-- Logs begin at Thu 2022-06-23 12:14:01 UTC, end at Thu 2022-06-23 14:07:39 UTC. -- Jun 23 12:52:11.140302 dv-cinder-847335-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 12:52:11.149859 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 12:52:11.151871 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 12:52:11 2022] *** Jun 23 12:52:11.151871 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 12:52:11.151871 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 12:52:11.151871 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: nodename: dv-cinder-847335-1-iscsi Jun 23 12:52:11.151871 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: machine: x86_64 Jun 23 12:52:11.151871 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: clock source: unix Jun 23 12:52:11.151871 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: pcre jit disabled Jun 23 12:52:11.151871 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: detected number of CPU cores: 4 Jun 23 12:52:11.151871 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: current working directory: / Jun 23 12:52:11.151871 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: detected binary path: /usr/bin/uwsgi-core Jun 23 12:52:11.152427 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: your processes number limit is 47680 Jun 23 12:52:11.152427 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: your memory page size is 4096 bytes Jun 23 12:52:11.152427 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: detected max file descriptor number: 2048 Jun 23 12:52:11.152427 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: lock engine: pthread robust mutexes Jun 23 12:52:11.152427 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: thunder lock: enabled Jun 23 12:52:11.152427 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 12:52:11.152427 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 12:52:11.195504 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: Python main interpreter initialized at 0x55f6257509c0 Jun 23 12:52:11.195504 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: python threads support enabled Jun 23 12:52:11.195504 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: your server socket listen backlog is limited to 100 connections Jun 23 12:52:11.195504 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: your mercy for graceful operations on workers is 90 seconds Jun 23 12:52:11.195826 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 12:52:11.195903 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: *** Operational MODE: preforking *** Jun 23 12:52:11.196170 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: *** uWSGI is running in multiple interpreter mode *** Jun 23 12:52:11.196170 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: spawned uWSGI master process (pid: 80247) Jun 23 12:52:11.196363 dv-cinder-847335-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 23 12:52:11.197904 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: spawned uWSGI worker 1 (pid: 80258, cores: 1) Jun 23 12:52:11.197904 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: spawned uWSGI worker 2 (pid: 80259, cores: 1) Jun 23 12:52:11.197904 dv-cinder-847335-1-iscsi devstack@keystone.service[80247]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 12:52:16.633197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 12:52:16.633197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: from cryptography.utils import int_from_bytes Jun 23 12:52:16.633999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 12:52:16.633999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: from cryptography.utils import int_from_bytes Jun 23 12:52:16.635370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 12:52:16.635370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: from cryptography.utils import int_from_bytes Jun 23 12:52:16.635826 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 12:52:16.635826 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: from cryptography.utils import int_from_bytes Jun 23 12:52:16.682378 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 12:52:16.682567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 12:52:16.682763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] command line args: [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 12:52:16.683035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 12:52:16.683216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ================================================================================ {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 12:52:16.683300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 12:52:16.683473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 12:52:16.683549 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] admin_token = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.683664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] command line args: [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 12:52:16.683747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] config_dir = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.683893 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.683977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 12:52:16.684079 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] config_source = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.684156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ================================================================================ {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 12:52:16.684259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] debug = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.684342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] admin_token = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.684459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.684740 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] config_dir = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.684740 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.684868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.684928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] config_source = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.685060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.685169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] debug = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.685266 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.685360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.685483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.685584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.685691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.685801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.685895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_config_append = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.685986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.686084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.686191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.686293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_dir = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.686393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.686493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_file = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.686593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_config_append = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.686693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.686819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.686819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_dir = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.687013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.687094 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_file = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.687216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.687297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.687374 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.687504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.687580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.687702 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.687783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.687859 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.687992 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.688070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.688190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.688266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.688387 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.688468 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.688547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.688679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.688756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.688905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.688992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.689133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.689218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.689362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.689438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.689591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.689701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.689833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.690075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.690204 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.690344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.690533 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] publish_errors = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.690622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.690810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.690891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.690990 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.691074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] publish_errors = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.691225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.691351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.691519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.691594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.691699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.691778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] standard_threads = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.691947 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.692029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.692178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.692263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.692368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.692445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] standard_threads = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.692546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] use_journal = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.692628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.692746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] use_json = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.692891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.692976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] use_stderr = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.693067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.693143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] use_syslog = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.693242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] use_journal = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.693324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.693467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] use_json = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.693541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.693610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] use_stderr = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.693737 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] use_syslog = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.693818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.693966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:52:16.694050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.694219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.694295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.694454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.694536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.694708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.694802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.694940 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.695022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.695183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.695260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.695415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.695501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.695659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.695737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.695893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.695969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.696128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.696212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.696368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.696443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.696608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.696710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.696878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.696962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.697121 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.697197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.697353 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.697429 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.697596 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.697686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.697841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.697923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.698074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.698150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.698308 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.698391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.698562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.698638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.698805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.698881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.699025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.699098 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.699274 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.699364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.699512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.699587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.699745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.699823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.699977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.700053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.700209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.700283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.700436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.700513 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.700679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.700769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.700923 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.701001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.701151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.701233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.701399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.701475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.701623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.701704 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.701851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.701935 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.702093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.702170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.702324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.702430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.702541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.702647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.702778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.702880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.703010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.703114 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.703221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.703317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.703469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.703557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.703681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.703763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.703875 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.703954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.704102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.704179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.704328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.704414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.704560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.704645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.704813 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.704887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.705041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.705123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.705275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.705359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.705498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.705574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.705728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.705804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.705959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.706044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.706192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.706273 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.706417 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.706493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.706650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.706747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.706882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.706969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.707651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.707734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.707888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.707982 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.708126 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.708259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.708339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.708409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.708579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.708848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.708848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.709008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.709080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.709150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.709295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.709384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.709531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.709609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.709767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.709845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.709994 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.710078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.710228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.710313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.710462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.710540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.710725 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.710882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.710963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.711035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.711181 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.711258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.711418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.711503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.711655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.711731 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.711886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.711962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.712118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.712205 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.712358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.712436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.712589 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.712710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.712849 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.712937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.713086 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.713171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.713315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.713392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.713548 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.713624 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.713777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.713852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.714012 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.714099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.714243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.714320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.714491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.714569 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.714728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.714810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.714962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.715039 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.715193 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.715270 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.715426 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.715503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.715656 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.715742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.715884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.715962 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.716112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.716188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.716338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.716415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.716565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.716644 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.716818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.716902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.717051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.717129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.717279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.717358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.717515 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.717594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.717749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.717825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.717992 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.718071 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.718225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.718302 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.718458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.external = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.718533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.718691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.718769 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.718945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.719027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.719176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.external = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.719254 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.719404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.719491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.password = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.719639 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] auth.token = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.719723 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.719878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.719955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.720114 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.720191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.password = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.720338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] auth.token = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.720415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.720572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.720650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.720831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.720910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.721076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.721155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.721299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.721376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.721532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.721608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.721781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.721861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.722004 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.722083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.722236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.722323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.722480 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.722566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.723351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.723447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.723551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.723630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.723786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.723867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.724026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.724104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.724260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.724338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.724520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.724600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.724795 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.724877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.725030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.725187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.725263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.725340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.725549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.725628 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.725793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.725879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.726029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.726114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.726269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.726347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.726518 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.726604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.726750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.726827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.726987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.727071 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.727232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.727318 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.727468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.727553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.727694 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.727771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.727939 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.728025 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.728174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.728253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.728427 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.728504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.728691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.728786 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.728920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.728997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.729157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.729233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.729400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.729486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.729635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.729719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.729873 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.729951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.730114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.730203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.730345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.730422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.730576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.730655 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.730820 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.730908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.731049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.731126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.731283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.731359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.731514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.731600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.731745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.731822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.731979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.732056 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.732207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.732339 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.732420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.732492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.732676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.732758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.732927 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.733015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.733169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.733247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.733421 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.733498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.733664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.733750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.733892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.733969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.734129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.734206 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.734362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.734441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.734586 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.734663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.734819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.734896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.735046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.735125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.735279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.735357 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.735508 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.735584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.735742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.735821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.735987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.736073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.736215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.736294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.736458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.736538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.736720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.736803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.736955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.737033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.737191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.737293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.737423 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.737548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.737670 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.737753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.737893 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.737972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.738134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.738211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.738410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.738490 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.738648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.738727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.738895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.738972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.739130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.739208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.739359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.739437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.739590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.739669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.739832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.739909 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.740061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.740140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.740288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.740372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.740529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.740605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.740792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.740873 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.741062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.741153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.741305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.741471 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.741557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.741710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.741789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.742018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.742094 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.742256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.742341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.742499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.742576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.742732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.742811 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.742959 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.743172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.743252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.743419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.743496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.743655 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.743733 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.743886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.743965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.744133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.744211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.744379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.744457 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.744615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.744708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.744884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.744961 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.745129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.745206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.745358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.745437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.745604 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.745681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.745841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.745919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.746077 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.746156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.746311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.746390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.746543 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.746620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.746784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.746862 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.747015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.747092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.747249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.747326 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.747481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.747560 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.747713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.747790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.747955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.748033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.748178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.748252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.748419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.748496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.748700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.748849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.748975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.749098 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.749220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.749342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.749464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.749594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.749717 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.749839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.749960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.750083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.750204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.750334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.750469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.750594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.750715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.750837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.750958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.751088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.751211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.751331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.751453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.751574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.751695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.751824 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.751946 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.752083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.752206 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.752333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.752455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.752603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] role.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.752791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.752892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] role.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.752970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.753042 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.753112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.753196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.753270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.753340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.753410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] role.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.753480 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.753549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] role.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.753627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.753699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.753769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.753909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.754013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.754158 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.754267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.754404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.754516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.754648 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.754752 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.754893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.755001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.755136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.755248 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.755379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.755497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.755622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.755745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.755869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.756080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.756158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.756324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.756402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.756566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.756649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.756835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.756914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.757105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.757227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.757354 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.757461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.757589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.757709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.757842 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.757955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.758093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.758199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.758332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.758444 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.758565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.758674 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.758797 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.758924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.759031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.759172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.759281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.759407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.759537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.759650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.759785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.759863 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.760024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.760110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.760261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.760338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.760490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.760639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.760765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.770212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.770300 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.770362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.770435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.770766 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.770830 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.770902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.770902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771208 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771497 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771720 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.771999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772069 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772287 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772571 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.772941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.connection = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773326 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.connection = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.773981 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774202 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774564 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774846 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.774980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775201 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775271 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775341 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775859 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 12:52:16.775920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:52:16.775920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 12:52:16.800220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.800451 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.800696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.801389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.801712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.802008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.809722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.811141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.837917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.838154 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.839196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.839428 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.980459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:16.983344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.029317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.029437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.029548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.029657 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.093677 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.093910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.094006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.094136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.094257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.094340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.094458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.094542 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.094682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.094765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.094902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.095120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.119186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.119412 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.119529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.119611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.119686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.119819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.119904 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.120038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.120123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.120252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.120336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.120492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.120630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.120733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.131975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.132253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.144490 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.145340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.145489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.145824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.145973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.146055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.146198 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.146294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.146416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.146500 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.146625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.146706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.146834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.147047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:52:17.164028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.164233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 12:52:17.164570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.164800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 12:52:17.165077 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.165340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.165520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.165602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.165819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 12:52:17.165910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.166279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.166473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 12:52:17.166735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.166986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.167235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.167483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.176653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.176955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.177222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.177501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.178297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.178569 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.178833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.179109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.185823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.187388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.189117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.189397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.189676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.189956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.190235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.190492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.190665 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.190747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.190937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.191016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.191210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.191292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.192011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.192097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.192287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.192376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.192543 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.192827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.193094 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.193362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.193628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.193888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.218840 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.220367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.220450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.220743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.222064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.222337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.226546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.226940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.227222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.228113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.228498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.228799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.234595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.234835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.236055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.236330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.239875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.240161 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.240442 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.240749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.241023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.241292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.241373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.241559 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.241640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.241828 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.241912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.242166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.242437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.242706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.242971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.243233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.260530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.260828 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.261875 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.262146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.265492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.266818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.269120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.270044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.271241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.271631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.275312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.276640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.278927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.280231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.282607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.282907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.283187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.283467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.283740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.283896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.284014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.284187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.284470 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.284774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.285049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.285890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.303727 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.304008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.304275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.304545 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.304892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.305185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.305449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.305721 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.312458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.313555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.314186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.314461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.315245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.315525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.317795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.318093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.318395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.318700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.318780 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.319007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.319089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.319284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.319559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.319846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.332855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.333133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.333423 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.333555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.333702 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.333829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.334111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.334393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.335197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.335488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.335774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.335883 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.336172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.336463 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.353749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.354418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.357058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.357698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.360345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.360979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.362098 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.362701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.364285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.364559 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.364870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.364955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.365142 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.365418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.372212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.372780 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.373856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.374471 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.377116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.377406 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.377702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.377786 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.377984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.378067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.378367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.378639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.387689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.387972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.388251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.388332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.388529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.388828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.396437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.396744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.396959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:52:17.397040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.397231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.397312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.397503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.397586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.397771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.397886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.398036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.398178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.398408 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.398489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.398689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.398769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.398955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.399044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.399229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.399310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.399486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.399574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.399749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.399829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.400014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.400093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.400288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.400546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:52:17.438161 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f6257509c0 pid: 80258 (default app) Jun 23 12:52:17.439508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f6257509c0 pid: 80259 (default app) Jun 23 12:52:17.441585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e66250-d30f-4adb-a066-a8e658e373fd None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:17.441882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e66250-d30f-4adb-a066-a8e658e373fd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:17.442162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e66250-d30f-4adb-a066-a8e658e373fd None None] PATH_INFO: `/v3` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:17.448166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Thu Jun 23 12:52:17 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:26.097356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aeb87-7bf6-43f2-b6df-a06d2ae578cd None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:26.098405 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aeb87-7bf6-43f2-b6df-a06d2ae578cd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:26.098507 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aeb87-7bf6-43f2-b6df-a06d2ae578cd None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:26.102726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:26.108106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad14aa-914d-485f-a1ff-413f9143bd8e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:26.108543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad14aa-914d-485f-a1ff-413f9143bd8e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:26.108691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad14aa-914d-485f-a1ff-413f9143bd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:26.178911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: INFO dbcounter [None req-c4ad14aa-914d-485f-a1ff-413f9143bd8e None None] Registered counter for database keystone Jun 23 12:52:26.199998 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG oslo_db.sqlalchemy.engines [None req-c4ad14aa-914d-485f-a1ff-413f9143bd8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80258) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 12:52:26.206327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writer thread running {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 12:52:26.381526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG passlib.handlers.bcrypt [None req-c4ad14aa-914d-485f-a1ff-413f9143bd8e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80258) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 12:52:26.381881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG passlib.handlers.bcrypt [None req-c4ad14aa-914d-485f-a1ff-413f9143bd8e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80258) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 12:52:26.435629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c4ad14aa-914d-485f-a1ff-413f9143bd8e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:26.437310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c4ad14aa-914d-485f-a1ff-413f9143bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:26.556284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 12:52:26.679444 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aeb87-7bf6-43f2-b6df-a06d2ae578cd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:26.749794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: INFO dbcounter [None req-0e5aeb87-7bf6-43f2-b6df-a06d2ae578cd None None] Registered counter for database keystone Jun 23 12:52:26.768479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG oslo_db.sqlalchemy.engines [None req-0e5aeb87-7bf6-43f2-b6df-a06d2ae578cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 12:52:26.775174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writer thread running {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 12:52:26.895711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aeb87-7bf6-43f2-b6df-a06d2ae578cd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:26.900352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9d493-7a1a-432c-afb5-278b1c92a672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:26.901044 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9d493-7a1a-432c-afb5-278b1c92a672 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:26.901335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9d493-7a1a-432c-afb5-278b1c92a672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:26.901615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9d493-7a1a-432c-afb5-278b1c92a672 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:26.909730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9d493-7a1a-432c-afb5-278b1c92a672 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:26.962078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: WARNING keystone.common.rbac_enforcer.enforcer [None req-30a9d493-7a1a-432c-afb5-278b1c92a672 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 12:52:26.962450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9d493-7a1a-432c-afb5-278b1c92a672 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:26.972063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Thu Jun 23 12:52:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 12:52:26.977919 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad14aa-914d-485f-a1ff-413f9143bd8e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:26.992209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad14aa-914d-485f-a1ff-413f9143bd8e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:26.996611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e93bf-203f-4da7-b1ba-0067b9f84059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:26.998150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e93bf-203f-4da7-b1ba-0067b9f84059 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:26.998438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e93bf-203f-4da7-b1ba-0067b9f84059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:26.998718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e93bf-203f-4da7-b1ba-0067b9f84059 admin admin] PATH_INFO: `/v3/projects/573a8643ae104193ab15bb005adb20d6` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:27.002806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e93bf-203f-4da7-b1ba-0067b9f84059 admin admin] RBAC: Authorizing `identity:get_project(project_id=573a8643ae104193ab15bb005adb20d6)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:27.053938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8a6e93bf-203f-4da7-b1ba-0067b9f84059 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 12:52:27.054284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e93bf-203f-4da7-b1ba-0067b9f84059 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:27.058850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Thu Jun 23 12:52:26 2022] GET /identity/v3/projects/573a8643ae104193ab15bb005adb20d6 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:29.042754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b75e-727b-4e09-bb82-8ade280321b2 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.043293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b75e-727b-4e09-bb82-8ade280321b2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.043293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b75e-727b-4e09-bb82-8ade280321b2 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.047387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:29.053397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6e63-73a0-44ef-8666-b0ec68989d99 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.053826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6e63-73a0-44ef-8666-b0ec68989d99 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.053964 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6e63-73a0-44ef-8666-b0ec68989d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.072309 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a71d6e63-73a0-44ef-8666-b0ec68989d99 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:29.073865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a71d6e63-73a0-44ef-8666-b0ec68989d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:29.081739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 12:52:29.104167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295b75e-727b-4e09-bb82-8ade280321b2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:29.116715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295b75e-727b-4e09-bb82-8ade280321b2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:29.120889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877daed-3a76-4435-aa62-e24cfeb9fb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:29.121517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877daed-3a76-4435-aa62-e24cfeb9fb09 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.121800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877daed-3a76-4435-aa62-e24cfeb9fb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.122075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877daed-3a76-4435-aa62-e24cfeb9fb09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.129694 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877daed-3a76-4435-aa62-e24cfeb9fb09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:29.131477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877daed-3a76-4435-aa62-e24cfeb9fb09 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:29.140011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Thu Jun 23 12:52:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 12:52:29.145268 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d6e63-73a0-44ef-8666-b0ec68989d99 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:29.154519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d6e63-73a0-44ef-8666-b0ec68989d99 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:29.158856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8948b6-b076-41a6-94fe-a495cc3c4a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:29.159720 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8948b6-b076-41a6-94fe-a495cc3c4a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.160510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8948b6-b076-41a6-94fe-a495cc3c4a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.160844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8948b6-b076-41a6-94fe-a495cc3c4a4e admin admin] PATH_INFO: `/v3/users/8182fe078f1d405e804c7fa5779da52a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.162237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8948b6-b076-41a6-94fe-a495cc3c4a4e admin admin] RBAC: Authorizing `identity:get_user(user_id=8182fe078f1d405e804c7fa5779da52a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:29.164044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8948b6-b076-41a6-94fe-a495cc3c4a4e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:29.165634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Thu Jun 23 12:52:29 2022] GET /identity/v3/users/8182fe078f1d405e804c7fa5779da52a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:31.231395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64ec22-0d89-4a55-8aeb-fef87a56a2c8 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.231900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64ec22-0d89-4a55-8aeb-fef87a56a2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.231994 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64ec22-0d89-4a55-8aeb-fef87a56a2c8 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.233408 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:31.239274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3dab1-cbc4-4b2f-958b-d0aabb4cbfdf None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.239700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3dab1-cbc4-4b2f-958b-d0aabb4cbfdf None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.239903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3dab1-cbc4-4b2f-958b-d0aabb4cbfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.255347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2665c-f888-4107-ace9-b96e77cec477 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.255634 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2665c-f888-4107-ace9-b96e77cec477 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.255916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2665c-f888-4107-ace9-b96e77cec477 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.256197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f0a3dab1-cbc4-4b2f-958b-d0aabb4cbfdf None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:31.257282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:31.257426 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f0a3dab1-cbc4-4b2f-958b-d0aabb4cbfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:31.262232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5c3db-c59f-4b82-b0e1-89c64926739e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.262524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5c3db-c59f-4b82-b0e1-89c64926739e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.262807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5c3db-c59f-4b82-b0e1-89c64926739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.302045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG passlib.handlers.bcrypt [None req-5ca5c3db-c59f-4b82-b0e1-89c64926739e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80259) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 12:52:31.302490 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG passlib.handlers.bcrypt [None req-5ca5c3db-c59f-4b82-b0e1-89c64926739e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80259) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 12:52:31.337857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:31.347871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5ca5c3db-c59f-4b82-b0e1-89c64926739e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:31.349493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5ca5c3db-c59f-4b82-b0e1-89c64926739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:31.361481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3dab1-cbc4-4b2f-958b-d0aabb4cbfdf None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:31.385057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:31.447594 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:52:31.464019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3dab1-cbc4-4b2f-958b-d0aabb4cbfdf None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:31.469854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5c3db-c59f-4b82-b0e1-89c64926739e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:31.498489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60643f1-23ce-407e-9abc-52dab922b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:31.499289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60643f1-23ce-407e-9abc-52dab922b915 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.499579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60643f1-23ce-407e-9abc-52dab922b915 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.499865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60643f1-23ce-407e-9abc-52dab922b915 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.510899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60643f1-23ce-407e-9abc-52dab922b915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-f60643f1-23ce-407e-9abc-52dab922b915 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:31.522870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:31.523808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:52:31.524748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:31.529862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60643f1-23ce-407e-9abc-52dab922b915 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:31.570176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5c3db-c59f-4b82-b0e1-89c64926739e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:31.572708 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:31.607098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b76119-4211-4728-8f63-58ed73a9ec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:31.607922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b76119-4211-4728-8f63-58ed73a9ec71 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.608210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b76119-4211-4728-8f63-58ed73a9ec71 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.608501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b76119-4211-4728-8f63-58ed73a9ec71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.614481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:31.632558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60643f1-23ce-407e-9abc-52dab922b915 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:31.665662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a399-24aa-4548-b494-9aeb9b1dc50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:31.666324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a399-24aa-4548-b494-9aeb9b1dc50e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.666613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a399-24aa-4548-b494-9aeb9b1dc50e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.666892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a399-24aa-4548-b494-9aeb9b1dc50e None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.667635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2a399-24aa-4548-b494-9aeb9b1dc50e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:31.667942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2a399-24aa-4548-b494-9aeb9b1dc50e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:31.669362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2a399-24aa-4548-b494-9aeb9b1dc50e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:31.676837 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b76119-4211-4728-8f63-58ed73a9ec71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:31.678349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b76119-4211-4728-8f63-58ed73a9ec71 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:31.681191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:31.686589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a399-24aa-4548-b494-9aeb9b1dc50e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:31.775405 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 12:52:31.780839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b76119-4211-4728-8f63-58ed73a9ec71 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:31.783450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:31.783826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a399-24aa-4548-b494-9aeb9b1dc50e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:31.817536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7c711-c3ef-40ec-9977-e576c990d7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:31.818758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7c711-c3ef-40ec-9977-e576c990d7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.818758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7c711-c3ef-40ec-9977-e576c990d7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.818976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7c711-c3ef-40ec-9977-e576c990d7b7 None admin] PATH_INFO: `/v3/users/8182fe078f1d405e804c7fa5779da52a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.820117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7c711-c3ef-40ec-9977-e576c990d7b7 None admin] RBAC: Authorizing `identity:get_user(user_id=8182fe078f1d405e804c7fa5779da52a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:31.821623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7c711-c3ef-40ec-9977-e576c990d7b7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:31.823254 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:31 2022] GET /identity/v3/users/8182fe078f1d405e804c7fa5779da52a => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:31.828424 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7c711-c3ef-40ec-9977-e576c990d7b7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:31.842326 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:31.877653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b76119-4211-4728-8f63-58ed73a9ec71 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:31.909575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96554779-3a65-4a96-97e9-7727ecaafdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:31.910866 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96554779-3a65-4a96-97e9-7727ecaafdda None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.911145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96554779-3a65-4a96-97e9-7727ecaafdda None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.911424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96554779-3a65-4a96-97e9-7727ecaafdda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.925094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7c711-c3ef-40ec-9977-e576c990d7b7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:31.929479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96554779-3a65-4a96-97e9-7727ecaafdda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:31.930926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96554779-3a65-4a96-97e9-7727ecaafdda None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-96554779-3a65-4a96-97e9-7727ecaafdda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:31.951375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:31.952205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:31.953036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:31.953036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:31.953036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:31.953036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:52:31.953036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 9/18] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:31.958495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96554779-3a65-4a96-97e9-7727ecaafdda None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:31.961137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e134-6cf0-457a-a3ce-c4fdbf3e79b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:31.961938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e134-6cf0-457a-a3ce-c4fdbf3e79b2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.962226 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e134-6cf0-457a-a3ce-c4fdbf3e79b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.962514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e134-6cf0-457a-a3ce-c4fdbf3e79b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.963693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936e134-6cf0-457a-a3ce-c4fdbf3e79b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:31.965183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936e134-6cf0-457a-a3ce-c4fdbf3e79b2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:31.966788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 10/19] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:31.972911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e134-6cf0-457a-a3ce-c4fdbf3e79b2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:32.013629 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:32.050116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:32.059369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96554779-3a65-4a96-97e9-7727ecaafdda None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:32.068652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e134-6cf0-457a-a3ce-c4fdbf3e79b2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:32.094052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1eafea-4406-4e5b-ba32-9d8399d9b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:32.094719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eafea-4406-4e5b-ba32-9d8399d9b4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:32.095006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eafea-4406-4e5b-ba32-9d8399d9b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:32.095295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eafea-4406-4e5b-ba32-9d8399d9b4f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:32.096023 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1eafea-4406-4e5b-ba32-9d8399d9b4f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:32.096331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1eafea-4406-4e5b-ba32-9d8399d9b4f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:32.097808 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1eafea-4406-4e5b-ba32-9d8399d9b4f1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:32.102591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfca32-b3d0-4a8c-990d-81d29fe46100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:32.103248 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfca32-b3d0-4a8c-990d-81d29fe46100 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:32.103539 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfca32-b3d0-4a8c-990d-81d29fe46100 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:32.103823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfca32-b3d0-4a8c-990d-81d29fe46100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:32.104651 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfca32-b3d0-4a8c-990d-81d29fe46100 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.domain.id=default, user.id=8182fe078f1d405e804c7fa5779da52a) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:32.104995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfca32-b3d0-4a8c-990d-81d29fe46100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:32.106420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfca32-b3d0-4a8c-990d-81d29fe46100 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:32.113410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1322 bytes} [Thu Jun 23 12:52:31 2022] GET /identity/v3/role_assignments?user.id=8182fe078f1d405e804c7fa5779da52a&scope.domain.id=default&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:32.114846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:34.770202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb624f5-dae1-4447-849c-fabaa0b45646 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.771478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb624f5-dae1-4447-849c-fabaa0b45646 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.771987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb624f5-dae1-4447-849c-fabaa0b45646 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.773596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:34.779165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4b7c-2bfd-4be5-9d3f-ecb448e744bb None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.779601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4b7c-2bfd-4be5-9d3f-ecb448e744bb None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.779727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4b7c-2bfd-4be5-9d3f-ecb448e744bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.798073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5abfd2-6d2c-4748-a40e-60c975bf9a9f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.798677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5abfd2-6d2c-4748-a40e-60c975bf9a9f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.798961 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5abfd2-6d2c-4748-a40e-60c975bf9a9f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.800349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 13/23] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:34.803168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2b9c4b7c-2bfd-4be5-9d3f-ecb448e744bb None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:34.804765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2b9c4b7c-2bfd-4be5-9d3f-ecb448e744bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:34.805616 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb07f9-acd5-410f-8bbe-62551bb4259e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.805897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb07f9-acd5-410f-8bbe-62551bb4259e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.806325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb07f9-acd5-410f-8bbe-62551bb4259e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.827191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a7fb07f9-acd5-410f-8bbe-62551bb4259e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:34.828726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a7fb07f9-acd5-410f-8bbe-62551bb4259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:34.881240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 11/24] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:34.890088 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df9e42-02bb-4ddb-ae76-23bc182d761e None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.890382 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df9e42-02bb-4ddb-ae76-23bc182d761e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.890668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df9e42-02bb-4ddb-ae76-23bc182d761e None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.891970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 12/25] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:34.893127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a85c7-6b50-4609-aa19-45cdcee2820f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.893413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a85c7-6b50-4609-aa19-45cdcee2820f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.893694 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a85c7-6b50-4609-aa19-45cdcee2820f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.894926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 13/26] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:34.901381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1171ef1-ec23-475c-a79c-41aa9447f3ab None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.901675 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1171ef1-ec23-475c-a79c-41aa9447f3ab None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.901963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1171ef1-ec23-475c-a79c-41aa9447f3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.903916 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 14/27] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:52:34.908136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70d3e0-123a-4524-8fc3-0e6e58e3dcd9 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.908713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70d3e0-123a-4524-8fc3-0e6e58e3dcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.909160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70d3e0-123a-4524-8fc3-0e6e58e3dcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.926204 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ca70d3e0-123a-4524-8fc3-0e6e58e3dcd9 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:34.927648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ca70d3e0-123a-4524-8fc3-0e6e58e3dcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:34.931280 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e1171ef1-ec23-475c-a79c-41aa9447f3ab None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:34.932331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e1171ef1-ec23-475c-a79c-41aa9447f3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:34.982192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.008079 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 14/28] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:52:35.008906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1171ef1-ec23-475c-a79c-41aa9447f3ab None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.014773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 15/29] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:52:35.015811 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70d3e0-123a-4524-8fc3-0e6e58e3dcd9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.019304 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.138725 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1171ef1-ec23-475c-a79c-41aa9447f3ab None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.157906 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70d3e0-123a-4524-8fc3-0e6e58e3dcd9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.180304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb1885-6d1f-41ec-856e-24bbd0ff21e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.181108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb1885-6d1f-41ec-856e-24bbd0ff21e0 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.181464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb1885-6d1f-41ec-856e-24bbd0ff21e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.181816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb1885-6d1f-41ec-856e-24bbd0ff21e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.182635 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb1885-6d1f-41ec-856e-24bbd0ff21e0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.184928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb1885-6d1f-41ec-856e-24bbd0ff21e0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.199101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cce3e7-9c5e-4435-a633-b9b655873045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.199779 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cce3e7-9c5e-4435-a633-b9b655873045 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.200066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cce3e7-9c5e-4435-a633-b9b655873045 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.200347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cce3e7-9c5e-4435-a633-b9b655873045 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.201208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cce3e7-9c5e-4435-a633-b9b655873045 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.202697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cce3e7-9c5e-4435-a633-b9b655873045 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.412989 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 15/30] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jun 23 12:52:35 2022] POST /identity/v3/roles => generated 219 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:35.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb1885-6d1f-41ec-856e-24bbd0ff21e0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.436928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 16/31] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jun 23 12:52:35 2022] POST /identity/v3/roles => generated 225 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:35.438449 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cce3e7-9c5e-4435-a633-b9b655873045 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.510387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.593055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.656503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cce3e7-9c5e-4435-a633-b9b655873045 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.661635 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb1885-6d1f-41ec-856e-24bbd0ff21e0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.694894 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8f29f-9e0f-488e-9c4b-2211fae8d4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.695936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8f29f-9e0f-488e-9c4b-2211fae8d4bf None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.696585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8f29f-9e0f-488e-9c4b-2211fae8d4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.697117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8f29f-9e0f-488e-9c4b-2211fae8d4bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.706877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a721a7b-2b92-40d6-ab97-7cd42d446c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.709824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a721a7b-2b92-40d6-ab97-7cd42d446c46 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.710270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a721a7b-2b92-40d6-ab97-7cd42d446c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.710725 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a721a7b-2b92-40d6-ab97-7cd42d446c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.713765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8f29f-9e0f-488e-9c4b-2211fae8d4bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c9e8f29f-9e0f-488e-9c4b-2211fae8d4bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:35.722728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:35.723744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:35.724684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:35.724684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:35.724684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:35.724684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:35.724684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:35.724684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:35.724684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:35.724684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:35.724684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:35.724684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:35.724684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:35.724684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:52:35.725276 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a721a7b-2b92-40d6-ab97-7cd42d446c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.726259 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a721a7b-2b92-40d6-ab97-7cd42d446c46 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.727005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 17/32] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:35.745263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8f29f-9e0f-488e-9c4b-2211fae8d4bf None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-5a721a7b-2b92-40d6-ab97-7cd42d446c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:35.749000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:35.749990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:35.750847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:35.750847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:35.750847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:35.750847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:52:35.750847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 16/33] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:35.756354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a721a7b-2b92-40d6-ab97-7cd42d446c46 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.864499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.874246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8f29f-9e0f-488e-9c4b-2211fae8d4bf None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.877774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a721a7b-2b92-40d6-ab97-7cd42d446c46 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.901250 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.912583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e8ffa-6434-4666-b47b-a488ff93a04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.914591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e8ffa-6434-4666-b47b-a488ff93a04a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.914591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e8ffa-6434-4666-b47b-a488ff93a04a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.914591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e8ffa-6434-4666-b47b-a488ff93a04a None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.915385 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e8ffa-6434-4666-b47b-a488ff93a04a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:35.915582 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d1cea-a033-4d0e-8af3-ca35d9207959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.916062 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e8ffa-6434-4666-b47b-a488ff93a04a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.916247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d1cea-a033-4d0e-8af3-ca35d9207959 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.916540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d1cea-a033-4d0e-8af3-ca35d9207959 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.916856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d1cea-a033-4d0e-8af3-ca35d9207959 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.917590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d1cea-a033-4d0e-8af3-ca35d9207959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:35.917904 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d1cea-a033-4d0e-8af3-ca35d9207959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.918716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e8ffa-6434-4666-b47b-a488ff93a04a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.919270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d1cea-a033-4d0e-8af3-ca35d9207959 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.928157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 18/34] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:35.929700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f100-4945-46be-b2b9-89a67c448328 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.929986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f100-4945-46be-b2b9-89a67c448328 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.930313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f100-4945-46be-b2b9-89a67c448328 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.933172 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 19/35] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:35.933566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892f100-4945-46be-b2b9-89a67c448328 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.936888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 17/36] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:35.939386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0e360-0e22-4b2e-98fe-2e26406a9cd2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.939824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0e360-0e22-4b2e-98fe-2e26406a9cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.940252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0e360-0e22-4b2e-98fe-2e26406a9cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.958766 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b6d0e360-0e22-4b2e-98fe-2e26406a9cd2 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:35.960358 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b6d0e360-0e22-4b2e-98fe-2e26406a9cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:36.034441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 18/37] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:36.044811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0e360-0e22-4b2e-98fe-2e26406a9cd2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.050260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892f100-4945-46be-b2b9-89a67c448328 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.095789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074fa51-0f31-4f0d-a0bd-5bb0ea347035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.096788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074fa51-0f31-4f0d-a0bd-5bb0ea347035 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.097141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074fa51-0f31-4f0d-a0bd-5bb0ea347035 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.097685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074fa51-0f31-4f0d-a0bd-5bb0ea347035 None admin] PATH_INFO: `/v3/users/8182fe078f1d405e804c7fa5779da52a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.099066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074fa51-0f31-4f0d-a0bd-5bb0ea347035 None admin] RBAC: Authorizing `identity:get_user(user_id=8182fe078f1d405e804c7fa5779da52a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.100713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074fa51-0f31-4f0d-a0bd-5bb0ea347035 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.102348 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/users/8182fe078f1d405e804c7fa5779da52a => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:36.103216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074fa51-0f31-4f0d-a0bd-5bb0ea347035 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.138904 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:36.160853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0e360-0e22-4b2e-98fe-2e26406a9cd2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.161199 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:36.193578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81109b4-f75d-4ac9-9c26-aa38e6e0e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.194239 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81109b4-f75d-4ac9-9c26-aa38e6e0e18f None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.194526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81109b4-f75d-4ac9-9c26-aa38e6e0e18f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.194806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81109b4-f75d-4ac9-9c26-aa38e6e0e18f None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.195742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81109b4-f75d-4ac9-9c26-aa38e6e0e18f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.197247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81109b4-f75d-4ac9-9c26-aa38e6e0e18f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.204635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074fa51-0f31-4f0d-a0bd-5bb0ea347035 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.239162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad3750-db58-47d9-9ee1-b6e876d2b4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.239754 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad3750-db58-47d9-9ee1-b6e876d2b4ac None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.240041 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad3750-db58-47d9-9ee1-b6e876d2b4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.240321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad3750-db58-47d9-9ee1-b6e876d2b4ac None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.241100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad3750-db58-47d9-9ee1-b6e876d2b4ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.242483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad3750-db58-47d9-9ee1-b6e876d2b4ac None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.269556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:52:36 2022] POST /identity/v3/projects => generated 301 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:36.270391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81109b4-f75d-4ac9-9c26-aa38e6e0e18f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.356690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jun 23 12:52:36 2022] POST /identity/v3/roles => generated 223 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:36.356690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7cdb1-6b79-4b1c-9a3a-5e58f6396ae7 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.356690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7cdb1-6b79-4b1c-9a3a-5e58f6396ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.356690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7cdb1-6b79-4b1c-9a3a-5e58f6396ae7 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.356690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 22/41] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:36.357456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac4dc6-abce-4571-a0ae-dc54b9da7b1f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.357815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac4dc6-abce-4571-a0ae-dc54b9da7b1f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.358105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac4dc6-abce-4571-a0ae-dc54b9da7b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.381955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-45ac4dc6-abce-4571-a0ae-dc54b9da7b1f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:36.383338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-45ac4dc6-abce-4571-a0ae-dc54b9da7b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:36.402260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81109b4-f75d-4ac9-9c26-aa38e6e0e18f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.451815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:36.462828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52f047-3efc-4a6b-b4b4-e78f66dbf047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.469213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52f047-3efc-4a6b-b4b4-e78f66dbf047 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.469213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52f047-3efc-4a6b-b4b4-e78f66dbf047 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.469213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52f047-3efc-4a6b-b4b4-e78f66dbf047 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.469213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52f047-3efc-4a6b-b4b4-e78f66dbf047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.469213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52f047-3efc-4a6b-b4b4-e78f66dbf047 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.471270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 20/42] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:36.478309 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 23/43] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:52:36.478497 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52f047-3efc-4a6b-b4b4-e78f66dbf047 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.502964 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac4dc6-abce-4571-a0ae-dc54b9da7b1f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.560117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:36.589514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52f047-3efc-4a6b-b4b4-e78f66dbf047 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.622200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac4dc6-abce-4571-a0ae-dc54b9da7b1f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.623058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c5f4c-a392-4248-9bf0-ca301ee281ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.623929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c5f4c-a392-4248-9bf0-ca301ee281ba None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.624214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c5f4c-a392-4248-9bf0-ca301ee281ba None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.624495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c5f4c-a392-4248-9bf0-ca301ee281ba None admin] PATH_INFO: `/v3/domains/default/users/8182fe078f1d405e804c7fa5779da52a/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.626784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c5f4c-a392-4248-9bf0-ca301ee281ba None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8182fe078f1d405e804c7fa5779da52a, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.628231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c5f4c-a392-4248-9bf0-ca301ee281ba None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.702972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 21/44] 10.222.0.33 () {58 vars in 1361 bytes} [Thu Jun 23 12:52:36 2022] PUT /identity/v3/domains/default/users/8182fe078f1d405e804c7fa5779da52a/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:52:36.770504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21faf3-d90b-494f-816c-0f8276189b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.771552 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21faf3-d90b-494f-816c-0f8276189b29 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.771910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21faf3-d90b-494f-816c-0f8276189b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.772197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21faf3-d90b-494f-816c-0f8276189b29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.773673 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21faf3-d90b-494f-816c-0f8276189b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.775156 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21faf3-d90b-494f-816c-0f8276189b29 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.776917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 24/45] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:36.782645 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c5f4c-a392-4248-9bf0-ca301ee281ba None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.843413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:36.888232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c5f4c-a392-4248-9bf0-ca301ee281ba None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.921864 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b2e71-7fda-40e5-8f65-6ad3da68c329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.922559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2e71-7fda-40e5-8f65-6ad3da68c329 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.922848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2e71-7fda-40e5-8f65-6ad3da68c329 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.923127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2e71-7fda-40e5-8f65-6ad3da68c329 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.923843 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b2e71-7fda-40e5-8f65-6ad3da68c329 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.925360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b2e71-7fda-40e5-8f65-6ad3da68c329 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:37.115839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 22/46] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:52:36 2022] POST /identity/v3/projects => generated 312 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:38.740900 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5d1fe-f5f0-431b-b3f1-20a7b84d44b2 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:38.741420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5d1fe-f5f0-431b-b3f1-20a7b84d44b2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:38.741505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5d1fe-f5f0-431b-b3f1-20a7b84d44b2 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:38.742853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 25/47] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:38.748171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0490b-b466-4a0b-9f76-c07888cceb22 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:38.748564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0490b-b466-4a0b-9f76-c07888cceb22 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:38.748766 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0490b-b466-4a0b-9f76-c07888cceb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:38.765711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-def0490b-b466-4a0b-9f76-c07888cceb22 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:38.766976 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-def0490b-b466-4a0b-9f76-c07888cceb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:38.833134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 23/48] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:38.855937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5d1fe-f5f0-431b-b3f1-20a7b84d44b2 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:38.957819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5d1fe-f5f0-431b-b3f1-20a7b84d44b2 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:38.970529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:38.991407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf23e33-8726-45ad-8d19-1b37e15d56ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:38.992140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf23e33-8726-45ad-8d19-1b37e15d56ce None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:38.992428 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf23e33-8726-45ad-8d19-1b37e15d56ce None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:38.992733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf23e33-8726-45ad-8d19-1b37e15d56ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.002857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf23e33-8726-45ad-8d19-1b37e15d56ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-ccf23e33-8726-45ad-8d19-1b37e15d56ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:39.011349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:39.012224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:52:39.013004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 26/49] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:39.019590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0490b-b466-4a0b-9f76-c07888cceb22 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.062252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:39.113322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ded2-0869-4576-96ad-24cd870a74e9 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.113617 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ded2-0869-4576-96ad-24cd870a74e9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.113904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ded2-0869-4576-96ad-24cd870a74e9 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.115294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 27/50] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:39.120215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ec420-8042-44e3-8d94-35ceee820e88 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.120472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0490b-b466-4a0b-9f76-c07888cceb22 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.120591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ec420-8042-44e3-8d94-35ceee820e88 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.120864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ec420-8042-44e3-8d94-35ceee820e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.137557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-140ec420-8042-44e3-8d94-35ceee820e88 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:39.138756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-140ec420-8042-44e3-8d94-35ceee820e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:39.154504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b934-22b3-409b-a63a-3dc514aa3eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.155166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b934-22b3-409b-a63a-3dc514aa3eba None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.155449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b934-22b3-409b-a63a-3dc514aa3eba None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.155735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b934-22b3-409b-a63a-3dc514aa3eba None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.156477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802b934-22b3-409b-a63a-3dc514aa3eba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:39.156819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802b934-22b3-409b-a63a-3dc514aa3eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.158195 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802b934-22b3-409b-a63a-3dc514aa3eba None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.169850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 24/51] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:39.175204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b934-22b3-409b-a63a-3dc514aa3eba None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.204856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 28/52] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:52:39.227293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ec420-8042-44e3-8d94-35ceee820e88 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.272135 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b934-22b3-409b-a63a-3dc514aa3eba None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.273683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:39.306980 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6b8fa-6705-40cf-9050-535bd1fbd783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.307855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6b8fa-6705-40cf-9050-535bd1fbd783 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.308180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6b8fa-6705-40cf-9050-535bd1fbd783 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.308459 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6b8fa-6705-40cf-9050-535bd1fbd783 None admin] PATH_INFO: `/v3/users/8182fe078f1d405e804c7fa5779da52a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.309718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6b8fa-6705-40cf-9050-535bd1fbd783 None admin] RBAC: Authorizing `identity:get_user(user_id=8182fe078f1d405e804c7fa5779da52a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.311171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6b8fa-6705-40cf-9050-535bd1fbd783 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.312844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 25/53] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/users/8182fe078f1d405e804c7fa5779da52a => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:39.318184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6b8fa-6705-40cf-9050-535bd1fbd783 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.326739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ec420-8042-44e3-8d94-35ceee820e88 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.328240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:39.361189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdd8e5-4504-4ab8-87f2-96f1a727e64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.361986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdd8e5-4504-4ab8-87f2-96f1a727e64b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.362272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdd8e5-4504-4ab8-87f2-96f1a727e64b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.362553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdd8e5-4504-4ab8-87f2-96f1a727e64b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.364059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdd8e5-4504-4ab8-87f2-96f1a727e64b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.365251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdd8e5-4504-4ab8-87f2-96f1a727e64b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.366878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 29/54] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:39.372355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdd8e5-4504-4ab8-87f2-96f1a727e64b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.416169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6b8fa-6705-40cf-9050-535bd1fbd783 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.448224 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a5ebf-ad83-4f29-a4cf-77f07968dea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.449053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a5ebf-ad83-4f29-a4cf-77f07968dea2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.449341 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a5ebf-ad83-4f29-a4cf-77f07968dea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.449624 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a5ebf-ad83-4f29-a4cf-77f07968dea2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.450802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a5ebf-ad83-4f29-a4cf-77f07968dea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.452234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a5ebf-ad83-4f29-a4cf-77f07968dea2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.453881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 26/55] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:39.459504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a5ebf-ad83-4f29-a4cf-77f07968dea2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.470861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdd8e5-4504-4ab8-87f2-96f1a727e64b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.499975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:39.504376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da4581-9d30-4947-84c8-80b4be720549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.505064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da4581-9d30-4947-84c8-80b4be720549 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.505347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da4581-9d30-4947-84c8-80b4be720549 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.505625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da4581-9d30-4947-84c8-80b4be720549 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.506399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da4581-9d30-4947-84c8-80b4be720549 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.510464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da4581-9d30-4947-84c8-80b4be720549 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.558607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a5ebf-ad83-4f29-a4cf-77f07968dea2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.590583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671706c8-534f-4d4b-acea-567b34e2efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.591237 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671706c8-534f-4d4b-acea-567b34e2efba None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.591524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671706c8-534f-4d4b-acea-567b34e2efba None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.591803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671706c8-534f-4d4b-acea-567b34e2efba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.592711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671706c8-534f-4d4b-acea-567b34e2efba None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.domain.id=default, user.id=8182fe078f1d405e804c7fa5779da52a) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:39.592979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671706c8-534f-4d4b-acea-567b34e2efba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.594410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671706c8-534f-4d4b-acea-567b34e2efba None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.602601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 27/56] 10.222.0.33 () {56 vars in 1322 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/role_assignments?user.id=8182fe078f1d405e804c7fa5779da52a&scope.domain.id=default&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:39.616739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 30/57] 10.222.0.33 () {60 vars in 1140 bytes} [Thu Jun 23 12:52:39 2022] POST /identity/v3/projects => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:52:41.658806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbec04f-0329-4296-b05c-7086d3c77f7e None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:41.659327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbec04f-0329-4296-b05c-7086d3c77f7e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:41.659431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbec04f-0329-4296-b05c-7086d3c77f7e None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:41.661285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 28/58] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:41.666562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db1735-751b-4276-9ede-b2f8e09c6aa0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:41.666947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db1735-751b-4276-9ede-b2f8e09c6aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:41.667135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db1735-751b-4276-9ede-b2f8e09c6aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:41.684120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-49db1735-751b-4276-9ede-b2f8e09c6aa0 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:41.685349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-49db1735-751b-4276-9ede-b2f8e09c6aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:41.701125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:41.749276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 31/59] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:41.773540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbec04f-0329-4296-b05c-7086d3c77f7e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:41.871446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbec04f-0329-4296-b05c-7086d3c77f7e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:41.872947 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:41.904220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4598044-f166-445f-9e90-455c4c3f1b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:41.905028 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4598044-f166-445f-9e90-455c4c3f1b17 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:41.905320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4598044-f166-445f-9e90-455c4c3f1b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:41.905603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4598044-f166-445f-9e90-455c4c3f1b17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:41.906776 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4598044-f166-445f-9e90-455c4c3f1b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:41.908222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4598044-f166-445f-9e90-455c4c3f1b17 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:41.910438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 29/60] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:41.915774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db1735-751b-4276-9ede-b2f8e09c6aa0 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:42.013812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db1735-751b-4276-9ede-b2f8e09c6aa0 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:42.047631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b784-68ef-4360-939c-5388c3b953d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:42.048311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b784-68ef-4360-939c-5388c3b953d9 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:42.048597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b784-68ef-4360-939c-5388c3b953d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:42.048903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b784-68ef-4360-939c-5388c3b953d9 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:42.049603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76b784-68ef-4360-939c-5388c3b953d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:42.051193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76b784-68ef-4360-939c-5388c3b953d9 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:42.148846 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 32/61] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:52:41 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:45.196300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dbacf-3ae3-4a23-89a9-e806f6796a63 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.197357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dbacf-3ae3-4a23-89a9-e806f6796a63 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.197877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dbacf-3ae3-4a23-89a9-e806f6796a63 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.199470 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 30/62] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:45.204687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99df298-0784-4145-80ad-a7443de72504 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.205497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99df298-0784-4145-80ad-a7443de72504 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.206067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99df298-0784-4145-80ad-a7443de72504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.228462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e99df298-0784-4145-80ad-a7443de72504 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:45.230056 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e99df298-0784-4145-80ad-a7443de72504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:45.232465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:45.318210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 33/63] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:45.353772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dbacf-3ae3-4a23-89a9-e806f6796a63 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:45.441940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615a0b9-ba90-4d7b-ae1c-fdb596ec051e None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.442235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615a0b9-ba90-4d7b-ae1c-fdb596ec051e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.442704 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615a0b9-ba90-4d7b-ae1c-fdb596ec051e None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.444218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 34/64] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:45.458962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf71657-e807-44c5-a64a-284c7f1c229e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.459254 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf71657-e807-44c5-a64a-284c7f1c229e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.459538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf71657-e807-44c5-a64a-284c7f1c229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.486531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-fcf71657-e807-44c5-a64a-284c7f1c229e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:45.488583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fcf71657-e807-44c5-a64a-284c7f1c229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:45.514586 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dbacf-3ae3-4a23-89a9-e806f6796a63 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:45.553000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4616f-1f0e-4ba1-800d-498f89774aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:45.553796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4616f-1f0e-4ba1-800d-498f89774aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.554179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4616f-1f0e-4ba1-800d-498f89774aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.554619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4616f-1f0e-4ba1-800d-498f89774aa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.559634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 35/65] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:52:45.566225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa0435-1d77-4804-b888-12ed40dfd53a None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.566719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4616f-1f0e-4ba1-800d-498f89774aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:45.566843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa0435-1d77-4804-b888-12ed40dfd53a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.567210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa0435-1d77-4804-b888-12ed40dfd53a None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.568652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 36/66] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:45.575770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f994-2637-45a2-ae72-1cbf9bd2e858 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.576282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f994-2637-45a2-ae72-1cbf9bd2e858 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.576796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f994-2637-45a2-ae72-1cbf9bd2e858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-4fb4616f-1f0e-4ba1-800d-498f89774aa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:45.580301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:45.581403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:45.582349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:45.582349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:45.582349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:45.582349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:45.582349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:45.582349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:45.582349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:45.582349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:45.582349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:45.582349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:45.582349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:45.582349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:52:45.584349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 31/67] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:45.596765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4616f-1f0e-4ba1-800d-498f89774aa8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:45.603089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9e99f994-2637-45a2-ae72-1cbf9bd2e858 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:45.604597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9e99f994-2637-45a2-ae72-1cbf9bd2e858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:45.630027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:45.673462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:45.678967 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 37/68] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:45.679867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f994-2637-45a2-ae72-1cbf9bd2e858 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:45.716764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4616f-1f0e-4ba1-800d-498f89774aa8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:45.753130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f687fe-b3f9-470c-88fa-df42a5bcdcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:45.754510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f687fe-b3f9-470c-88fa-df42a5bcdcec None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.755072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f687fe-b3f9-470c-88fa-df42a5bcdcec None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.756280 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f687fe-b3f9-470c-88fa-df42a5bcdcec None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.757207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f687fe-b3f9-470c-88fa-df42a5bcdcec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:45.757663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f687fe-b3f9-470c-88fa-df42a5bcdcec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:45.759196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f687fe-b3f9-470c-88fa-df42a5bcdcec None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:45.768128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 32/69] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:45.770048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61061c0-2ef6-4bbd-af09-25428f4d6498 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.770520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61061c0-2ef6-4bbd-af09-25428f4d6498 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.770936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61061c0-2ef6-4bbd-af09-25428f4d6498 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.772650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 33/70] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:45.777424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61061c0-2ef6-4bbd-af09-25428f4d6498 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:45.791176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f994-2637-45a2-ae72-1cbf9bd2e858 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:45.828619 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e9f3a-b4d8-4938-aad6-7a37ab254065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:45.829557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9f3a-b4d8-4938-aad6-7a37ab254065 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.829840 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9f3a-b4d8-4938-aad6-7a37ab254065 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.830115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9f3a-b4d8-4938-aad6-7a37ab254065 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.840965 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e9f3a-b4d8-4938-aad6-7a37ab254065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-373e9f3a-b4d8-4938-aad6-7a37ab254065 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:45.848874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:45.849854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:45.850763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:45.850763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:45.850763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:45.850763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:45.850763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:45.850763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:45.850763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:45.850763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:45.850763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:45.850763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:45.850763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:52:45.850763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:52:45.852606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 38/71] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:45.853523 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e9f3a-b4d8-4938-aad6-7a37ab254065 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:45.872630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:45.883230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61061c0-2ef6-4bbd-af09-25428f4d6498 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:45.917096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d038990-64f6-4d24-a04e-3efd1ae4c2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:45.917284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:45.918200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d038990-64f6-4d24-a04e-3efd1ae4c2cd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.918491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d038990-64f6-4d24-a04e-3efd1ae4c2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.918793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d038990-64f6-4d24-a04e-3efd1ae4c2cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.930473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d038990-64f6-4d24-a04e-3efd1ae4c2cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-0d038990-64f6-4d24-a04e-3efd1ae4c2cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:45.938778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:45.939720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:52:45.940483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 34/72] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:45.942292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5688d6-2ced-41c1-a58a-95982120e59e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.942292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5688d6-2ced-41c1-a58a-95982120e59e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.942407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5688d6-2ced-41c1-a58a-95982120e59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.959244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-fd5688d6-2ced-41c1-a58a-95982120e59e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:45.960693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fd5688d6-2ced-41c1-a58a-95982120e59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:45.966930 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e9f3a-b4d8-4938-aad6-7a37ab254065 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.006191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99216908-ea4f-41fc-a289-02d1c27f8d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.007081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99216908-ea4f-41fc-a289-02d1c27f8d41 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.007375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99216908-ea4f-41fc-a289-02d1c27f8d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.007658 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99216908-ea4f-41fc-a289-02d1c27f8d41 None admin] PATH_INFO: `/v3/users/8182fe078f1d405e804c7fa5779da52a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.008916 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99216908-ea4f-41fc-a289-02d1c27f8d41 None admin] RBAC: Authorizing `identity:get_user(user_id=8182fe078f1d405e804c7fa5779da52a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.010382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99216908-ea4f-41fc-a289-02d1c27f8d41 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.012070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 39/73] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:45 2022] GET /identity/v3/users/8182fe078f1d405e804c7fa5779da52a => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:46.012866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99216908-ea4f-41fc-a289-02d1c27f8d41 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.036217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 35/74] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:46.037327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5688d6-2ced-41c1-a58a-95982120e59e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.117307 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99216908-ea4f-41fc-a289-02d1c27f8d41 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.122482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.142932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5688d6-2ced-41c1-a58a-95982120e59e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.143064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.151527 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50fc99-c885-44be-b7a4-ea690a895a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.152203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50fc99-c885-44be-b7a4-ea690a895a79 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.152494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50fc99-c885-44be-b7a4-ea690a895a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.152815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50fc99-c885-44be-b7a4-ea690a895a79 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.153570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50fc99-c885-44be-b7a4-ea690a895a79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:46.153884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50fc99-c885-44be-b7a4-ea690a895a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.155268 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50fc99-c885-44be-b7a4-ea690a895a79 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.164252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 40/75] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:46.165064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50fc99-c885-44be-b7a4-ea690a895a79 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.175146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a3c0d-6cf1-4220-b9e8-f853ef99b977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.176324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a3c0d-6cf1-4220-b9e8-f853ef99b977 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.176614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a3c0d-6cf1-4220-b9e8-f853ef99b977 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.177393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a3c0d-6cf1-4220-b9e8-f853ef99b977 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.177691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a3c0d-6cf1-4220-b9e8-f853ef99b977 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:46.178005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a3c0d-6cf1-4220-b9e8-f853ef99b977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.179379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a3c0d-6cf1-4220-b9e8-f853ef99b977 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.187377 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 36/76] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:46.188916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b092a5a-c1e1-4eea-9550-5e010ebcdc80 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.189218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b092a5a-c1e1-4eea-9550-5e010ebcdc80 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.189499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b092a5a-c1e1-4eea-9550-5e010ebcdc80 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.190883 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 37/77] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:46.191494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b092a5a-c1e1-4eea-9550-5e010ebcdc80 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.271913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50fc99-c885-44be-b7a4-ea690a895a79 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.291284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b092a5a-c1e1-4eea-9550-5e010ebcdc80 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.308841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8da4e-37d9-46fb-8547-7654b7c993c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.309497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8da4e-37d9-46fb-8547-7654b7c993c2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.309788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8da4e-37d9-46fb-8547-7654b7c993c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.310068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8da4e-37d9-46fb-8547-7654b7c993c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.325661 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe612a-8cc5-4d66-8087-15f9ada5d88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.326447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe612a-8cc5-4d66-8087-15f9ada5d88d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.326732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe612a-8cc5-4d66-8087-15f9ada5d88d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.327008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe612a-8cc5-4d66-8087-15f9ada5d88d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.338834 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe612a-8cc5-4d66-8087-15f9ada5d88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-93fe612a-8cc5-4d66-8087-15f9ada5d88d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:46.348344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:46.349215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 38/78] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:46.355172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe612a-8cc5-4d66-8087-15f9ada5d88d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.355861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.364335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.376595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8da4e-37d9-46fb-8547-7654b7c993c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.378691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8da4e-37d9-46fb-8547-7654b7c993c2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.452359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe612a-8cc5-4d66-8087-15f9ada5d88d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.475140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 41/79] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:46.475872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8da4e-37d9-46fb-8547-7654b7c993c2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.485164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeca19-7f2d-4d75-b5dd-46b848b48261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.486046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeca19-7f2d-4d75-b5dd-46b848b48261 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.486328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeca19-7f2d-4d75-b5dd-46b848b48261 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.486604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeca19-7f2d-4d75-b5dd-46b848b48261 None admin] PATH_INFO: `/v3/users/447b7a5e893a41caa2ad9f9322c097ff` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.501292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aeca19-7f2d-4d75-b5dd-46b848b48261 None admin] RBAC: Authorizing `identity:get_user(user_id=447b7a5e893a41caa2ad9f9322c097ff)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.502750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aeca19-7f2d-4d75-b5dd-46b848b48261 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.509415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 39/80] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/users/447b7a5e893a41caa2ad9f9322c097ff => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:46.509415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de6cd7-3d35-46ff-aebf-46295b602498 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.509415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de6cd7-3d35-46ff-aebf-46295b602498 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.509415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de6cd7-3d35-46ff-aebf-46295b602498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.522555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b8de6cd7-3d35-46ff-aebf-46295b602498 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:46.523738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b8de6cd7-3d35-46ff-aebf-46295b602498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:46.567909 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.578178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.579535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8da4e-37d9-46fb-8547-7654b7c993c2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.587822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 40/81] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:46.608938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de6cd7-3d35-46ff-aebf-46295b602498 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.614596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184fd9b-c7f6-425d-8730-05f7df94fadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.615473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184fd9b-c7f6-425d-8730-05f7df94fadd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.615756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184fd9b-c7f6-425d-8730-05f7df94fadd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.616033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184fd9b-c7f6-425d-8730-05f7df94fadd None admin] PATH_INFO: `/v3/users/447b7a5e893a41caa2ad9f9322c097ff` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.624710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184fd9b-c7f6-425d-8730-05f7df94fadd None admin] RBAC: Authorizing `identity:get_user(user_id=447b7a5e893a41caa2ad9f9322c097ff)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.624710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184fd9b-c7f6-425d-8730-05f7df94fadd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.624710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 42/82] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/users/447b7a5e893a41caa2ad9f9322c097ff => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:46.624710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184fd9b-c7f6-425d-8730-05f7df94fadd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.686367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de6cd7-3d35-46ff-aebf-46295b602498 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.720389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184fd9b-c7f6-425d-8730-05f7df94fadd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.721446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3c597-d700-4671-ac38-a574a1c45409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.722117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3c597-d700-4671-ac38-a574a1c45409 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.722401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3c597-d700-4671-ac38-a574a1c45409 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.722693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3c597-d700-4671-ac38-a574a1c45409 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.723440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3c597-d700-4671-ac38-a574a1c45409 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:46.723753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3c597-d700-4671-ac38-a574a1c45409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.725154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3c597-d700-4671-ac38-a574a1c45409 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.733051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 41/83] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:46.733998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3c597-d700-4671-ac38-a574a1c45409 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.758369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0a8fe-7907-40c4-b799-8f741b16b9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.759223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0a8fe-7907-40c4-b799-8f741b16b9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.759510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0a8fe-7907-40c4-b799-8f741b16b9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.759788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0a8fe-7907-40c4-b799-8f741b16b9e1 None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.760991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0a8fe-7907-40c4-b799-8f741b16b9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.762415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0a8fe-7907-40c4-b799-8f741b16b9e1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.764092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 43/84] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:46.769482 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0a8fe-7907-40c4-b799-8f741b16b9e1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.790117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.792758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.833693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3c597-d700-4671-ac38-a574a1c45409 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.864966 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0a8fe-7907-40c4-b799-8f741b16b9e1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.866288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc4268-f3a4-4197-9fa0-fb53187baa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.866939 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4268-f3a4-4197-9fa0-fb53187baa0c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.867231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4268-f3a4-4197-9fa0-fb53187baa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.867514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4268-f3a4-4197-9fa0-fb53187baa0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.898184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab0339-9bf7-4a67-93a7-f1f64e81d868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.898969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab0339-9bf7-4a67-93a7-f1f64e81d868 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.899257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab0339-9bf7-4a67-93a7-f1f64e81d868 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.899535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab0339-9bf7-4a67-93a7-f1f64e81d868 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.900739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab0339-9bf7-4a67-93a7-f1f64e81d868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.902171 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab0339-9bf7-4a67-93a7-f1f64e81d868 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.903777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 44/85] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:46.904615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab0339-9bf7-4a67-93a7-f1f64e81d868 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.936140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc4268-f3a4-4197-9fa0-fb53187baa0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.937636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc4268-f3a4-4197-9fa0-fb53187baa0c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.991626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.994118 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:47.002521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab0339-9bf7-4a67-93a7-f1f64e81d868 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:47.035575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 42/86] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:47.036412 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc4268-f3a4-4197-9fa0-fb53187baa0c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:47.040880 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc0ef2-cc4b-4cc2-b7d6-7429c11c48b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:47.041659 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc0ef2-cc4b-4cc2-b7d6-7429c11c48b4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:47.041948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc0ef2-cc4b-4cc2-b7d6-7429c11c48b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:47.042230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc0ef2-cc4b-4cc2-b7d6-7429c11c48b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:47.110332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc0ef2-cc4b-4cc2-b7d6-7429c11c48b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:47.111796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc0ef2-cc4b-4cc2-b7d6-7429c11c48b4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:47.137190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc4268-f3a4-4197-9fa0-fb53187baa0c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:47.170480 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b11452-7bca-4fee-8a5a-348abf3f7517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:47.171341 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b11452-7bca-4fee-8a5a-348abf3f7517 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:47.171625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b11452-7bca-4fee-8a5a-348abf3f7517 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:47.171899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b11452-7bca-4fee-8a5a-348abf3f7517 None admin] PATH_INFO: `/v3/users/447b7a5e893a41caa2ad9f9322c097ff` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:47.173143 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b11452-7bca-4fee-8a5a-348abf3f7517 None admin] RBAC: Authorizing `identity:get_user(user_id=447b7a5e893a41caa2ad9f9322c097ff)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:47.174569 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b11452-7bca-4fee-8a5a-348abf3f7517 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:47.176254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 43/87] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:47 2022] GET /identity/v3/users/447b7a5e893a41caa2ad9f9322c097ff => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:47.177033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b11452-7bca-4fee-8a5a-348abf3f7517 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:47.200627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:47.204436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:47.214666 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 45/88] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:47.214666 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc0ef2-cc4b-4cc2-b7d6-7429c11c48b4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:47.282436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b11452-7bca-4fee-8a5a-348abf3f7517 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:47.309169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc0ef2-cc4b-4cc2-b7d6-7429c11c48b4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:47.315260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a7d84-f47b-48f0-86c5-baed0e9294e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:47.316485 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a7d84-f47b-48f0-86c5-baed0e9294e7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:47.316800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a7d84-f47b-48f0-86c5-baed0e9294e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:47.317076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a7d84-f47b-48f0-86c5-baed0e9294e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:47.317902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a7d84-f47b-48f0-86c5-baed0e9294e7 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e, user.id=8182fe078f1d405e804c7fa5779da52a) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:47.318215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a7d84-f47b-48f0-86c5-baed0e9294e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:47.319637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a7d84-f47b-48f0-86c5-baed0e9294e7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:47.325026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 44/89] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:47 2022] GET /identity/v3/role_assignments?user.id=8182fe078f1d405e804c7fa5779da52a&scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:47.325803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a7d84-f47b-48f0-86c5-baed0e9294e7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:47.346580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71872cc8-2a2f-4fc3-a9d6-0c2df5aed22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:47.347605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872cc8-2a2f-4fc3-a9d6-0c2df5aed22a None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:47.348041 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872cc8-2a2f-4fc3-a9d6-0c2df5aed22a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:47.348481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872cc8-2a2f-4fc3-a9d6-0c2df5aed22a None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:47.350120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71872cc8-2a2f-4fc3-a9d6-0c2df5aed22a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:47.352192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71872cc8-2a2f-4fc3-a9d6-0c2df5aed22a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:47.418757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:47.430483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 46/90] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:52:47 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:47.431352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71872cc8-2a2f-4fc3-a9d6-0c2df5aed22a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:47.445962 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a7d84-f47b-48f0-86c5-baed0e9294e7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:47.496459 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8878600-95a4-4683-9f55-e31b3d2406ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:47.497769 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878600-95a4-4683-9f55-e31b3d2406ac None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:47.498263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878600-95a4-4683-9f55-e31b3d2406ac None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:47.498611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878600-95a4-4683-9f55-e31b3d2406ac None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:47.499962 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8878600-95a4-4683-9f55-e31b3d2406ac None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:47.501547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8878600-95a4-4683-9f55-e31b3d2406ac None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:47.501767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:47.503569 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 45/91] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:47 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:47.504453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8878600-95a4-4683-9f55-e31b3d2406ac None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:47.578457 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71872cc8-2a2f-4fc3-a9d6-0c2df5aed22a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:47.621778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8878600-95a4-4683-9f55-e31b3d2406ac None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:47.625553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a7c3c-e69d-4198-aead-0bb7ee9840fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:47.626218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a7c3c-e69d-4198-aead-0bb7ee9840fb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:47.626481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a7c3c-e69d-4198-aead-0bb7ee9840fb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:47.626767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a7c3c-e69d-4198-aead-0bb7ee9840fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:47.660445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9477f-dbc5-4746-9a52-0e6b9adc3614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:47.661348 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9477f-dbc5-4746-9a52-0e6b9adc3614 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:47.661643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9477f-dbc5-4746-9a52-0e6b9adc3614 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:47.661917 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9477f-dbc5-4746-9a52-0e6b9adc3614 None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:47.664136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9477f-dbc5-4746-9a52-0e6b9adc3614 None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:47.665619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9477f-dbc5-4746-9a52-0e6b9adc3614 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:47.667485 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 46/92] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:47 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:47.668079 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9477f-dbc5-4746-9a52-0e6b9adc3614 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:47.706316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:47.720340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a7c3c-e69d-4198-aead-0bb7ee9840fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:47.723072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a7c3c-e69d-4198-aead-0bb7ee9840fb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:47.782813 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:47.807869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9477f-dbc5-4746-9a52-0e6b9adc3614 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:47.849681 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 47/93] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:47.850363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a7c3c-e69d-4198-aead-0bb7ee9840fb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:47.851472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c46c2-5330-403b-b295-656d86c6bb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:47.852482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c46c2-5330-403b-b295-656d86c6bb08 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:47.852919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c46c2-5330-403b-b295-656d86c6bb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:47.853304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c46c2-5330-403b-b295-656d86c6bb08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:47.854439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c46c2-5330-403b-b295-656d86c6bb08 None admin] RBAC: Adding query filter params (role.id=3b950540b0074582839238d2d27d159e, scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e, user.id=447b7a5e893a41caa2ad9f9322c097ff) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:47.854882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c46c2-5330-403b-b295-656d86c6bb08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:47.856510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c46c2-5330-403b-b295-656d86c6bb08 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:47.862668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 47/94] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:47 2022] GET /identity/v3/role_assignments?user.id=447b7a5e893a41caa2ad9f9322c097ff&scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e&role.id=3b950540b0074582839238d2d27d159e => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:47.868692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c46c2-5330-403b-b295-656d86c6bb08 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:47.987619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:48.014749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c46c2-5330-403b-b295-656d86c6bb08 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:48.074994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a7c3c-e69d-4198-aead-0bb7ee9840fb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:48.086324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880970f-646d-475f-ad9d-d323009bee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:48.087209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880970f-646d-475f-ad9d-d323009bee5e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.087540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880970f-646d-475f-ad9d-d323009bee5e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.087822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880970f-646d-475f-ad9d-d323009bee5e None admin] PATH_INFO: `/v3/projects/cbaecb94b26642f0b868e29b89d38bc5` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.089286 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880970f-646d-475f-ad9d-d323009bee5e None admin] RBAC: Authorizing `identity:get_project(project_id=cbaecb94b26642f0b868e29b89d38bc5)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:48.090771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880970f-646d-475f-ad9d-d323009bee5e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:48.092525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 48/95] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:47 2022] GET /identity/v3/projects/cbaecb94b26642f0b868e29b89d38bc5 => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:48.102838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880970f-646d-475f-ad9d-d323009bee5e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:48.152007 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6f490-e6d3-449c-8557-c1c46ff0d641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:48.152702 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6f490-e6d3-449c-8557-c1c46ff0d641 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.153000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6f490-e6d3-449c-8557-c1c46ff0d641 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.153289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6f490-e6d3-449c-8557-c1c46ff0d641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.154292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6f490-e6d3-449c-8557-c1c46ff0d641 None admin] RBAC: Adding query filter params (role.id=aa5b9dc3549b47aaabedcc3d727351c0, scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e, user.id=447b7a5e893a41caa2ad9f9322c097ff) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:48.154620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6f490-e6d3-449c-8557-c1c46ff0d641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:48.156452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6f490-e6d3-449c-8557-c1c46ff0d641 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:48.163461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 48/96] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:47 2022] GET /identity/v3/role_assignments?user.id=447b7a5e893a41caa2ad9f9322c097ff&scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e&role.id=aa5b9dc3549b47aaabedcc3d727351c0 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:48.283209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880970f-646d-475f-ad9d-d323009bee5e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:48.337785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5751450-c599-423d-a1b7-8eb890601b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:48.338575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751450-c599-423d-a1b7-8eb890601b3d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.338773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751450-c599-423d-a1b7-8eb890601b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.339051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751450-c599-423d-a1b7-8eb890601b3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.339917 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5751450-c599-423d-a1b7-8eb890601b3d None admin] RBAC: Adding query filter params (role.id=3b950540b0074582839238d2d27d159e, scope.project.id=cbaecb94b26642f0b868e29b89d38bc5, user.id=447b7a5e893a41caa2ad9f9322c097ff) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:48.340235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5751450-c599-423d-a1b7-8eb890601b3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:48.341728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5751450-c599-423d-a1b7-8eb890601b3d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:48.353343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 49/97] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:48 2022] GET /identity/v3/role_assignments?user.id=447b7a5e893a41caa2ad9f9322c097ff&scope.project.id=cbaecb94b26642f0b868e29b89d38bc5&role.id=3b950540b0074582839238d2d27d159e => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:50.388324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981d38e-be77-451a-abd1-331302b77846 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:50.388834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981d38e-be77-451a-abd1-331302b77846 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:50.388834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981d38e-be77-451a-abd1-331302b77846 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:50.390350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 49/98] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:50.408027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d1883-5e09-45a2-8a79-19162777fe0f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:50.408951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d1883-5e09-45a2-8a79-19162777fe0f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:50.409496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d1883-5e09-45a2-8a79-19162777fe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:50.434021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e92d1883-5e09-45a2-8a79-19162777fe0f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:50.435770 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e92d1883-5e09-45a2-8a79-19162777fe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:50.452783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:50.492453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff8480-9349-4014-bfde-753394460855 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:50.493125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff8480-9349-4014-bfde-753394460855 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:50.493427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff8480-9349-4014-bfde-753394460855 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:50.495433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 50/99] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:50.506466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a36b0f-831d-4570-b76d-d8cc7bf40dc6 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:50.506784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a36b0f-831d-4570-b76d-d8cc7bf40dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:50.507093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a36b0f-831d-4570-b76d-d8cc7bf40dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:50.533513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 50/100] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:50.557803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e1a36b0f-831d-4570-b76d-d8cc7bf40dc6 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:50.559040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e1a36b0f-831d-4570-b76d-d8cc7bf40dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:50.562340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d1883-5e09-45a2-8a79-19162777fe0f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:50.568088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:50.692305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 51/101] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 23 12:52:50.694248 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b650613-af75-4eca-9cba-172668efaf85 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:50.694553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b650613-af75-4eca-9cba-172668efaf85 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:50.695716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b650613-af75-4eca-9cba-172668efaf85 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:50.697119 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 52/102] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:50.698199 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ee72e-3a71-4a62-870b-46b399731004 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:50.698490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ee72e-3a71-4a62-870b-46b399731004 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:50.698773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ee72e-3a71-4a62-870b-46b399731004 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:50.701002 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 53/103] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:50.705957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3bab-24fa-40db-95fd-227eb865989c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:50.706767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3bab-24fa-40db-95fd-227eb865989c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:50.707082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3bab-24fa-40db-95fd-227eb865989c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:50.729892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-24ab3bab-24fa-40db-95fd-227eb865989c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:50.731203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-24ab3bab-24fa-40db-95fd-227eb865989c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:50.731564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d1883-5e09-45a2-8a79-19162777fe0f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:50.768421 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b9fc6-43a8-437b-88c8-85edd1b42918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:50.769314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b9fc6-43a8-437b-88c8-85edd1b42918 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:50.769676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b9fc6-43a8-437b-88c8-85edd1b42918 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:50.769961 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b9fc6-43a8-437b-88c8-85edd1b42918 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:50.771147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b9fc6-43a8-437b-88c8-85edd1b42918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:50.773289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b9fc6-43a8-437b-88c8-85edd1b42918 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:50.775065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 51/104] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:50.776225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a67016-958d-4a14-8322-d1b9f4016b59 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:50.776514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a67016-958d-4a14-8322-d1b9f4016b59 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:50.776883 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a67016-958d-4a14-8322-d1b9f4016b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:50.797983 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a5a67016-958d-4a14-8322-d1b9f4016b59 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:50.799186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a5a67016-958d-4a14-8322-d1b9f4016b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:50.812897 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:50.821956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 54/105] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:50.822629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab3bab-24fa-40db-95fd-227eb865989c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:50.893699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 52/106] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:50.894659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a67016-958d-4a14-8322-d1b9f4016b59 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:50.937406 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:50.969426 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab3bab-24fa-40db-95fd-227eb865989c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.007931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f64b-158b-4ce1-91f3-4762f0c97bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.008850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f64b-158b-4ce1-91f3-4762f0c97bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.009141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f64b-158b-4ce1-91f3-4762f0c97bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.009476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f64b-158b-4ce1-91f3-4762f0c97bf4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.020608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91f64b-158b-4ce1-91f3-4762f0c97bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:51.021715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a67016-958d-4a14-8322-d1b9f4016b59 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-7a91f64b-158b-4ce1-91f3-4762f0c97bf4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:51.030195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:51.032492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 55/107] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:51.034997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f64b-158b-4ce1-91f3-4762f0c97bf4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.061832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39d3b9-2864-42c9-87d6-f42d50897f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.062507 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39d3b9-2864-42c9-87d6-f42d50897f90 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.062797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39d3b9-2864-42c9-87d6-f42d50897f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.063084 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39d3b9-2864-42c9-87d6-f42d50897f90 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.063793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39d3b9-2864-42c9-87d6-f42d50897f90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:51.065305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39d3b9-2864-42c9-87d6-f42d50897f90 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:51.144493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:51.147435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f64b-158b-4ce1-91f3-4762f0c97bf4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.153128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 53/108] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:52:50 2022] POST /identity/v3/projects => generated 302 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:51.154518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39d3b9-2864-42c9-87d6-f42d50897f90 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.190168 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:51.198605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3317a-188b-4c0a-adae-a109f379efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.199985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3317a-188b-4c0a-adae-a109f379efcc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.200613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3317a-188b-4c0a-adae-a109f379efcc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.201464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3317a-188b-4c0a-adae-a109f379efcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.222445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3317a-188b-4c0a-adae-a109f379efcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-3fe3317a-188b-4c0a-adae-a109f379efcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:51.233493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:51.234402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:51.235160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:51.235160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:51.235160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:51.235160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:51.235160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:51.235160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:51.235160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:51.235160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:51.235160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:51.235160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:51.235160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:51.235160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:52:51.237680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 56/109] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:51.238696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3317a-188b-4c0a-adae-a109f379efcc None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.291405 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39d3b9-2864-42c9-87d6-f42d50897f90 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.333565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae88be-b69c-40f8-853f-4cf7ab5fca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.334346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae88be-b69c-40f8-853f-4cf7ab5fca33 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.334637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae88be-b69c-40f8-853f-4cf7ab5fca33 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.334924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae88be-b69c-40f8-853f-4cf7ab5fca33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.349839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae88be-b69c-40f8-853f-4cf7ab5fca33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-c6ae88be-b69c-40f8-853f-4cf7ab5fca33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:51.357644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:51.358473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:52:51.359236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 54/110] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:51.360642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2988d2-4a57-4f49-a716-93ad75cd606c None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.360831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2988d2-4a57-4f49-a716-93ad75cd606c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.361113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2988d2-4a57-4f49-a716-93ad75cd606c None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.362527 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 55/111] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:51.366654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2988d2-4a57-4f49-a716-93ad75cd606c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.375840 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3317a-188b-4c0a-adae-a109f379efcc None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.428442 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7dc5a7-b6a3-439d-b46a-ae20a4fcbde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.429304 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dc5a7-b6a3-439d-b46a-ae20a4fcbde2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.429499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dc5a7-b6a3-439d-b46a-ae20a4fcbde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.429776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dc5a7-b6a3-439d-b46a-ae20a4fcbde2 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.430531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dc5a7-b6a3-439d-b46a-ae20a4fcbde2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:51.430842 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dc5a7-b6a3-439d-b46a-ae20a4fcbde2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:51.432243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dc5a7-b6a3-439d-b46a-ae20a4fcbde2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:51.442742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 57/112] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:51.444159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb63256-ed34-4615-86ca-7675c79e1bd8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.444453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb63256-ed34-4615-86ca-7675c79e1bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.449045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb63256-ed34-4615-86ca-7675c79e1bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.450190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:51.471424 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-fdb63256-ed34-4615-86ca-7675c79e1bd8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:51.473161 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fdb63256-ed34-4615-86ca-7675c79e1bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:51.499467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2988d2-4a57-4f49-a716-93ad75cd606c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.536353 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99a2f3-0f3c-4f87-98a2-506c8ef1cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.537078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99a2f3-0f3c-4f87-98a2-506c8ef1cdb5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.537367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99a2f3-0f3c-4f87-98a2-506c8ef1cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.537657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99a2f3-0f3c-4f87-98a2-506c8ef1cdb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.538710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99a2f3-0f3c-4f87-98a2-506c8ef1cdb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:51.538710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99a2f3-0f3c-4f87-98a2-506c8ef1cdb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:51.540088 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99a2f3-0f3c-4f87-98a2-506c8ef1cdb5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:51.541466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:51.550468 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 56/113] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:51.551609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99a2f3-0f3c-4f87-98a2-506c8ef1cdb5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.559737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 58/114] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:51.560826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb63256-ed34-4615-86ca-7675c79e1bd8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.667992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb63256-ed34-4615-86ca-7675c79e1bd8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.668362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99a2f3-0f3c-4f87-98a2-506c8ef1cdb5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.692899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:51.706933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47647bd-8917-469e-b621-c1e59b0df1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.707820 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47647bd-8917-469e-b621-c1e59b0df1ec None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.708144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b31afc-879a-44be-bcb4-94293d91d345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.726488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47647bd-8917-469e-b621-c1e59b0df1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.726488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47647bd-8917-469e-b621-c1e59b0df1ec None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.726743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31afc-879a-44be-bcb4-94293d91d345 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.726743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31afc-879a-44be-bcb4-94293d91d345 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.726899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47647bd-8917-469e-b621-c1e59b0df1ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:51.726979 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31afc-879a-44be-bcb4-94293d91d345 None admin] PATH_INFO: `/v3/users/20c97c2c67824b7b81db361cd18e7551` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.727057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47647bd-8917-469e-b621-c1e59b0df1ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:51.727057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47647bd-8917-469e-b621-c1e59b0df1ec None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:51.727057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 57/115] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:51.727057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef509331-557a-42c1-9fe0-e98b38ed323f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.727057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef509331-557a-42c1-9fe0-e98b38ed323f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.727057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef509331-557a-42c1-9fe0-e98b38ed323f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.727057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 58/116] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:51.727515 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef509331-557a-42c1-9fe0-e98b38ed323f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.732802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b31afc-879a-44be-bcb4-94293d91d345 None admin] RBAC: Authorizing `identity:get_user(user_id=20c97c2c67824b7b81db361cd18e7551)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:51.734360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b31afc-879a-44be-bcb4-94293d91d345 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:51.736335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 59/117] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/users/20c97c2c67824b7b81db361cd18e7551 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:51.736970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b31afc-879a-44be-bcb4-94293d91d345 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.782516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:51.841284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b31afc-879a-44be-bcb4-94293d91d345 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.850781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef509331-557a-42c1-9fe0-e98b38ed323f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.878106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4211f58-0da8-4d13-bc85-7dd40905926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.879228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211f58-0da8-4d13-bc85-7dd40905926e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.879776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211f58-0da8-4d13-bc85-7dd40905926e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.880059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211f58-0da8-4d13-bc85-7dd40905926e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.885980 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d7140-e2ff-429f-a535-a855c1338f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.886855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d7140-e2ff-429f-a535-a855c1338f31 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.887145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d7140-e2ff-429f-a535-a855c1338f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.887428 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d7140-e2ff-429f-a535-a855c1338f31 None admin] PATH_INFO: `/v3/users/8182fe078f1d405e804c7fa5779da52a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.888615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d7140-e2ff-429f-a535-a855c1338f31 None admin] RBAC: Authorizing `identity:get_user(user_id=8182fe078f1d405e804c7fa5779da52a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:51.890085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d7140-e2ff-429f-a535-a855c1338f31 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:51.896753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 59/118] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/users/8182fe078f1d405e804c7fa5779da52a => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:51.896753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d7140-e2ff-429f-a535-a855c1338f31 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.896925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4211f58-0da8-4d13-bc85-7dd40905926e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-b4211f58-0da8-4d13-bc85-7dd40905926e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:51.901784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:51.902634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:52:51.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 60/119] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:51.909422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883ec33-3dbe-4753-a657-0188d4ba4b49 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.909422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883ec33-3dbe-4753-a657-0188d4ba4b49 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.909422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883ec33-3dbe-4753-a657-0188d4ba4b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.921432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6883ec33-3dbe-4753-a657-0188d4ba4b49 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:51.922630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6883ec33-3dbe-4753-a657-0188d4ba4b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:51.955765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:51.996449 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 61/120] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:51.997664 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883ec33-3dbe-4753-a657-0188d4ba4b49 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.019325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d7140-e2ff-429f-a535-a855c1338f31 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.031155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:52.058411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24c67d-4afe-4fdc-a877-710e4163da0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.059290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24c67d-4afe-4fdc-a877-710e4163da0d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.059576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24c67d-4afe-4fdc-a877-710e4163da0d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.059856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24c67d-4afe-4fdc-a877-710e4163da0d None admin] PATH_INFO: `/v3/users/447b7a5e893a41caa2ad9f9322c097ff` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.061106 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24c67d-4afe-4fdc-a877-710e4163da0d None admin] RBAC: Authorizing `identity:get_user(user_id=447b7a5e893a41caa2ad9f9322c097ff)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:52.062681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24c67d-4afe-4fdc-a877-710e4163da0d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:52.064325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 60/121] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/users/447b7a5e893a41caa2ad9f9322c097ff => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:52.065109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24c67d-4afe-4fdc-a877-710e4163da0d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.120323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883ec33-3dbe-4753-a657-0188d4ba4b49 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.154712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626aafa1-949c-47a9-8966-2ea581bff893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.155365 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aafa1-949c-47a9-8966-2ea581bff893 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.155653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aafa1-949c-47a9-8966-2ea581bff893 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.155936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aafa1-949c-47a9-8966-2ea581bff893 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.173601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24c67d-4afe-4fdc-a877-710e4163da0d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.191905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:52.209375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac152e-aea0-4fb6-ab12-cff3d01304fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.210479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac152e-aea0-4fb6-ab12-cff3d01304fd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.210957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac152e-aea0-4fb6-ab12-cff3d01304fd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.211398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac152e-aea0-4fb6-ab12-cff3d01304fd None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.212795 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac152e-aea0-4fb6-ab12-cff3d01304fd None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:52.214428 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac152e-aea0-4fb6-ab12-cff3d01304fd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:52.220964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 61/122] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:52 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:52.222471 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac152e-aea0-4fb6-ab12-cff3d01304fd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.225133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aafa1-949c-47a9-8966-2ea581bff893 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:52.226706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aafa1-949c-47a9-8966-2ea581bff893 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:52.260396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:52.327358 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac152e-aea0-4fb6-ab12-cff3d01304fd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.342830 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 62/123] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:52.343627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626aafa1-949c-47a9-8966-2ea581bff893 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.366899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c67f2b-e01d-4b93-858d-29ac894845e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.367578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c67f2b-e01d-4b93-858d-29ac894845e7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.367868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c67f2b-e01d-4b93-858d-29ac894845e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.368148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c67f2b-e01d-4b93-858d-29ac894845e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.368931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c67f2b-e01d-4b93-858d-29ac894845e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:52.369523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c67f2b-e01d-4b93-858d-29ac894845e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:52.370635 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c67f2b-e01d-4b93-858d-29ac894845e7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:52.378654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 62/124] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:52.379436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c67f2b-e01d-4b93-858d-29ac894845e7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.433607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:52.454686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626aafa1-949c-47a9-8966-2ea581bff893 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.486465 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c67f2b-e01d-4b93-858d-29ac894845e7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.489421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:52.494259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5d615-918f-41e2-84cd-30b88f978018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.495070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5d615-918f-41e2-84cd-30b88f978018 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.495354 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5d615-918f-41e2-84cd-30b88f978018 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.495634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5d615-918f-41e2-84cd-30b88f978018 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.506400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5d615-918f-41e2-84cd-30b88f978018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-acd5d615-918f-41e2-84cd-30b88f978018 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:52.514159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:52.515013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:52:52.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 63/125] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:52.517102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5d615-918f-41e2-84cd-30b88f978018 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.528741 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbcf33-ee8a-4f51-b4d2-90128e86e2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.529610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbcf33-ee8a-4f51-b4d2-90128e86e2fb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.529892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbcf33-ee8a-4f51-b4d2-90128e86e2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.530167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbcf33-ee8a-4f51-b4d2-90128e86e2fb None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.531350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbcf33-ee8a-4f51-b4d2-90128e86e2fb None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:52.532816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbcf33-ee8a-4f51-b4d2-90128e86e2fb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:52.534879 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 63/126] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:52 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:52.539900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbcf33-ee8a-4f51-b4d2-90128e86e2fb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.620864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5d615-918f-41e2-84cd-30b88f978018 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.639224 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbcf33-ee8a-4f51-b4d2-90128e86e2fb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.656055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:52.657805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188c908-d6df-40b8-a4b4-da7ceb519106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.658662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188c908-d6df-40b8-a4b4-da7ceb519106 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.658943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188c908-d6df-40b8-a4b4-da7ceb519106 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.659269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188c908-d6df-40b8-a4b4-da7ceb519106 None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e/users/8182fe078f1d405e804c7fa5779da52a/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.661487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188c908-d6df-40b8-a4b4-da7ceb519106 None admin] RBAC: Authorizing `identity:create_grant(project_id=8591f06cadbb400b9aa7b13fdd7f109e, user_id=8182fe078f1d405e804c7fa5779da52a, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:52.662939 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188c908-d6df-40b8-a4b4-da7ceb519106 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:52.673870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf0fd4-41ed-479f-bb8f-e4320bd8e382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.675285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf0fd4-41ed-479f-bb8f-e4320bd8e382 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.675597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf0fd4-41ed-479f-bb8f-e4320bd8e382 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.675862 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf0fd4-41ed-479f-bb8f-e4320bd8e382 None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.677075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf0fd4-41ed-479f-bb8f-e4320bd8e382 None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:52.678509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf0fd4-41ed-479f-bb8f-e4320bd8e382 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:52.680407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 64/127] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:52 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:52.681094 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf0fd4-41ed-479f-bb8f-e4320bd8e382 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.754583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 64/128] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:52 2022] PUT /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e/users/8182fe078f1d405e804c7fa5779da52a/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:52.755419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188c908-d6df-40b8-a4b4-da7ceb519106 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.796785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf0fd4-41ed-479f-bb8f-e4320bd8e382 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.842053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd136e-a153-4339-af1b-f4a65aa1a7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.845052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd136e-a153-4339-af1b-f4a65aa1a7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.845407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd136e-a153-4339-af1b-f4a65aa1a7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.845695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd136e-a153-4339-af1b-f4a65aa1a7d7 None admin] PATH_INFO: `/v3/users/447b7a5e893a41caa2ad9f9322c097ff` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.847807 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:52.848827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd136e-a153-4339-af1b-f4a65aa1a7d7 None admin] RBAC: Authorizing `identity:get_user(user_id=447b7a5e893a41caa2ad9f9322c097ff)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:52.850761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd136e-a153-4339-af1b-f4a65aa1a7d7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:52.856744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 65/129] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:52 2022] GET /identity/v3/users/447b7a5e893a41caa2ad9f9322c097ff => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:52.863207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd136e-a153-4339-af1b-f4a65aa1a7d7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.912006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188c908-d6df-40b8-a4b4-da7ceb519106 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.934344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:52.959112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4034d44-eac9-43c5-9feb-bf96e81d5f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.959523 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4034d44-eac9-43c5-9feb-bf96e81d5f25 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.959812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4034d44-eac9-43c5-9feb-bf96e81d5f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.960089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4034d44-eac9-43c5-9feb-bf96e81d5f25 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.960889 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4034d44-eac9-43c5-9feb-bf96e81d5f25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:52.961203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4034d44-eac9-43c5-9feb-bf96e81d5f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:52.962638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4034d44-eac9-43c5-9feb-bf96e81d5f25 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:52.972316 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 65/130] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:52:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:52.974980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4034d44-eac9-43c5-9feb-bf96e81d5f25 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.991661 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd136e-a153-4339-af1b-f4a65aa1a7d7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:53.032082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568f15a-2cc6-429b-a27c-4fca87655e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:53.033000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568f15a-2cc6-429b-a27c-4fca87655e8a None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.033283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568f15a-2cc6-429b-a27c-4fca87655e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.033558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568f15a-2cc6-429b-a27c-4fca87655e8a None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e/users/447b7a5e893a41caa2ad9f9322c097ff/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.035609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568f15a-2cc6-429b-a27c-4fca87655e8a None admin] RBAC: Authorizing `identity:create_grant(project_id=8591f06cadbb400b9aa7b13fdd7f109e, user_id=447b7a5e893a41caa2ad9f9322c097ff, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:53.037081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568f15a-2cc6-429b-a27c-4fca87655e8a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:53.101264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4034d44-eac9-43c5-9feb-bf96e81d5f25 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:53.115913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:53.136318 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a39584-e67a-41b5-8696-de588eb11255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:53.137011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a39584-e67a-41b5-8696-de588eb11255 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.137363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a39584-e67a-41b5-8696-de588eb11255 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.137696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a39584-e67a-41b5-8696-de588eb11255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.138597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a39584-e67a-41b5-8696-de588eb11255 None admin] RBAC: Adding query filter params (role.id=25b9d230b8374a58a3e9746a2893f6f2, scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e, user.id=20c97c2c67824b7b81db361cd18e7551) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:53.138958 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a39584-e67a-41b5-8696-de588eb11255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:53.143920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a39584-e67a-41b5-8696-de588eb11255 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:53.144367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 66/131] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:52 2022] PUT /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e/users/447b7a5e893a41caa2ad9f9322c097ff/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:53.146188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568f15a-2cc6-429b-a27c-4fca87655e8a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:53.149154 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 66/132] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:52 2022] GET /identity/v3/role_assignments?user.id=20c97c2c67824b7b81db361cd18e7551&scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e&role.id=25b9d230b8374a58a3e9746a2893f6f2 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:53.161264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a39584-e67a-41b5-8696-de588eb11255 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:53.367167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568f15a-2cc6-429b-a27c-4fca87655e8a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:53.389938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:53.395965 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a39584-e67a-41b5-8696-de588eb11255 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:53.419211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0654d-95b7-4c24-a95a-2d05780df7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:53.420206 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0654d-95b7-4c24-a95a-2d05780df7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.420503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0654d-95b7-4c24-a95a-2d05780df7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.420839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0654d-95b7-4c24-a95a-2d05780df7d0 None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.422068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0654d-95b7-4c24-a95a-2d05780df7d0 None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:53.428047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0654d-95b7-4c24-a95a-2d05780df7d0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:53.428047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 67/133] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:53 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:53.428047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd860-890b-44ef-a6e5-585f9c81ec0f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.428047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd860-890b-44ef-a6e5-585f9c81ec0f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.428953 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd860-890b-44ef-a6e5-585f9c81ec0f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.430011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 68/134] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:53.435570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe59a0-3020-417f-bc8c-005881fb5507 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.435967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe59a0-3020-417f-bc8c-005881fb5507 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.436325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe59a0-3020-417f-bc8c-005881fb5507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.448188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da773ca8-cce1-486b-b9a0-4164eda83469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:53.449363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da773ca8-cce1-486b-b9a0-4164eda83469 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.449811 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da773ca8-cce1-486b-b9a0-4164eda83469 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.450246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da773ca8-cce1-486b-b9a0-4164eda83469 None admin] PATH_INFO: `/v3/users/447b7a5e893a41caa2ad9f9322c097ff` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.453483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da773ca8-cce1-486b-b9a0-4164eda83469 None admin] RBAC: Authorizing `identity:get_user(user_id=447b7a5e893a41caa2ad9f9322c097ff)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:53.455253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da773ca8-cce1-486b-b9a0-4164eda83469 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:53.456214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ccbe59a0-3020-417f-bc8c-005881fb5507 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:53.457554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ccbe59a0-3020-417f-bc8c-005881fb5507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:53.457914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 67/135] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:53 2022] GET /identity/v3/users/447b7a5e893a41caa2ad9f9322c097ff => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:53.458839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da773ca8-cce1-486b-b9a0-4164eda83469 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:53.520286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:53.536533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 69/136] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:52:53.538055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe59a0-3020-417f-bc8c-005881fb5507 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:53.598515 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da773ca8-cce1-486b-b9a0-4164eda83469 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:53.672813 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d49762-4213-4ca9-8f22-831e2cb2f8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:53.673639 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d49762-4213-4ca9-8f22-831e2cb2f8da None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.673928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d49762-4213-4ca9-8f22-831e2cb2f8da None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.674213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d49762-4213-4ca9-8f22-831e2cb2f8da None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e/users/447b7a5e893a41caa2ad9f9322c097ff/roles/aa5b9dc3549b47aaabedcc3d727351c0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.680097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d49762-4213-4ca9-8f22-831e2cb2f8da None admin] RBAC: Authorizing `identity:create_grant(project_id=8591f06cadbb400b9aa7b13fdd7f109e, user_id=447b7a5e893a41caa2ad9f9322c097ff, role_id=aa5b9dc3549b47aaabedcc3d727351c0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:53.681596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d49762-4213-4ca9-8f22-831e2cb2f8da None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:53.703223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe59a0-3020-417f-bc8c-005881fb5507 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:53.714387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:53.739098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb72d93-2ca8-4632-a57f-71fac63808d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:53.739971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb72d93-2ca8-4632-a57f-71fac63808d2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.740259 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb72d93-2ca8-4632-a57f-71fac63808d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.740540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb72d93-2ca8-4632-a57f-71fac63808d2 None admin] PATH_INFO: `/v3/projects/cbaecb94b26642f0b868e29b89d38bc5` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.741852 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb72d93-2ca8-4632-a57f-71fac63808d2 None admin] RBAC: Authorizing `identity:get_project(project_id=cbaecb94b26642f0b868e29b89d38bc5)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:53.743407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb72d93-2ca8-4632-a57f-71fac63808d2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:53.747154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 70/137] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:53 2022] GET /identity/v3/projects/cbaecb94b26642f0b868e29b89d38bc5 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:53.752288 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 68/138] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:53 2022] PUT /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e/users/447b7a5e893a41caa2ad9f9322c097ff/roles/aa5b9dc3549b47aaabedcc3d727351c0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:53.753585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d49762-4213-4ca9-8f22-831e2cb2f8da None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:53.756521 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb72d93-2ca8-4632-a57f-71fac63808d2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:53.922975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb72d93-2ca8-4632-a57f-71fac63808d2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:53.974132 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d49762-4213-4ca9-8f22-831e2cb2f8da None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:53.987891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:53.993252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152ffe3-e2f4-4309-974f-678a008235ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:53.994426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ffe3-e2f4-4309-974f-678a008235ab None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.995014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ffe3-e2f4-4309-974f-678a008235ab None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.995489 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ffe3-e2f4-4309-974f-678a008235ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.996966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152ffe3-e2f4-4309-974f-678a008235ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:54.003690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152ffe3-e2f4-4309-974f-678a008235ab None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:54.003690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 71/139] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:54.008203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152ffe3-e2f4-4309-974f-678a008235ab None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:54.045955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb5d88-ea2b-45ac-923c-fc4b9cbc0fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:54.046880 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb5d88-ea2b-45ac-923c-fc4b9cbc0fb7 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:54.047170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb5d88-ea2b-45ac-923c-fc4b9cbc0fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:54.047452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb5d88-ea2b-45ac-923c-fc4b9cbc0fb7 None admin] PATH_INFO: `/v3/projects/cbaecb94b26642f0b868e29b89d38bc5/users/447b7a5e893a41caa2ad9f9322c097ff/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:54.049509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb5d88-ea2b-45ac-923c-fc4b9cbc0fb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbaecb94b26642f0b868e29b89d38bc5, user_id=447b7a5e893a41caa2ad9f9322c097ff, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:54.051507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb5d88-ea2b-45ac-923c-fc4b9cbc0fb7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:54.075159 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:54.135034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 69/140] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:53 2022] PUT /identity/v3/projects/cbaecb94b26642f0b868e29b89d38bc5/users/447b7a5e893a41caa2ad9f9322c097ff/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:54.150022 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152ffe3-e2f4-4309-974f-678a008235ab None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:54.190064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc7f5a-48fe-4843-9178-7ba6468accca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:54.191175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc7f5a-48fe-4843-9178-7ba6468accca None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:54.191705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc7f5a-48fe-4843-9178-7ba6468accca None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:54.192229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc7f5a-48fe-4843-9178-7ba6468accca None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:54.193210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc7f5a-48fe-4843-9178-7ba6468accca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:54.195025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc7f5a-48fe-4843-9178-7ba6468accca None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:54.304055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 72/141] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:52:54 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:52:55.603078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d309577-409c-4dd8-bafd-4dfad1e0e795 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:55.603610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d309577-409c-4dd8-bafd-4dfad1e0e795 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:55.603610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d309577-409c-4dd8-bafd-4dfad1e0e795 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:55.605087 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 70/142] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:55.610439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ad577-f036-4c61-8ae2-afbe53660f94 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:55.610877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ad577-f036-4c61-8ae2-afbe53660f94 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:55.611033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ad577-f036-4c61-8ae2-afbe53660f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:55.628645 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f98ad577-f036-4c61-8ae2-afbe53660f94 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:55.629876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f98ad577-f036-4c61-8ae2-afbe53660f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:55.686728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853307ad-4bb0-46cc-be27-7f4e8dca6386 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:55.687044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853307ad-4bb0-46cc-be27-7f4e8dca6386 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:55.687292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853307ad-4bb0-46cc-be27-7f4e8dca6386 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:55.688831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 71/143] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:55.693886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db1fb7-5482-4ed8-8dc0-586d7cb3db9a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:55.694184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db1fb7-5482-4ed8-8dc0-586d7cb3db9a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:55.694465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db1fb7-5482-4ed8-8dc0-586d7cb3db9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:55.712161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 73/144] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:55.729705 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-74db1fb7-5482-4ed8-8dc0-586d7cb3db9a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:55.730931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-74db1fb7-5482-4ed8-8dc0-586d7cb3db9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:55.735718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ad577-f036-4c61-8ae2-afbe53660f94 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:55.770801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:55.842438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ad577-f036-4c61-8ae2-afbe53660f94 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:55.880938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86ddfd-7ec0-4677-bdfd-5008f8c23c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:55.881678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86ddfd-7ec0-4677-bdfd-5008f8c23c47 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:55.881959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86ddfd-7ec0-4677-bdfd-5008f8c23c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:55.882234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86ddfd-7ec0-4677-bdfd-5008f8c23c47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:55.891115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 72/145] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:55.894295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86ddfd-7ec0-4677-bdfd-5008f8c23c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-4c86ddfd-7ec0-4677-bdfd-5008f8c23c47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:55.902279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:55.903174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:52:55.903954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 74/146] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:55.910103 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db1fb7-5482-4ed8-8dc0-586d7cb3db9a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:55.939558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86ddfd-7ec0-4677-bdfd-5008f8c23c47 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.070234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:56.081115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86ddfd-7ec0-4677-bdfd-5008f8c23c47 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.117268 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:56.130825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db1fb7-5482-4ed8-8dc0-586d7cb3db9a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.131884 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a08f2-84fa-4dbf-aff8-2f4add2d271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.132637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a08f2-84fa-4dbf-aff8-2f4add2d271a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.132962 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a08f2-84fa-4dbf-aff8-2f4add2d271a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.133245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a08f2-84fa-4dbf-aff8-2f4add2d271a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.150571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a08f2-84fa-4dbf-aff8-2f4add2d271a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-4c6a08f2-84fa-4dbf-aff8-2f4add2d271a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:56.165298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:56.166212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:52:56.166960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 75/147] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:56.173548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a08f2-84fa-4dbf-aff8-2f4add2d271a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.237983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cdcad-ab36-4306-bbdf-65ed5f52634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.238679 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cdcad-ab36-4306-bbdf-65ed5f52634b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.238970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cdcad-ab36-4306-bbdf-65ed5f52634b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.239250 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cdcad-ab36-4306-bbdf-65ed5f52634b None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.240018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cdcad-ab36-4306-bbdf-65ed5f52634b None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:56.240329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cdcad-ab36-4306-bbdf-65ed5f52634b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:56.241778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cdcad-ab36-4306-bbdf-65ed5f52634b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:56.259881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 73/148] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:52:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:56.298563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cdcad-ab36-4306-bbdf-65ed5f52634b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.302367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a08f2-84fa-4dbf-aff8-2f4add2d271a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.339187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90974fa9-7986-4178-90c2-be41cc57c3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.339856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90974fa9-7986-4178-90c2-be41cc57c3ee None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.340145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90974fa9-7986-4178-90c2-be41cc57c3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.340420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90974fa9-7986-4178-90c2-be41cc57c3ee None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.341203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90974fa9-7986-4178-90c2-be41cc57c3ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:56.341508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90974fa9-7986-4178-90c2-be41cc57c3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:56.342891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90974fa9-7986-4178-90c2-be41cc57c3ee None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:56.351414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 76/149] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:56.356998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90974fa9-7986-4178-90c2-be41cc57c3ee None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.373779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:56.488256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cdcad-ab36-4306-bbdf-65ed5f52634b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.528932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90974fa9-7986-4178-90c2-be41cc57c3ee None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.546328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e9a6b-7d64-43a1-a2f7-a283689a1846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.547235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9a6b-7d64-43a1-a2f7-a283689a1846 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.547526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9a6b-7d64-43a1-a2f7-a283689a1846 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.547808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9a6b-7d64-43a1-a2f7-a283689a1846 None admin] PATH_INFO: `/v3/users/447b7a5e893a41caa2ad9f9322c097ff` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.553433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e9a6b-7d64-43a1-a2f7-a283689a1846 None admin] RBAC: Authorizing `identity:get_user(user_id=447b7a5e893a41caa2ad9f9322c097ff)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:56.554926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e9a6b-7d64-43a1-a2f7-a283689a1846 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:56.556980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 74/150] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/users/447b7a5e893a41caa2ad9f9322c097ff => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:56.558222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d97f-b5e0-43d0-adc0-0487368c9aab None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.558510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d97f-b5e0-43d0-adc0-0487368c9aab None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.558794 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d97f-b5e0-43d0-adc0-0487368c9aab None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.560135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 75/151] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:56.567496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ae2c5-35aa-4a65-8baa-69926ae55333 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.567801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ae2c5-35aa-4a65-8baa-69926ae55333 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.568084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ae2c5-35aa-4a65-8baa-69926ae55333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.594699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-861ae2c5-35aa-4a65-8baa-69926ae55333 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:56.595901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-861ae2c5-35aa-4a65-8baa-69926ae55333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:56.598554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ea4a9-b5ef-4f16-bbd2-dd301ae7b64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.599730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ea4a9-b5ef-4f16-bbd2-dd301ae7b64e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.600220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ea4a9-b5ef-4f16-bbd2-dd301ae7b64e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.600722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ea4a9-b5ef-4f16-bbd2-dd301ae7b64e None admin] PATH_INFO: `/v3/users/8182fe078f1d405e804c7fa5779da52a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.602181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ea4a9-b5ef-4f16-bbd2-dd301ae7b64e None admin] RBAC: Authorizing `identity:get_user(user_id=8182fe078f1d405e804c7fa5779da52a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:56.603932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ea4a9-b5ef-4f16-bbd2-dd301ae7b64e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:56.606181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 77/152] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/users/8182fe078f1d405e804c7fa5779da52a => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:56.612682 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ea4a9-b5ef-4f16-bbd2-dd301ae7b64e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.625646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:56.707883 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 76/153] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:52:56.708749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ae2c5-35aa-4a65-8baa-69926ae55333 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.763804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:56.799419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ea4a9-b5ef-4f16-bbd2-dd301ae7b64e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.868267 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fc659-4570-4d71-a89c-32430b1200cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.869360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fc659-4570-4d71-a89c-32430b1200cf None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.869844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fc659-4570-4d71-a89c-32430b1200cf None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.870391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fc659-4570-4d71-a89c-32430b1200cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.909778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ae2c5-35aa-4a65-8baa-69926ae55333 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.949844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c7cc5-cedb-48be-b58a-a21e86d8922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.950501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c7cc5-cedb-48be-b58a-a21e86d8922d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.950792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c7cc5-cedb-48be-b58a-a21e86d8922d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.951073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c7cc5-cedb-48be-b58a-a21e86d8922d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.984065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:57.040151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fc659-4570-4d71-a89c-32430b1200cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:57.042135 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fc659-4570-4d71-a89c-32430b1200cf None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:57.047874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c7cc5-cedb-48be-b58a-a21e86d8922d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:57.047874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c7cc5-cedb-48be-b58a-a21e86d8922d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:57.201028 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:57.233228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 77/154] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:57.233970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c7cc5-cedb-48be-b58a-a21e86d8922d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:57.236443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 78/155] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:57.244429 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fc659-4570-4d71-a89c-32430b1200cf None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:57.309622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:57.366281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c7cc5-cedb-48be-b58a-a21e86d8922d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:57.407928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8f172-e549-4ec4-bb19-13610d4e58a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:57.408796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8f172-e549-4ec4-bb19-13610d4e58a4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.409638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8f172-e549-4ec4-bb19-13610d4e58a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.409920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8f172-e549-4ec4-bb19-13610d4e58a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.421709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8f172-e549-4ec4-bb19-13610d4e58a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-0ee8f172-e549-4ec4-bb19-13610d4e58a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:57.430402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:57.431257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:52:57.432059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 78/156] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:57.432721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8f172-e549-4ec4-bb19-13610d4e58a4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:57.527518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fc659-4570-4d71-a89c-32430b1200cf None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:57.540131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8f172-e549-4ec4-bb19-13610d4e58a4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:57.571078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:57.577047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355c61b-1cc0-475d-9e0b-68d7cc4aab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:57.577998 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355c61b-1cc0-475d-9e0b-68d7cc4aab7a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.578287 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355c61b-1cc0-475d-9e0b-68d7cc4aab7a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.578570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355c61b-1cc0-475d-9e0b-68d7cc4aab7a None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.579775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355c61b-1cc0-475d-9e0b-68d7cc4aab7a None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:57.581314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355c61b-1cc0-475d-9e0b-68d7cc4aab7a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:57.583749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 79/157] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:57 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:57.585054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567b3d5-cfbb-4ee2-9d07-eaedec1cf09d None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.591281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567b3d5-cfbb-4ee2-9d07-eaedec1cf09d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.591281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567b3d5-cfbb-4ee2-9d07-eaedec1cf09d None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.591281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 80/158] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:57.591281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac99c1-b7a0-4555-977c-331419ec1a8d None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.591281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac99c1-b7a0-4555-977c-331419ec1a8d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.591281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac99c1-b7a0-4555-977c-331419ec1a8d None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.591281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 81/159] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:57.591729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac99c1-b7a0-4555-977c-331419ec1a8d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:57.609391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a4a1b-5761-442f-b0d0-e397b134189b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:57.610281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4a1b-5761-442f-b0d0-e397b134189b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.610568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4a1b-5761-442f-b0d0-e397b134189b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.610854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4a1b-5761-442f-b0d0-e397b134189b None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.612119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a4a1b-5761-442f-b0d0-e397b134189b None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:57.614184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a4a1b-5761-442f-b0d0-e397b134189b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:57.616060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 79/160] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:57 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:57.617090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ee364-05c5-4e61-9151-6d6e3b57fefc None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.617380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ee364-05c5-4e61-9151-6d6e3b57fefc None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.617663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ee364-05c5-4e61-9151-6d6e3b57fefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.657640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-021ee364-05c5-4e61-9151-6d6e3b57fefc None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:57.658847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-021ee364-05c5-4e61-9151-6d6e3b57fefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:57.701754 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac99c1-b7a0-4555-977c-331419ec1a8d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:57.747062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:57.751274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e841a4b-fc41-4998-8809-db9601656a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:57.752014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e841a4b-fc41-4998-8809-db9601656a88 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.752304 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e841a4b-fc41-4998-8809-db9601656a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.752584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e841a4b-fc41-4998-8809-db9601656a88 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.753407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e841a4b-fc41-4998-8809-db9601656a88 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:57.753720 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e841a4b-fc41-4998-8809-db9601656a88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:57.755197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e841a4b-fc41-4998-8809-db9601656a88 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:57.768159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 82/161] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:52:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:57.769786 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e841a4b-fc41-4998-8809-db9601656a88 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:57.794511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 80/162] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:57.795619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112680e-bc78-4b7d-9a48-47ed8c4f544c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.795917 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112680e-bc78-4b7d-9a48-47ed8c4f544c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.796220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112680e-bc78-4b7d-9a48-47ed8c4f544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.834582 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6112680e-bc78-4b7d-9a48-47ed8c4f544c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:57.835712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6112680e-bc78-4b7d-9a48-47ed8c4f544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:57.885014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:57.954703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 81/163] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:57.955565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112680e-bc78-4b7d-9a48-47ed8c4f544c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:57.978160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e841a4b-fc41-4998-8809-db9601656a88 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.046695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e098b-dae7-4ceb-8ca6-0b1c529a9da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.047361 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e098b-dae7-4ceb-8ca6-0b1c529a9da5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.047649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e098b-dae7-4ceb-8ca6-0b1c529a9da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.047924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e098b-dae7-4ceb-8ca6-0b1c529a9da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.048800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e098b-dae7-4ceb-8ca6-0b1c529a9da5 None admin] RBAC: Adding query filter params (role.id=3b950540b0074582839238d2d27d159e, scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e, user.id=447b7a5e893a41caa2ad9f9322c097ff) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:58.049452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e098b-dae7-4ceb-8ca6-0b1c529a9da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:58.051358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e098b-dae7-4ceb-8ca6-0b1c529a9da5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:58.058826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 83/164] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:57 2022] GET /identity/v3/role_assignments?user.id=447b7a5e893a41caa2ad9f9322c097ff&scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e&role.id=3b950540b0074582839238d2d27d159e => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:58.058826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e098b-dae7-4ceb-8ca6-0b1c529a9da5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.134622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112680e-bc78-4b7d-9a48-47ed8c4f544c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.147504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:58.173586 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49673151-ef73-4403-8e69-83b52f6effe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.174541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49673151-ef73-4403-8e69-83b52f6effe6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.175220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49673151-ef73-4403-8e69-83b52f6effe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.175643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49673151-ef73-4403-8e69-83b52f6effe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.176779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49673151-ef73-4403-8e69-83b52f6effe6 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e, user.id=8182fe078f1d405e804c7fa5779da52a) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:58.177252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49673151-ef73-4403-8e69-83b52f6effe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:58.179168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49673151-ef73-4403-8e69-83b52f6effe6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:58.185858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 82/165] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:57 2022] GET /identity/v3/role_assignments?user.id=8182fe078f1d405e804c7fa5779da52a&scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:58.186825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49673151-ef73-4403-8e69-83b52f6effe6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.311057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49673151-ef73-4403-8e69-83b52f6effe6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.318687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e098b-dae7-4ceb-8ca6-0b1c529a9da5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.347143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:58.351937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd944fa-b09c-4445-951e-ecfef0a3ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.353087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd944fa-b09c-4445-951e-ecfef0a3ece0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.353572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd944fa-b09c-4445-951e-ecfef0a3ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.353994 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd944fa-b09c-4445-951e-ecfef0a3ece0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.366960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd944fa-b09c-4445-951e-ecfef0a3ece0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-4fd944fa-b09c-4445-951e-ecfef0a3ece0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:58.376247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:58.377441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:58.378435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:58.378435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:58.378435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:58.378435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:58.378435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:58.378435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:58.378435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:58.378435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:58.378435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:58.378435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:58.378435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:52:58.378435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:52:58.381779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 83/166] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:58.382941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd944fa-b09c-4445-951e-ecfef0a3ece0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.405050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449e31e-bff1-4a8a-80d7-b6d9421ba9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.406015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449e31e-bff1-4a8a-80d7-b6d9421ba9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.406133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449e31e-bff1-4a8a-80d7-b6d9421ba9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.406418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449e31e-bff1-4a8a-80d7-b6d9421ba9f4 None admin] PATH_INFO: `/v3/users/20c97c2c67824b7b81db361cd18e7551` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.413549 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449e31e-bff1-4a8a-80d7-b6d9421ba9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=20c97c2c67824b7b81db361cd18e7551)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:58.415063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449e31e-bff1-4a8a-80d7-b6d9421ba9f4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:58.416914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 84/167] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:58 2022] GET /identity/v3/users/20c97c2c67824b7b81db361cd18e7551 => generated 289 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:58.417680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449e31e-bff1-4a8a-80d7-b6d9421ba9f4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.424104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:58.501910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd944fa-b09c-4445-951e-ecfef0a3ece0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.539773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486c383-3884-4538-916c-6cfca644211f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.540839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486c383-3884-4538-916c-6cfca644211f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.541297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486c383-3884-4538-916c-6cfca644211f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.541717 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486c383-3884-4538-916c-6cfca644211f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.554015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486c383-3884-4538-916c-6cfca644211f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d486c383-3884-4538-916c-6cfca644211f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:58.562450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:58.563483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:58.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:58.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:58.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:58.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:58.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:58.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:58.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:58.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:58.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:58.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:58.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:52:58.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:52:58.567025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 84/168] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:58.568036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486c383-3884-4538-916c-6cfca644211f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.668399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:58.676613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486c383-3884-4538-916c-6cfca644211f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.688481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449e31e-bff1-4a8a-80d7-b6d9421ba9f4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.713789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadd047-f3f5-4546-915c-257bad64a4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.714898 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadd047-f3f5-4546-915c-257bad64a4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.715371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadd047-f3f5-4546-915c-257bad64a4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.715789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadd047-f3f5-4546-915c-257bad64a4f2 None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.717238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadd047-f3f5-4546-915c-257bad64a4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:58.718861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadd047-f3f5-4546-915c-257bad64a4f2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:58.720744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 85/169] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:58 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:58.721748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadd047-f3f5-4546-915c-257bad64a4f2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.778552 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4f1fa-7f9b-4883-b253-55651771810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.779238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4f1fa-7f9b-4883-b253-55651771810f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.779530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4f1fa-7f9b-4883-b253-55651771810f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.779814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4f1fa-7f9b-4883-b253-55651771810f None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.780581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4f1fa-7f9b-4883-b253-55651771810f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:58.780924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4f1fa-7f9b-4883-b253-55651771810f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:58.782581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4f1fa-7f9b-4883-b253-55651771810f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:58.799897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 85/170] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:58.800810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4f1fa-7f9b-4883-b253-55651771810f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.834053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadd047-f3f5-4546-915c-257bad64a4f2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.870991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c6733-850a-4c5d-a95d-5ad6d142cef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.871958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c6733-850a-4c5d-a95d-5ad6d142cef4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.872414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c6733-850a-4c5d-a95d-5ad6d142cef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.872851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c6733-850a-4c5d-a95d-5ad6d142cef4 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.873812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c6733-850a-4c5d-a95d-5ad6d142cef4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:58.874254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c6733-850a-4c5d-a95d-5ad6d142cef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:58.875755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c6733-850a-4c5d-a95d-5ad6d142cef4 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:58.885031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:58.885930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 86/171] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:52:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:58.886674 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c6733-850a-4c5d-a95d-5ad6d142cef4 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.913967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:58.955130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4f1fa-7f9b-4883-b253-55651771810f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.991009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49578b4-24af-499c-ab9e-7667e20e1d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.992033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49578b4-24af-499c-ab9e-7667e20e1d90 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.992396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49578b4-24af-499c-ab9e-7667e20e1d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.992864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49578b4-24af-499c-ab9e-7667e20e1d90 None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e/users/20c97c2c67824b7b81db361cd18e7551/roles/25b9d230b8374a58a3e9746a2893f6f2` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.994845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49578b4-24af-499c-ab9e-7667e20e1d90 None admin] RBAC: Authorizing `identity:create_grant(project_id=8591f06cadbb400b9aa7b13fdd7f109e, user_id=20c97c2c67824b7b81db361cd18e7551, role_id=25b9d230b8374a58a3e9746a2893f6f2)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:58.996396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49578b4-24af-499c-ab9e-7667e20e1d90 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:58.998392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c6733-850a-4c5d-a95d-5ad6d142cef4 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.033278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039c244-61b8-433c-9fce-c6de4b17382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.034696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039c244-61b8-433c-9fce-c6de4b17382d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.034985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039c244-61b8-433c-9fce-c6de4b17382d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.035261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039c244-61b8-433c-9fce-c6de4b17382d None admin] PATH_INFO: `/v3/users/447b7a5e893a41caa2ad9f9322c097ff` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.036531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039c244-61b8-433c-9fce-c6de4b17382d None admin] RBAC: Authorizing `identity:get_user(user_id=447b7a5e893a41caa2ad9f9322c097ff)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:59.038033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039c244-61b8-433c-9fce-c6de4b17382d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:59.039713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 87/172] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:58 2022] GET /identity/v3/users/447b7a5e893a41caa2ad9f9322c097ff => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:59.041373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0f0a-c4e5-4697-8351-bd6158d29938 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.041373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0f0a-c4e5-4697-8351-bd6158d29938 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.041526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0f0a-c4e5-4697-8351-bd6158d29938 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.042710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 88/173] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:59.043360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0f0a-c4e5-4697-8351-bd6158d29938 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.065926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 86/174] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:58 2022] PUT /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e/users/20c97c2c67824b7b81db361cd18e7551/roles/25b9d230b8374a58a3e9746a2893f6f2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:59.074197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7122eb-1478-485e-bb21-0a9d9faa2b64 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.074521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7122eb-1478-485e-bb21-0a9d9faa2b64 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.074768 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7122eb-1478-485e-bb21-0a9d9faa2b64 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.080230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 87/175] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:59.085126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7122eb-1478-485e-bb21-0a9d9faa2b64 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.166496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:59.180773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0f0a-c4e5-4697-8351-bd6158d29938 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.223200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b518d6f-92a7-4023-a4b1-3a47c638eb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.224610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b518d6f-92a7-4023-a4b1-3a47c638eb9d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.224949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b518d6f-92a7-4023-a4b1-3a47c638eb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.225233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b518d6f-92a7-4023-a4b1-3a47c638eb9d None admin] PATH_INFO: `/v3/users/447b7a5e893a41caa2ad9f9322c097ff` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.226524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b518d6f-92a7-4023-a4b1-3a47c638eb9d None admin] RBAC: Authorizing `identity:get_user(user_id=447b7a5e893a41caa2ad9f9322c097ff)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:59.228014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b518d6f-92a7-4023-a4b1-3a47c638eb9d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:59.229965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 89/176] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/users/447b7a5e893a41caa2ad9f9322c097ff => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:59.231038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c8190-6510-4255-8044-48ecb9922ba5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.231387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c8190-6510-4255-8044-48ecb9922ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.231676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c8190-6510-4255-8044-48ecb9922ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.247960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:59.252245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-201c8190-6510-4255-8044-48ecb9922ba5 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:59.253548 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7122eb-1478-485e-bb21-0a9d9faa2b64 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.254166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-201c8190-6510-4255-8044-48ecb9922ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:59.291420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b7ad9-e69e-4ac1-820b-d19d0cd3ce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.292073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b7ad9-e69e-4ac1-820b-d19d0cd3ce1e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.292358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b7ad9-e69e-4ac1-820b-d19d0cd3ce1e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.292635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b7ad9-e69e-4ac1-820b-d19d0cd3ce1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.324712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 90/177] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:59.325931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008b74-a3f0-4b4a-af4c-f584c0e518c0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.326251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008b74-a3f0-4b4a-af4c-f584c0e518c0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.326535 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008b74-a3f0-4b4a-af4c-f584c0e518c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.347264 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-53008b74-a3f0-4b4a-af4c-f584c0e518c0 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:59.348403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-53008b74-a3f0-4b4a-af4c-f584c0e518c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:59.374033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b7ad9-e69e-4ac1-820b-d19d0cd3ce1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:59.375783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b7ad9-e69e-4ac1-820b-d19d0cd3ce1e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:59.420448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 91/178] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:59.422096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2820351-9767-464b-b1f6-210fa0fabc49 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.422391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2820351-9767-464b-b1f6-210fa0fabc49 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.422673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2820351-9767-464b-b1f6-210fa0fabc49 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.424075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 92/179] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:59.424714 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2820351-9767-464b-b1f6-210fa0fabc49 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.447160 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:59.489693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:59.493841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 88/180] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:59.493841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b7ad9-e69e-4ac1-820b-d19d0cd3ce1e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.538648 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2820351-9767-464b-b1f6-210fa0fabc49 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.575786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181f246-8016-4e4a-9534-ae79ad20786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.576441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181f246-8016-4e4a-9534-ae79ad20786d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.576765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181f246-8016-4e4a-9534-ae79ad20786d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.577053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181f246-8016-4e4a-9534-ae79ad20786d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.597861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b7ad9-e69e-4ac1-820b-d19d0cd3ce1e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.633874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0e222-2730-4b9e-8013-d421043f7007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.634832 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0e222-2730-4b9e-8013-d421043f7007 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.635438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0e222-2730-4b9e-8013-d421043f7007 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.635722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0e222-2730-4b9e-8013-d421043f7007 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.646095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0e222-2730-4b9e-8013-d421043f7007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:59.647556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181f246-8016-4e4a-9534-ae79ad20786d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:59.649052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181f246-8016-4e4a-9534-ae79ad20786d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-abd0e222-2730-4b9e-8013-d421043f7007 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:59.654140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:59.655188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:52:59.656478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 89/181] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:59.657222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95663-91c7-4270-ac2e-520973f5fb7c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.657222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95663-91c7-4270-ac2e-520973f5fb7c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.657222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95663-91c7-4270-ac2e-520973f5fb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.676429 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-daf95663-91c7-4270-ac2e-520973f5fb7c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:59.677482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:59.677923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-daf95663-91c7-4270-ac2e-520973f5fb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:59.736009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:59.747542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 90/182] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:59.758349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95663-91c7-4270-ac2e-520973f5fb7c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.763979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 93/183] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:59.763979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181f246-8016-4e4a-9534-ae79ad20786d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.865620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95663-91c7-4270-ac2e-520973f5fb7c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.871249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181f246-8016-4e4a-9534-ae79ad20786d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.891957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:59.903141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47fe65-65ea-4a98-8de9-5ff089c44f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.903985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47fe65-65ea-4a98-8de9-5ff089c44f6f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.904273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47fe65-65ea-4a98-8de9-5ff089c44f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.904573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47fe65-65ea-4a98-8de9-5ff089c44f6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.905781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a9238-ad9e-40c6-b5b0-b4374a0f1350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.906996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a9238-ad9e-40c6-b5b0-b4374a0f1350 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.906996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a9238-ad9e-40c6-b5b0-b4374a0f1350 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.907259 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a9238-ad9e-40c6-b5b0-b4374a0f1350 None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.908460 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a9238-ad9e-40c6-b5b0-b4374a0f1350 None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:59.910449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a9238-ad9e-40c6-b5b0-b4374a0f1350 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:59.912140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 94/184] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:59.913007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a9238-ad9e-40c6-b5b0-b4374a0f1350 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.920231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47fe65-65ea-4a98-8de9-5ff089c44f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-fc47fe65-65ea-4a98-8de9-5ff089c44f6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:59.929293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:59.930173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 91/185] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:59.935669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47fe65-65ea-4a98-8de9-5ff089c44f6f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.984535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.030610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a9238-ad9e-40c6-b5b0-b4374a0f1350 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.035357 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47fe65-65ea-4a98-8de9-5ff089c44f6f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.069977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7d1ac-f143-4769-9422-7c9fc1ebaa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.070704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7d1ac-f143-4769-9422-7c9fc1ebaa6a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.070988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7d1ac-f143-4769-9422-7c9fc1ebaa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.071313 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7d1ac-f143-4769-9422-7c9fc1ebaa6a None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.071539 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982e5e8-67f1-4f4e-a2e5-8e819b4a447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.072080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7d1ac-f143-4769-9422-7c9fc1ebaa6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:00.072390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7d1ac-f143-4769-9422-7c9fc1ebaa6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.072480 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982e5e8-67f1-4f4e-a2e5-8e819b4a447f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.072701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982e5e8-67f1-4f4e-a2e5-8e819b4a447f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.072987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982e5e8-67f1-4f4e-a2e5-8e819b4a447f None admin] PATH_INFO: `/v3/projects/cbaecb94b26642f0b868e29b89d38bc5` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.073809 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7d1ac-f143-4769-9422-7c9fc1ebaa6a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.074176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982e5e8-67f1-4f4e-a2e5-8e819b4a447f None admin] RBAC: Authorizing `identity:get_project(project_id=cbaecb94b26642f0b868e29b89d38bc5)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.077358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982e5e8-67f1-4f4e-a2e5-8e819b4a447f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.082695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 92/186] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/projects/cbaecb94b26642f0b868e29b89d38bc5 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:00.083137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 95/187] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:00.083739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982e5e8-67f1-4f4e-a2e5-8e819b4a447f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.085565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7d1ac-f143-4769-9422-7c9fc1ebaa6a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.140623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.191075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982e5e8-67f1-4f4e-a2e5-8e819b4a447f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.192301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7d1ac-f143-4769-9422-7c9fc1ebaa6a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.209559 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.227375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18dfa92-9563-42b1-baf1-1d69a14b3586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.227824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b351b-c04f-4095-8e0e-636ec79b6a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.228195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dfa92-9563-42b1-baf1-1d69a14b3586 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.228483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dfa92-9563-42b1-baf1-1d69a14b3586 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.230275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b351b-c04f-4095-8e0e-636ec79b6a3a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.230373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dfa92-9563-42b1-baf1-1d69a14b3586 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.230443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b351b-c04f-4095-8e0e-636ec79b6a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.230443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b351b-c04f-4095-8e0e-636ec79b6a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.230443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b351b-c04f-4095-8e0e-636ec79b6a3a None admin] RBAC: Adding query filter params (role.id=aa5b9dc3549b47aaabedcc3d727351c0, scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e, user.id=447b7a5e893a41caa2ad9f9322c097ff) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:00.230625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18dfa92-9563-42b1-baf1-1d69a14b3586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.230694 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b351b-c04f-4095-8e0e-636ec79b6a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.231654 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18dfa92-9563-42b1-baf1-1d69a14b3586 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.231755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b351b-c04f-4095-8e0e-636ec79b6a3a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.238478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 93/188] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:00.238478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18dfa92-9563-42b1-baf1-1d69a14b3586 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.244928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 96/189] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/role_assignments?user.id=447b7a5e893a41caa2ad9f9322c097ff&scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e&role.id=aa5b9dc3549b47aaabedcc3d727351c0 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:00.253000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b351b-c04f-4095-8e0e-636ec79b6a3a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.373413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b351b-c04f-4095-8e0e-636ec79b6a3a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.382888 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18dfa92-9563-42b1-baf1-1d69a14b3586 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.389387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.410447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5672b6-c412-4d81-8581-bd4552e58a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.411113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5672b6-c412-4d81-8581-bd4552e58a48 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.411398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5672b6-c412-4d81-8581-bd4552e58a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.411675 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5672b6-c412-4d81-8581-bd4552e58a48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.412518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5672b6-c412-4d81-8581-bd4552e58a48 None admin] RBAC: Adding query filter params (role.id=3b950540b0074582839238d2d27d159e, scope.project.id=cbaecb94b26642f0b868e29b89d38bc5, user.id=447b7a5e893a41caa2ad9f9322c097ff) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:00.412931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5672b6-c412-4d81-8581-bd4552e58a48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.414469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5672b6-c412-4d81-8581-bd4552e58a48 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.422563 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 97/190] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/role_assignments?user.id=447b7a5e893a41caa2ad9f9322c097ff&scope.project.id=cbaecb94b26642f0b868e29b89d38bc5&role.id=3b950540b0074582839238d2d27d159e => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:00.423194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5672b6-c412-4d81-8581-bd4552e58a48 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.428771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0500-7694-4702-8a8a-f61fabe8ba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.429452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0500-7694-4702-8a8a-f61fabe8ba8d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.429734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0500-7694-4702-8a8a-f61fabe8ba8d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.430008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0500-7694-4702-8a8a-f61fabe8ba8d None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.430757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f0500-7694-4702-8a8a-f61fabe8ba8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:00.431062 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f0500-7694-4702-8a8a-f61fabe8ba8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.432448 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f0500-7694-4702-8a8a-f61fabe8ba8d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.442837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 94/191] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:00.443681 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0500-7694-4702-8a8a-f61fabe8ba8d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.499920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.561685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5672b6-c412-4d81-8581-bd4552e58a48 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.569862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0500-7694-4702-8a8a-f61fabe8ba8d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.613410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab10f3-fb2d-4d60-a933-4618c04ff97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.614301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab10f3-fb2d-4d60-a933-4618c04ff97a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.614581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab10f3-fb2d-4d60-a933-4618c04ff97a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.614854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab10f3-fb2d-4d60-a933-4618c04ff97a None admin] PATH_INFO: `/v3/users/6abcf5b063464a3ba204d3fdd1992e38` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.620909 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25db22-b344-4a18-a8ee-552608814f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.621606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25db22-b344-4a18-a8ee-552608814f78 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.621896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25db22-b344-4a18-a8ee-552608814f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.622178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25db22-b344-4a18-a8ee-552608814f78 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.622910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25db22-b344-4a18-a8ee-552608814f78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.624556 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25db22-b344-4a18-a8ee-552608814f78 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.632833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab10f3-fb2d-4d60-a933-4618c04ff97a None admin] RBAC: Authorizing `identity:get_user(user_id=6abcf5b063464a3ba204d3fdd1992e38)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.634878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab10f3-fb2d-4d60-a933-4618c04ff97a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.636928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 98/192] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/users/6abcf5b063464a3ba204d3fdd1992e38 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:00.637897 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab10f3-fb2d-4d60-a933-4618c04ff97a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.680601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.733272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 95/193] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:53:00 2022] POST /identity/v3/users => generated 297 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:53:00.734392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25db22-b344-4a18-a8ee-552608814f78 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.759175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab10f3-fb2d-4d60-a933-4618c04ff97a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.799731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d653e-83f6-401c-b344-48442cf69ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.801063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d653e-83f6-401c-b344-48442cf69ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.801555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d653e-83f6-401c-b344-48442cf69ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.802029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d653e-83f6-401c-b344-48442cf69ad7 None admin] PATH_INFO: `/v3/users/6abcf5b063464a3ba204d3fdd1992e38` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.803597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d653e-83f6-401c-b344-48442cf69ad7 None admin] RBAC: Authorizing `identity:get_user(user_id=6abcf5b063464a3ba204d3fdd1992e38)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.805496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d653e-83f6-401c-b344-48442cf69ad7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.807424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 99/194] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/users/6abcf5b063464a3ba204d3fdd1992e38 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:00.813179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d653e-83f6-401c-b344-48442cf69ad7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.867231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25db22-b344-4a18-a8ee-552608814f78 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.881143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.915965 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1e6ac-3217-4cd7-ac8d-dd08b96a1813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.916637 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e6ac-3217-4cd7-ac8d-dd08b96a1813 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.916964 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e6ac-3217-4cd7-ac8d-dd08b96a1813 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.917246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e6ac-3217-4cd7-ac8d-dd08b96a1813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.941921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d653e-83f6-401c-b344-48442cf69ad7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.944799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.992743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf6232-2011-4079-9282-6046e3746e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.993691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf6232-2011-4079-9282-6046e3746e31 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.993965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf6232-2011-4079-9282-6046e3746e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.994243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf6232-2011-4079-9282-6046e3746e31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.009984 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1e6ac-3217-4cd7-ac8d-dd08b96a1813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:01.011590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1e6ac-3217-4cd7-ac8d-dd08b96a1813 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:01.093523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf6232-2011-4079-9282-6046e3746e31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:01.095246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf6232-2011-4079-9282-6046e3746e31 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:01.149811 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 96/195] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:01.155649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1e6ac-3217-4cd7-ac8d-dd08b96a1813 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:01.160062 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:01.227095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 100/196] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:01.229118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13091ac-0900-4606-be97-6b6521393350 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.229460 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13091ac-0900-4606-be97-6b6521393350 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.229743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13091ac-0900-4606-be97-6b6521393350 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.231281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 101/197] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:01.232320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13091ac-0900-4606-be97-6b6521393350 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:01.239105 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:01.277461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1e6ac-3217-4cd7-ac8d-dd08b96a1813 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:01.325093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299144c1-bccd-461b-8be2-2cec48a6524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:01.326541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299144c1-bccd-461b-8be2-2cec48a6524d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.326843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299144c1-bccd-461b-8be2-2cec48a6524d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.327173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299144c1-bccd-461b-8be2-2cec48a6524d None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.328885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299144c1-bccd-461b-8be2-2cec48a6524d None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:01.331073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299144c1-bccd-461b-8be2-2cec48a6524d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:01.333573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 97/198] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:01 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:01.335139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2f9d-0b78-431c-b0a5-865193d57d66 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.335693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2f9d-0b78-431c-b0a5-865193d57d66 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.335987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2f9d-0b78-431c-b0a5-865193d57d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.355075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13091ac-0900-4606-be97-6b6521393350 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:01.358904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-91fa2f9d-0b78-431c-b0a5-865193d57d66 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:01.360118 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-91fa2f9d-0b78-431c-b0a5-865193d57d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:01.396696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f048-924c-4c2c-85bd-6f2ebe6f062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:01.398240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f048-924c-4c2c-85bd-6f2ebe6f062e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.398522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f048-924c-4c2c-85bd-6f2ebe6f062e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.398799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f048-924c-4c2c-85bd-6f2ebe6f062e None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.400736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f048-924c-4c2c-85bd-6f2ebe6f062e None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:01.402377 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f048-924c-4c2c-85bd-6f2ebe6f062e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:01.404266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 102/199] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:01 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:01.405105 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f048-924c-4c2c-85bd-6f2ebe6f062e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:01.443483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 98/200] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:01.444328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa2f9d-0b78-431c-b0a5-865193d57d66 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:01.454297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:01.498637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:01.531154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f048-924c-4c2c-85bd-6f2ebe6f062e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:01.571216 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9b286-1d6d-4893-8c87-7c8ddb2f5fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:01.572148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9b286-1d6d-4893-8c87-7c8ddb2f5fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.572881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9b286-1d6d-4893-8c87-7c8ddb2f5fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.573295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9b286-1d6d-4893-8c87-7c8ddb2f5fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.574284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9b286-1d6d-4893-8c87-7c8ddb2f5fb7 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e, user.id=6abcf5b063464a3ba204d3fdd1992e38) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:01.574602 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9b286-1d6d-4893-8c87-7c8ddb2f5fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:01.576034 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9b286-1d6d-4893-8c87-7c8ddb2f5fb7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:01.581333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa2f9d-0b78-431c-b0a5-865193d57d66 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:01.582481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 103/201] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:01 2022] GET /identity/v3/role_assignments?user.id=6abcf5b063464a3ba204d3fdd1992e38&scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:01.583267 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9b286-1d6d-4893-8c87-7c8ddb2f5fb7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:01.677541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e77fb5-eba9-448a-ace9-b60a17ec2d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:01.678147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e77fb5-eba9-448a-ace9-b60a17ec2d06 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.678433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e77fb5-eba9-448a-ace9-b60a17ec2d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.678716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e77fb5-eba9-448a-ace9-b60a17ec2d06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.679574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e77fb5-eba9-448a-ace9-b60a17ec2d06 None admin] RBAC: Adding query filter params (role.id=aa5b9dc3549b47aaabedcc3d727351c0, scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e, user.id=6abcf5b063464a3ba204d3fdd1992e38) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:01.679892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e77fb5-eba9-448a-ace9-b60a17ec2d06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:01.681395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e77fb5-eba9-448a-ace9-b60a17ec2d06 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:01.692247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9b286-1d6d-4893-8c87-7c8ddb2f5fb7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:01.698645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 99/202] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:01 2022] GET /identity/v3/role_assignments?user.id=6abcf5b063464a3ba204d3fdd1992e38&scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e&role.id=aa5b9dc3549b47aaabedcc3d727351c0 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:01.731404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97daf30d-d517-4c24-a3d1-aecbeee3d917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:01.732238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daf30d-d517-4c24-a3d1-aecbeee3d917 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.732522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daf30d-d517-4c24-a3d1-aecbeee3d917 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.732834 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daf30d-d517-4c24-a3d1-aecbeee3d917 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.745779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97daf30d-d517-4c24-a3d1-aecbeee3d917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:01.751606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-97daf30d-d517-4c24-a3d1-aecbeee3d917 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:01.755171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:01.756054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:01.756882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 104/203] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:01.765831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e77fb5-eba9-448a-ace9-b60a17ec2d06 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:01.891805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:01.930913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e77fb5-eba9-448a-ace9-b60a17ec2d06 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:01.967401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccf7b8-b130-4e47-8d3a-64e221b267ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:01.968464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccf7b8-b130-4e47-8d3a-64e221b267ef None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.968977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccf7b8-b130-4e47-8d3a-64e221b267ef None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.969455 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccf7b8-b130-4e47-8d3a-64e221b267ef None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.970400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccf7b8-b130-4e47-8d3a-64e221b267ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:01.971074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccf7b8-b130-4e47-8d3a-64e221b267ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:01.972702 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccf7b8-b130-4e47-8d3a-64e221b267ef None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:01.983261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 100/204] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:01.988797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97daf30d-d517-4c24-a3d1-aecbeee3d917 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:02.148709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97daf30d-d517-4c24-a3d1-aecbeee3d917 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:02.197835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8f3c-0858-4740-a0a5-3475a6a8a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:02.199044 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8f3c-0858-4740-a0a5-3475a6a8a341 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:02.199553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8f3c-0858-4740-a0a5-3475a6a8a341 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:02.200038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8f3c-0858-4740-a0a5-3475a6a8a341 None admin] PATH_INFO: `/v3/users/20c97c2c67824b7b81db361cd18e7551` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:02.202247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e8f3c-0858-4740-a0a5-3475a6a8a341 None admin] RBAC: Authorizing `identity:get_user(user_id=20c97c2c67824b7b81db361cd18e7551)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:02.204008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e8f3c-0858-4740-a0a5-3475a6a8a341 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:02.206454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 105/205] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:01 2022] GET /identity/v3/users/20c97c2c67824b7b81db361cd18e7551 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:02.212065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccf7b8-b130-4e47-8d3a-64e221b267ef None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:02.342141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccf7b8-b130-4e47-8d3a-64e221b267ef None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:02.369212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:02.384394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b68420-43fb-424d-96e5-ba6f70629993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:02.392254 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b68420-43fb-424d-96e5-ba6f70629993 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:02.392254 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b68420-43fb-424d-96e5-ba6f70629993 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:02.392254 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b68420-43fb-424d-96e5-ba6f70629993 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:02.468630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b68420-43fb-424d-96e5-ba6f70629993 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:02.470127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b68420-43fb-424d-96e5-ba6f70629993 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:02.582582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 101/206] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:02.588295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8f3c-0858-4740-a0a5-3475a6a8a341 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:02.731174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:02.774118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8f3c-0858-4740-a0a5-3475a6a8a341 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:02.842819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d165050-ac55-4eb5-b500-e4b09ba78112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:02.843702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165050-ac55-4eb5-b500-e4b09ba78112 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:02.843986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165050-ac55-4eb5-b500-e4b09ba78112 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:02.844262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165050-ac55-4eb5-b500-e4b09ba78112 None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:02.849373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d165050-ac55-4eb5-b500-e4b09ba78112 None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:02.850836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d165050-ac55-4eb5-b500-e4b09ba78112 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:02.852566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 106/207] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:02 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:02.858627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b68420-43fb-424d-96e5-ba6f70629993 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:02.925330 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:02.998191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b68420-43fb-424d-96e5-ba6f70629993 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:03.033306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3292f31-375a-40af-b85f-c3d124833b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:03.033998 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3292f31-375a-40af-b85f-c3d124833b93 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.034290 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3292f31-375a-40af-b85f-c3d124833b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.034573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3292f31-375a-40af-b85f-c3d124833b93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.035418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3292f31-375a-40af-b85f-c3d124833b93 None admin] RBAC: Adding query filter params (role.id=25b9d230b8374a58a3e9746a2893f6f2, scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e, user.id=20c97c2c67824b7b81db361cd18e7551) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:03.035738 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3292f31-375a-40af-b85f-c3d124833b93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:03.037250 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3292f31-375a-40af-b85f-c3d124833b93 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:03.043357 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 102/208] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:02 2022] GET /identity/v3/role_assignments?user.id=20c97c2c67824b7b81db361cd18e7551&scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e&role.id=25b9d230b8374a58a3e9746a2893f6f2 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:03.447153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1995f-1e32-4146-88bf-be6e1301a56e None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.447502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1995f-1e32-4146-88bf-be6e1301a56e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.447676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1995f-1e32-4146-88bf-be6e1301a56e None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.449361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 107/209] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:03.454694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce954e-5ee2-403d-b906-cd1ba5b49a3e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.455040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce954e-5ee2-403d-b906-cd1ba5b49a3e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.455269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce954e-5ee2-403d-b906-cd1ba5b49a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.472679 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-afce954e-5ee2-403d-b906-cd1ba5b49a3e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:03.473872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-afce954e-5ee2-403d-b906-cd1ba5b49a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:03.517916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892a6bd-8251-4c77-bc54-aee2cea79f92 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.519073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892a6bd-8251-4c77-bc54-aee2cea79f92 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.519570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892a6bd-8251-4c77-bc54-aee2cea79f92 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.521164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 108/210] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:53:03.526685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77a319-9fdd-4645-9a9f-f23cf490e810 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.527242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77a319-9fdd-4645-9a9f-f23cf490e810 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.527711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77a319-9fdd-4645-9a9f-f23cf490e810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.543763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 103/211] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:03.549779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7b77a319-9fdd-4645-9a9f-f23cf490e810 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:03.550984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7b77a319-9fdd-4645-9a9f-f23cf490e810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:03.572198 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce954e-5ee2-403d-b906-cd1ba5b49a3e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:03.599499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:03.642324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 109/212] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:03.670002 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77a319-9fdd-4645-9a9f-f23cf490e810 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:03.693185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce954e-5ee2-403d-b906-cd1ba5b49a3e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:03.736324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:03.738439 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf7792-8ca4-49f1-84be-b440938ae416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:03.739299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf7792-8ca4-49f1-84be-b440938ae416 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.740755 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf7792-8ca4-49f1-84be-b440938ae416 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.740755 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf7792-8ca4-49f1-84be-b440938ae416 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.741122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf7792-8ca4-49f1-84be-b440938ae416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:03.742703 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf7792-8ca4-49f1-84be-b440938ae416 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:03.744376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 104/213] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:03.751942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf7792-8ca4-49f1-84be-b440938ae416 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:03.788551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77a319-9fdd-4645-9a9f-f23cf490e810 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:03.829683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f7cbf-eb75-4303-8333-e7a814016930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:03.831826 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7cbf-eb75-4303-8333-e7a814016930 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.832114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7cbf-eb75-4303-8333-e7a814016930 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.832396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7cbf-eb75-4303-8333-e7a814016930 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.844843 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f7cbf-eb75-4303-8333-e7a814016930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:03.854792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-5f7f7cbf-eb75-4303-8333-e7a814016930 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:03.855064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:03.855954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:03.856775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:03.856775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:03.856775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:03.856775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:03.856775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:03.856775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:03.856775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:03.856775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:03.856775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:03.856775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:03.856775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:03.856775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:03.860750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 110/214] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:03.862956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f7cbf-eb75-4303-8333-e7a814016930 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:03.872860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf7792-8ca4-49f1-84be-b440938ae416 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:03.918320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01861771-05a5-41b3-8860-5da0552cc96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:03.919328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01861771-05a5-41b3-8860-5da0552cc96d None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.919807 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01861771-05a5-41b3-8860-5da0552cc96d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.920300 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01861771-05a5-41b3-8860-5da0552cc96d None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.921261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01861771-05a5-41b3-8860-5da0552cc96d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:03.922894 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01861771-05a5-41b3-8860-5da0552cc96d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:03.982074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f7cbf-eb75-4303-8333-e7a814016930 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.005240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.016585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1e737-fe0c-4fc1-a486-801f96cb2941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.017308 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1e737-fe0c-4fc1-a486-801f96cb2941 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.017590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1e737-fe0c-4fc1-a486-801f96cb2941 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.017868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1e737-fe0c-4fc1-a486-801f96cb2941 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.019113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1e737-fe0c-4fc1-a486-801f96cb2941 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:04.019418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1e737-fe0c-4fc1-a486-801f96cb2941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.020840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1e737-fe0c-4fc1-a486-801f96cb2941 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.028762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 105/215] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:53:03 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:53:04.030571 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d344d-f4be-4972-aab9-845689ab6c03 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.030864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d344d-f4be-4972-aab9-845689ab6c03 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.031146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d344d-f4be-4972-aab9-845689ab6c03 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.037010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 106/216] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:04.038869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198890bf-359f-4d63-9f3d-7367238dfe8f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.039200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198890bf-359f-4d63-9f3d-7367238dfe8f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.039460 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 111/217] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:04.040627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198890bf-359f-4d63-9f3d-7367238dfe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.045896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1e737-fe0c-4fc1-a486-801f96cb2941 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.085366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-198890bf-359f-4d63-9f3d-7367238dfe8f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:04.086568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-198890bf-359f-4d63-9f3d-7367238dfe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:04.170643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 107/218] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:04.172013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb615b-f693-4bfb-aeb3-b4e5b6f3989a None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.172305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb615b-f693-4bfb-aeb3-b4e5b6f3989a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.172586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb615b-f693-4bfb-aeb3-b4e5b6f3989a None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.174018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 108/219] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:04.180189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e426-c07a-4338-8f15-495589f92b3a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.180478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e426-c07a-4338-8f15-495589f92b3a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.180790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e426-c07a-4338-8f15-495589f92b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.181449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1e737-fe0c-4fc1-a486-801f96cb2941 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.198857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4724e426-c07a-4338-8f15-495589f92b3a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:04.200075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4724e426-c07a-4338-8f15-495589f92b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:04.218967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f815-11a9-49fc-9880-04a4f5c6b5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.219844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f815-11a9-49fc-9880-04a4f5c6b5cb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.220120 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f815-11a9-49fc-9880-04a4f5c6b5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.220390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f815-11a9-49fc-9880-04a4f5c6b5cb None admin] PATH_INFO: `/v3/users/f7519141db254e3fb8dfd6b5aa805ed6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.238900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407f815-11a9-49fc-9880-04a4f5c6b5cb None admin] RBAC: Authorizing `identity:get_user(user_id=f7519141db254e3fb8dfd6b5aa805ed6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.240359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407f815-11a9-49fc-9880-04a4f5c6b5cb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.242127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 112/220] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/users/f7519141db254e3fb8dfd6b5aa805ed6 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:04.243350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f815-11a9-49fc-9880-04a4f5c6b5cb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.275325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 109/221] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:04.276117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724e426-c07a-4338-8f15-495589f92b3a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.284968 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.297452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.363098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f815-11a9-49fc-9880-04a4f5c6b5cb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.395567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724e426-c07a-4338-8f15-495589f92b3a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.403226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc0f1a-5d51-493c-a5c3-3cfb72cac4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.404033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc0f1a-5d51-493c-a5c3-3cfb72cac4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.404398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc0f1a-5d51-493c-a5c3-3cfb72cac4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.404729 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc0f1a-5d51-493c-a5c3-3cfb72cac4f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.417613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc0f1a-5d51-493c-a5c3-3cfb72cac4f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-e3bc0f1a-5d51-493c-a5c3-3cfb72cac4f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:04.426614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:04.427711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:04.428518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 113/222] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:04.429254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc0f1a-5d51-493c-a5c3-3cfb72cac4f6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.445277 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8d1ba-7495-4a4d-b034-3d8da586d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.446026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8d1ba-7495-4a4d-b034-3d8da586d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.446299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8d1ba-7495-4a4d-b034-3d8da586d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.446738 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8d1ba-7495-4a4d-b034-3d8da586d1d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.525293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8d1ba-7495-4a4d-b034-3d8da586d1d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.526823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8d1ba-7495-4a4d-b034-3d8da586d1d0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.536343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.560893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc0f1a-5d51-493c-a5c3-3cfb72cac4f6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.562630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.606743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0d835-fa76-405e-a1d8-9a8062d65023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.608167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0d835-fa76-405e-a1d8-9a8062d65023 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.608529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0d835-fa76-405e-a1d8-9a8062d65023 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.608911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0d835-fa76-405e-a1d8-9a8062d65023 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.625538 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0d835-fa76-405e-a1d8-9a8062d65023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-7bc0d835-fa76-405e-a1d8-9a8062d65023 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:04.638340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:04.639246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:04.640045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 114/223] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:04.641852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 110/224] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:04.642062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0d835-fa76-405e-a1d8-9a8062d65023 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.646947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8d1ba-7495-4a4d-b034-3d8da586d1d0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.758097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8d1ba-7495-4a4d-b034-3d8da586d1d0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.766505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.768511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0d835-fa76-405e-a1d8-9a8062d65023 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.803599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a09e-aae8-479f-9a52-05b36b498f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.804822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a09e-aae8-479f-9a52-05b36b498f71 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.805369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a09e-aae8-479f-9a52-05b36b498f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.805654 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a09e-aae8-479f-9a52-05b36b498f71 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.807235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8a09e-aae8-479f-9a52-05b36b498f71 None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.809017 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8a09e-aae8-479f-9a52-05b36b498f71 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.809190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838f377-a5cf-4b65-b17f-ff154148ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.810015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838f377-a5cf-4b65-b17f-ff154148ac05 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.810393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838f377-a5cf-4b65-b17f-ff154148ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.810782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838f377-a5cf-4b65-b17f-ff154148ac05 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.811049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 111/225] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:04.811775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838f377-a5cf-4b65-b17f-ff154148ac05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:04.811888 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a09e-aae8-479f-9a52-05b36b498f71 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.812250 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838f377-a5cf-4b65-b17f-ff154148ac05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.813743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838f377-a5cf-4b65-b17f-ff154148ac05 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.828349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 115/226] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:04.829435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838f377-a5cf-4b65-b17f-ff154148ac05 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.857377 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.932963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a09e-aae8-479f-9a52-05b36b498f71 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.962181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838f377-a5cf-4b65-b17f-ff154148ac05 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.970946 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c9b4f-5be7-4744-b5e1-3f428d8e40ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.971770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c9b4f-5be7-4744-b5e1-3f428d8e40ea None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.972148 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c9b4f-5be7-4744-b5e1-3f428d8e40ea None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.972519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c9b4f-5be7-4744-b5e1-3f428d8e40ea None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.973401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c9b4f-5be7-4744-b5e1-3f428d8e40ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:04.973817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c9b4f-5be7-4744-b5e1-3f428d8e40ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.975284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c9b4f-5be7-4744-b5e1-3f428d8e40ea None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.983887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 112/227] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:04.989607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c9b4f-5be7-4744-b5e1-3f428d8e40ea None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:05.005739 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc67cdf-33a9-429b-92fb-0bad14522031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:05.006410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc67cdf-33a9-429b-92fb-0bad14522031 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:05.006694 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc67cdf-33a9-429b-92fb-0bad14522031 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:05.006972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc67cdf-33a9-429b-92fb-0bad14522031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:05.008111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc67cdf-33a9-429b-92fb-0bad14522031 None admin] RBAC: Adding query filter params (role.id=3b950540b0074582839238d2d27d159e, scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e, user.id=f7519141db254e3fb8dfd6b5aa805ed6) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:05.008880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc67cdf-33a9-429b-92fb-0bad14522031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:05.010590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc67cdf-33a9-429b-92fb-0bad14522031 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:05.019276 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 116/228] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/role_assignments?user.id=f7519141db254e3fb8dfd6b5aa805ed6&scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e&role.id=3b950540b0074582839238d2d27d159e => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:05.020432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc67cdf-33a9-429b-92fb-0bad14522031 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:05.031688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:05.159911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c9b4f-5be7-4744-b5e1-3f428d8e40ea None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:05.185292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:05.199729 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc67cdf-33a9-429b-92fb-0bad14522031 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:05.236611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3960f-d36a-4c6a-91c9-73798f26398c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:05.237670 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3960f-d36a-4c6a-91c9-73798f26398c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:05.237956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3960f-d36a-4c6a-91c9-73798f26398c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:05.238233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3960f-d36a-4c6a-91c9-73798f26398c None admin] PATH_INFO: `/v3/users/6abcf5b063464a3ba204d3fdd1992e38` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:05.241228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3960f-d36a-4c6a-91c9-73798f26398c None admin] RBAC: Authorizing `identity:get_user(user_id=6abcf5b063464a3ba204d3fdd1992e38)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:05.242731 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3960f-d36a-4c6a-91c9-73798f26398c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:05.243110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a9f9e-1474-4a62-942e-01a83090d89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:05.244202 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a9f9e-1474-4a62-942e-01a83090d89e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:05.244687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 113/229] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/users/6abcf5b063464a3ba204d3fdd1992e38 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:05.244906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a9f9e-1474-4a62-942e-01a83090d89e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:05.245371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a9f9e-1474-4a62-942e-01a83090d89e None admin] PATH_INFO: `/v3/users/6abcf5b063464a3ba204d3fdd1992e38` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:05.246791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a9f9e-1474-4a62-942e-01a83090d89e None admin] RBAC: Authorizing `identity:get_user(user_id=6abcf5b063464a3ba204d3fdd1992e38)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:05.248510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a9f9e-1474-4a62-942e-01a83090d89e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:05.249917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3960f-d36a-4c6a-91c9-73798f26398c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:05.250965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 117/230] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:05 2022] GET /identity/v3/users/6abcf5b063464a3ba204d3fdd1992e38 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:05.257391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a9f9e-1474-4a62-942e-01a83090d89e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:05.378331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a9f9e-1474-4a62-942e-01a83090d89e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:05.415781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853f9e2-f2d6-496f-a340-48c5ea329543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:05.417019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853f9e2-f2d6-496f-a340-48c5ea329543 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:05.417608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853f9e2-f2d6-496f-a340-48c5ea329543 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:05.418085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853f9e2-f2d6-496f-a340-48c5ea329543 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:05.419488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853f9e2-f2d6-496f-a340-48c5ea329543 None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:05.421171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853f9e2-f2d6-496f-a340-48c5ea329543 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:05.423588 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 118/231] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:05 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:05.431262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853f9e2-f2d6-496f-a340-48c5ea329543 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:05.437127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3960f-d36a-4c6a-91c9-73798f26398c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:05.439476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:05.473109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f960193-0d79-4625-bc14-387d4d520432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:05.474020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f960193-0d79-4625-bc14-387d4d520432 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:05.474307 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f960193-0d79-4625-bc14-387d4d520432 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:05.474637 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f960193-0d79-4625-bc14-387d4d520432 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:05.475793 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f960193-0d79-4625-bc14-387d4d520432 None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:05.477339 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f960193-0d79-4625-bc14-387d4d520432 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:05.479455 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 114/232] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:05 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:05.480533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:05.485163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f960193-0d79-4625-bc14-387d4d520432 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:05.594859 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f960193-0d79-4625-bc14-387d4d520432 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:05.632610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8ec6b-4080-4060-8171-b0de3531bc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:05.633933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8ec6b-4080-4060-8171-b0de3531bc01 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:05.634474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8ec6b-4080-4060-8171-b0de3531bc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:05.634952 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8ec6b-4080-4060-8171-b0de3531bc01 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e/users/6abcf5b063464a3ba204d3fdd1992e38/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:05.637595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8ec6b-4080-4060-8171-b0de3531bc01 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e, user_id=6abcf5b063464a3ba204d3fdd1992e38, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:05.639238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8ec6b-4080-4060-8171-b0de3531bc01 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:05.657176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853f9e2-f2d6-496f-a340-48c5ea329543 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:05.695229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e9a6e-8837-4a6b-9921-4df0917166f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:05.696505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e9a6e-8837-4a6b-9921-4df0917166f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:05.697019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e9a6e-8837-4a6b-9921-4df0917166f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:05.697495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e9a6e-8837-4a6b-9921-4df0917166f5 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e/users/6abcf5b063464a3ba204d3fdd1992e38/roles/aa5b9dc3549b47aaabedcc3d727351c0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:05.699994 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e9a6e-8837-4a6b-9921-4df0917166f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e, user_id=6abcf5b063464a3ba204d3fdd1992e38, role_id=aa5b9dc3549b47aaabedcc3d727351c0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:05.701750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e9a6e-8837-4a6b-9921-4df0917166f5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:05.737648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 115/233] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:05 2022] PUT /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e/users/6abcf5b063464a3ba204d3fdd1992e38/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:53:05.829820 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 119/234] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:05 2022] PUT /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e/users/6abcf5b063464a3ba204d3fdd1992e38/roles/aa5b9dc3549b47aaabedcc3d727351c0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:06.330789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56edd8-3eb7-4154-b523-4d95a51bbcf8 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:06.331295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56edd8-3eb7-4154-b523-4d95a51bbcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:06.331295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56edd8-3eb7-4154-b523-4d95a51bbcf8 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:06.332907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 116/235] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:06.338302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c955dc0-246b-4b67-b57a-885ee96c86bd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:06.338604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c955dc0-246b-4b67-b57a-885ee96c86bd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:06.338891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c955dc0-246b-4b67-b57a-885ee96c86bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:06.365713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6c955dc0-246b-4b67-b57a-885ee96c86bd None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:06.366926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6c955dc0-246b-4b67-b57a-885ee96c86bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:06.451976 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 120/236] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:06.492966 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56edd8-3eb7-4154-b523-4d95a51bbcf8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:06.506329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a0299-5a57-450e-a32e-780d263eb2aa None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:06.506624 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a0299-5a57-450e-a32e-780d263eb2aa None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:06.506900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a0299-5a57-450e-a32e-780d263eb2aa None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:06.508533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 121/237] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:06.513526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba33c7-6d9e-4444-8733-64cbd19da7ca None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:06.513815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba33c7-6d9e-4444-8733-64cbd19da7ca None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:06.514091 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba33c7-6d9e-4444-8733-64cbd19da7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:06.532077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8dba33c7-6d9e-4444-8733-64cbd19da7ca None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:06.534239 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8dba33c7-6d9e-4444-8733-64cbd19da7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:06.546285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:06.557030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:06.638870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 122/238] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:06.665385 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56edd8-3eb7-4154-b523-4d95a51bbcf8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:06.675327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba33c7-6d9e-4444-8733-64cbd19da7ca None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:06.728857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5fde8-4e2d-4a82-861d-6c77a91bef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:06.729658 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5fde8-4e2d-4a82-861d-6c77a91bef2d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:06.729945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5fde8-4e2d-4a82-861d-6c77a91bef2d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:06.730227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5fde8-4e2d-4a82-861d-6c77a91bef2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:06.757617 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5fde8-4e2d-4a82-861d-6c77a91bef2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-b0c5fde8-4e2d-4a82-861d-6c77a91bef2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:06.772096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:06.773015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:06.773795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:06.773795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:06.773795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:06.773795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:06.773795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:06.773795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:06.773795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:06.773795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:06.773795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:06.773795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:06.773795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:06.773795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:06.775518 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 117/239] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:06.780299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5fde8-4e2d-4a82-861d-6c77a91bef2d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:06.848603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba33c7-6d9e-4444-8733-64cbd19da7ca None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:06.901242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:06.907577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048746a-3916-4a49-9539-91082e07961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:06.908376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048746a-3916-4a49-9539-91082e07961d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:06.908703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048746a-3916-4a49-9539-91082e07961d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:06.908992 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048746a-3916-4a49-9539-91082e07961d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:06.910144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048746a-3916-4a49-9539-91082e07961d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:06.911588 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048746a-3916-4a49-9539-91082e07961d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:06.913520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 123/240] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:06.917589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5fde8-4e2d-4a82-861d-6c77a91bef2d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:06.918763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048746a-3916-4a49-9539-91082e07961d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:06.951920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:07.000630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd576c6-8214-4e18-b55d-7e3572fd785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:07.001330 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd576c6-8214-4e18-b55d-7e3572fd785c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.001612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd576c6-8214-4e18-b55d-7e3572fd785c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.001885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd576c6-8214-4e18-b55d-7e3572fd785c None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.002704 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd576c6-8214-4e18-b55d-7e3572fd785c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:07.003009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd576c6-8214-4e18-b55d-7e3572fd785c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:07.004394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd576c6-8214-4e18-b55d-7e3572fd785c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:07.026566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 118/241] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:07.029721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd576c6-8214-4e18-b55d-7e3572fd785c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:07.049118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048746a-3916-4a49-9539-91082e07961d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:07.102303 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292d1df-c5a9-450e-8778-a3c3c83727fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:07.102981 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d1df-c5a9-450e-8778-a3c3c83727fb None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.103266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d1df-c5a9-450e-8778-a3c3c83727fb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.103545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d1df-c5a9-450e-8778-a3c3c83727fb None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.104261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292d1df-c5a9-450e-8778-a3c3c83727fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:07.105722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292d1df-c5a9-450e-8778-a3c3c83727fb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:07.174712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd576c6-8214-4e18-b55d-7e3572fd785c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:07.208960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 124/242] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:53:06 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:53:07.223590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706a51d-9781-4344-836c-3b5c0b533471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:07.224591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706a51d-9781-4344-836c-3b5c0b533471 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.224939 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706a51d-9781-4344-836c-3b5c0b533471 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.225221 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706a51d-9781-4344-836c-3b5c0b533471 None admin] PATH_INFO: `/v3/users/a9e6d753e36e45ddb6e7955354850ce9` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.248210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706a51d-9781-4344-836c-3b5c0b533471 None admin] RBAC: Authorizing `identity:get_user(user_id=a9e6d753e36e45ddb6e7955354850ce9)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:07.249735 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706a51d-9781-4344-836c-3b5c0b533471 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:07.251562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 119/243] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:07 2022] GET /identity/v3/users/a9e6d753e36e45ddb6e7955354850ce9 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:07.257912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292d1df-c5a9-450e-8778-a3c3c83727fb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:07.355509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:07.391059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292d1df-c5a9-450e-8778-a3c3c83727fb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:07.428340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6375936-52e1-4238-adef-f9b123a60314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:07.429342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6375936-52e1-4238-adef-f9b123a60314 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.429846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6375936-52e1-4238-adef-f9b123a60314 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.430338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6375936-52e1-4238-adef-f9b123a60314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.504263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6375936-52e1-4238-adef-f9b123a60314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:07.506085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6375936-52e1-4238-adef-f9b123a60314 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:07.509046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03def1d3-9026-4db8-a29e-32bc1bdb6295 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.509497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03def1d3-9026-4db8-a29e-32bc1bdb6295 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.509665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03def1d3-9026-4db8-a29e-32bc1bdb6295 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.510970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 120/244] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:07.515990 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f5b38-e61f-48d1-8ef2-9168bc1a7f2a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.516275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f5b38-e61f-48d1-8ef2-9168bc1a7f2a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.516553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f5b38-e61f-48d1-8ef2-9168bc1a7f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.537310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-af3f5b38-e61f-48d1-8ef2-9168bc1a7f2a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:07.538931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-af3f5b38-e61f-48d1-8ef2-9168bc1a7f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:07.550122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:07.585727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:07.626241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 125/245] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 12:53:07.632378 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6375936-52e1-4238-adef-f9b123a60314 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:07.636440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 121/246] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:07.665585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f5b38-e61f-48d1-8ef2-9168bc1a7f2a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:07.754109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6375936-52e1-4238-adef-f9b123a60314 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:07.793988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed40902-bf7a-445c-82b2-69f4c9b0aa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:07.795187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed40902-bf7a-445c-82b2-69f4c9b0aa52 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.795399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f5b38-e61f-48d1-8ef2-9168bc1a7f2a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:07.795836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed40902-bf7a-445c-82b2-69f4c9b0aa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.796277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed40902-bf7a-445c-82b2-69f4c9b0aa52 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.797703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed40902-bf7a-445c-82b2-69f4c9b0aa52 None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:07.799876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed40902-bf7a-445c-82b2-69f4c9b0aa52 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:07.802225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 126/247] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:07 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:07.809619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed40902-bf7a-445c-82b2-69f4c9b0aa52 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:07.845247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adabbe-63a5-417d-91a8-bc3b006e398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:07.847570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adabbe-63a5-417d-91a8-bc3b006e398a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.847570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adabbe-63a5-417d-91a8-bc3b006e398a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.847570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adabbe-63a5-417d-91a8-bc3b006e398a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.863431 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adabbe-63a5-417d-91a8-bc3b006e398a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:07.864936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-e8adabbe-63a5-417d-91a8-bc3b006e398a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:07.874111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:07.875026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:07.875803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:07.875803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:07.875803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:07.875803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:07.875803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:07.875803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:07.875803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:07.875803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:07.875803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:07.875803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:07.875803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:07.875803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:07.879036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 122/248] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:07.885385 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adabbe-63a5-417d-91a8-bc3b006e398a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:07.888841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:07.944367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed40902-bf7a-445c-82b2-69f4c9b0aa52 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:07.989175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88935c35-d1d3-4285-a583-88f5d1ad2c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:07.990504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935c35-d1d3-4285-a583-88f5d1ad2c7a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.990504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935c35-d1d3-4285-a583-88f5d1ad2c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.990696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935c35-d1d3-4285-a583-88f5d1ad2c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.991468 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88935c35-d1d3-4285-a583-88f5d1ad2c7a None admin] RBAC: Adding query filter params (role.id=25b9d230b8374a58a3e9746a2893f6f2, scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e, user.id=a9e6d753e36e45ddb6e7955354850ce9) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:07.992173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88935c35-d1d3-4285-a583-88f5d1ad2c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:07.993689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88935c35-d1d3-4285-a583-88f5d1ad2c7a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:08.001805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 127/249] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:07 2022] GET /identity/v3/role_assignments?user.id=a9e6d753e36e45ddb6e7955354850ce9&scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e&role.id=25b9d230b8374a58a3e9746a2893f6f2 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:08.017127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adabbe-63a5-417d-91a8-bc3b006e398a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:08.059222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c5ee6-b795-4e6e-949c-e1dd0d89eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:08.060275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c5ee6-b795-4e6e-949c-e1dd0d89eea8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:08.060796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c5ee6-b795-4e6e-949c-e1dd0d89eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:08.061285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c5ee6-b795-4e6e-949c-e1dd0d89eea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:08.062252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c5ee6-b795-4e6e-949c-e1dd0d89eea8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:08.062753 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c5ee6-b795-4e6e-949c-e1dd0d89eea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:08.064393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c5ee6-b795-4e6e-949c-e1dd0d89eea8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:08.074876 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 123/250] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:08.081443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88935c35-d1d3-4285-a583-88f5d1ad2c7a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:08.213653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:08.216916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88935c35-d1d3-4285-a583-88f5d1ad2c7a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:08.254301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd590f7f-8880-4ca5-946e-e3029f755482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:08.255204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd590f7f-8880-4ca5-946e-e3029f755482 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:08.255489 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd590f7f-8880-4ca5-946e-e3029f755482 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:08.255827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd590f7f-8880-4ca5-946e-e3029f755482 None admin] PATH_INFO: `/v3/users/f7519141db254e3fb8dfd6b5aa805ed6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:08.257178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd590f7f-8880-4ca5-946e-e3029f755482 None admin] RBAC: Authorizing `identity:get_user(user_id=f7519141db254e3fb8dfd6b5aa805ed6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:08.258650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd590f7f-8880-4ca5-946e-e3029f755482 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:08.260772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 128/251] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:08 2022] GET /identity/v3/users/f7519141db254e3fb8dfd6b5aa805ed6 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:08.266275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c5ee6-b795-4e6e-949c-e1dd0d89eea8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:08.354959 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:08.384686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10241a87-dee4-4297-b346-dd466d7de09a None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:08.384686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10241a87-dee4-4297-b346-dd466d7de09a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:08.384686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10241a87-dee4-4297-b346-dd466d7de09a None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:08.384686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 129/252] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:08.388761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950da213-dbe0-4ef5-8102-80b4ab7d491a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:08.388985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950da213-dbe0-4ef5-8102-80b4ab7d491a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:08.389269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950da213-dbe0-4ef5-8102-80b4ab7d491a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:08.401848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c5ee6-b795-4e6e-949c-e1dd0d89eea8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:08.425732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-950da213-dbe0-4ef5-8102-80b4ab7d491a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:08.426945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-950da213-dbe0-4ef5-8102-80b4ab7d491a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:08.437683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89843e6f-7547-42be-9eb9-05c03298a712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:08.438905 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89843e6f-7547-42be-9eb9-05c03298a712 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:08.439395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89843e6f-7547-42be-9eb9-05c03298a712 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:08.439987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89843e6f-7547-42be-9eb9-05c03298a712 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:08.441494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89843e6f-7547-42be-9eb9-05c03298a712 None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:08.443211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89843e6f-7547-42be-9eb9-05c03298a712 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:08.445210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 124/253] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:08 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:08.450907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89843e6f-7547-42be-9eb9-05c03298a712 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:08.556341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89843e6f-7547-42be-9eb9-05c03298a712 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:08.560930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 130/254] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:08.588537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:08.595446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf507d-49c3-4697-bf6e-0e57b8948156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:08.596633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf507d-49c3-4697-bf6e-0e57b8948156 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:08.597094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf507d-49c3-4697-bf6e-0e57b8948156 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:08.598998 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf507d-49c3-4697-bf6e-0e57b8948156 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e/users/f7519141db254e3fb8dfd6b5aa805ed6/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:08.599726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf507d-49c3-4697-bf6e-0e57b8948156 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e, user_id=f7519141db254e3fb8dfd6b5aa805ed6, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:08.601369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf507d-49c3-4697-bf6e-0e57b8948156 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:08.605647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950da213-dbe0-4ef5-8102-80b4ab7d491a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:08.666992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 125/255] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:08 2022] PUT /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e/users/f7519141db254e3fb8dfd6b5aa805ed6/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:53:08.751158 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:08.754786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950da213-dbe0-4ef5-8102-80b4ab7d491a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:08.801762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16589367-3715-4f02-8480-84b9a584d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:08.802572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16589367-3715-4f02-8480-84b9a584d960 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:08.802856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16589367-3715-4f02-8480-84b9a584d960 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:08.803192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16589367-3715-4f02-8480-84b9a584d960 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:08.815480 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16589367-3715-4f02-8480-84b9a584d960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-16589367-3715-4f02-8480-84b9a584d960 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:08.823789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:08.824767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:08.825555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 131/256] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:08.831141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf507d-49c3-4697-bf6e-0e57b8948156 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:08.949160 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e21a-b10e-4605-a33b-d73ec1aff02c None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:08.949160 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e21a-b10e-4605-a33b-d73ec1aff02c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:08.949712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e21a-b10e-4605-a33b-d73ec1aff02c None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:08.950659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 132/257] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:08.958007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdb080-cc58-4053-a266-bed37aada1aa None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:08.958390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdb080-cc58-4053-a266-bed37aada1aa None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:08.958629 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdb080-cc58-4053-a266-bed37aada1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:08.963726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf507d-49c3-4697-bf6e-0e57b8948156 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:08.993654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e2cdb080-cc58-4053-a266-bed37aada1aa None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:08.994914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e2cdb080-cc58-4053-a266-bed37aada1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:08.999254 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a361-61d8-4589-88a2-522dc3a1c10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:09.000192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a361-61d8-4589-88a2-522dc3a1c10f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:09.000706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a361-61d8-4589-88a2-522dc3a1c10f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:09.001192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a361-61d8-4589-88a2-522dc3a1c10f None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:09.002154 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0a361-61d8-4589-88a2-522dc3a1c10f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:09.003199 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0a361-61d8-4589-88a2-522dc3a1c10f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:09.004827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0a361-61d8-4589-88a2-522dc3a1c10f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:09.014042 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 126/258] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:09.023942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a361-61d8-4589-88a2-522dc3a1c10f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:09.091806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:09.138527 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a361-61d8-4589-88a2-522dc3a1c10f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:09.156477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 133/259] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:09.180495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9624-22a3-465a-99b9-e3e5c10ac4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:09.181782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9624-22a3-465a-99b9-e3e5c10ac4fc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:09.182297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9624-22a3-465a-99b9-e3e5c10ac4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:09.182770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9624-22a3-465a-99b9-e3e5c10ac4fc None admin] PATH_INFO: `/v3/users/6abcf5b063464a3ba204d3fdd1992e38` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:09.184212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c9624-22a3-465a-99b9-e3e5c10ac4fc None admin] RBAC: Authorizing `identity:get_user(user_id=6abcf5b063464a3ba204d3fdd1992e38)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:09.186173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c9624-22a3-465a-99b9-e3e5c10ac4fc None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:09.188106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 127/260] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:09 2022] GET /identity/v3/users/6abcf5b063464a3ba204d3fdd1992e38 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:09.193518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdb080-cc58-4053-a266-bed37aada1aa None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:09.202081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9624-22a3-465a-99b9-e3e5c10ac4fc None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:09.337991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:09.348731 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9624-22a3-465a-99b9-e3e5c10ac4fc None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:09.356945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdb080-cc58-4053-a266-bed37aada1aa None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:09.374620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:09.388063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843f05e-8557-4095-a8e9-940ba115ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:09.389057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843f05e-8557-4095-a8e9-940ba115ef08 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:09.389549 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843f05e-8557-4095-a8e9-940ba115ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:09.390052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843f05e-8557-4095-a8e9-940ba115ef08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:09.391851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b142a-074d-4bbc-9611-b0e12d37abca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:09.392684 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b142a-074d-4bbc-9611-b0e12d37abca None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:09.392999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b142a-074d-4bbc-9611-b0e12d37abca None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:09.393280 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b142a-074d-4bbc-9611-b0e12d37abca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:09.404066 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b142a-074d-4bbc-9611-b0e12d37abca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-8c0b142a-074d-4bbc-9611-b0e12d37abca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:09.420491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:09.421585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:09.422387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 134/261] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:53:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:09.427627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b142a-074d-4bbc-9611-b0e12d37abca None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:09.472848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843f05e-8557-4095-a8e9-940ba115ef08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:09.474916 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843f05e-8557-4095-a8e9-940ba115ef08 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:09.550342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b142a-074d-4bbc-9611-b0e12d37abca None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:09.584450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3f09e-9eed-4db1-901f-bbab916552a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:09.585152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f09e-9eed-4db1-901f-bbab916552a5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:09.585440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f09e-9eed-4db1-901f-bbab916552a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:09.585720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3f09e-9eed-4db1-901f-bbab916552a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:09.586479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3f09e-9eed-4db1-901f-bbab916552a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:09.586831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3f09e-9eed-4db1-901f-bbab916552a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:09.587063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 128/262] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:09.592567 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3f09e-9eed-4db1-901f-bbab916552a5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:09.601831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 135/263] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:09.603165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843f05e-8557-4095-a8e9-940ba115ef08 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:09.607586 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3f09e-9eed-4db1-901f-bbab916552a5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:09.628386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:09.654322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:09.770311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3f09e-9eed-4db1-901f-bbab916552a5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:09.806858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843f05e-8557-4095-a8e9-940ba115ef08 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:09.810127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53344cb9-1a3c-4703-b9d3-3135f0e03fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:09.811004 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53344cb9-1a3c-4703-b9d3-3135f0e03fbc None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:09.811286 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53344cb9-1a3c-4703-b9d3-3135f0e03fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:09.811560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53344cb9-1a3c-4703-b9d3-3135f0e03fbc None admin] PATH_INFO: `/v3/users/6abcf5b063464a3ba204d3fdd1992e38` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:09.817300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53344cb9-1a3c-4703-b9d3-3135f0e03fbc None admin] RBAC: Authorizing `identity:get_user(user_id=6abcf5b063464a3ba204d3fdd1992e38)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:09.818752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53344cb9-1a3c-4703-b9d3-3135f0e03fbc None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:09.820394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 136/264] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:09 2022] GET /identity/v3/users/6abcf5b063464a3ba204d3fdd1992e38 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:09.825735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53344cb9-1a3c-4703-b9d3-3135f0e03fbc None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:09.888745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fd9f6-973a-4231-af99-c13fb4ddde5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:09.889624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fd9f6-973a-4231-af99-c13fb4ddde5d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:09.889907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fd9f6-973a-4231-af99-c13fb4ddde5d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:09.890186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fd9f6-973a-4231-af99-c13fb4ddde5d None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:09.891383 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fd9f6-973a-4231-af99-c13fb4ddde5d None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:09.900916 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fd9f6-973a-4231-af99-c13fb4ddde5d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:09.902696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 129/265] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:09 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:09.921924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fd9f6-973a-4231-af99-c13fb4ddde5d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:09.933719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:09.945350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53344cb9-1a3c-4703-b9d3-3135f0e03fbc None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:10.009012 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc19466-7b14-45f3-babb-689ba5030f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:10.009673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc19466-7b14-45f3-babb-689ba5030f27 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:10.009942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc19466-7b14-45f3-babb-689ba5030f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:10.010224 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc19466-7b14-45f3-babb-689ba5030f27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:10.114253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:10.136072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fd9f6-973a-4231-af99-c13fb4ddde5d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:10.146296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc19466-7b14-45f3-babb-689ba5030f27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:10.151284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc19466-7b14-45f3-babb-689ba5030f27 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:10.202185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379f9f9-e0d0-40ee-837f-fd71be24cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:10.202849 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f9f9-e0d0-40ee-837f-fd71be24cb18 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:10.203135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f9f9-e0d0-40ee-837f-fd71be24cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:10.206146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f9f9-e0d0-40ee-837f-fd71be24cb18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:10.206993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379f9f9-e0d0-40ee-837f-fd71be24cb18 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e, user.id=6abcf5b063464a3ba204d3fdd1992e38) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:10.207310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379f9f9-e0d0-40ee-837f-fd71be24cb18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:10.208778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379f9f9-e0d0-40ee-837f-fd71be24cb18 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:10.225714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 130/266] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:09 2022] GET /identity/v3/role_assignments?user.id=6abcf5b063464a3ba204d3fdd1992e38&scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:10.274186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:10.306129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 137/267] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:10.311536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379f9f9-e0d0-40ee-837f-fd71be24cb18 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:10.440532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379f9f9-e0d0-40ee-837f-fd71be24cb18 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:10.490393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bae2d-440b-460d-9d6e-f1352b738e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:10.491274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bae2d-440b-460d-9d6e-f1352b738e9c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:10.491561 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bae2d-440b-460d-9d6e-f1352b738e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:10.491841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bae2d-440b-460d-9d6e-f1352b738e9c None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:10.497520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bae2d-440b-460d-9d6e-f1352b738e9c None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:10.499018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bae2d-440b-460d-9d6e-f1352b738e9c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:10.501282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 131/268] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:10 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:10.506752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc19466-7b14-45f3-babb-689ba5030f27 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:10.612076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc19466-7b14-45f3-babb-689ba5030f27 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:10.652179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72543a-7c57-4386-92f1-e97a42f1965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:10.652894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72543a-7c57-4386-92f1-e97a42f1965d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:10.653182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72543a-7c57-4386-92f1-e97a42f1965d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:10.653500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72543a-7c57-4386-92f1-e97a42f1965d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:10.654329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72543a-7c57-4386-92f1-e97a42f1965d None admin] RBAC: Adding query filter params (role.id=aa5b9dc3549b47aaabedcc3d727351c0, scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e, user.id=6abcf5b063464a3ba204d3fdd1992e38) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:10.654648 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72543a-7c57-4386-92f1-e97a42f1965d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:10.656141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72543a-7c57-4386-92f1-e97a42f1965d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:10.663822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 138/269] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:10 2022] GET /identity/v3/role_assignments?user.id=6abcf5b063464a3ba204d3fdd1992e38&scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e&role.id=aa5b9dc3549b47aaabedcc3d727351c0 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:10.839144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2a9f0-2056-4c86-a809-170fd03ad737 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:10.839665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2a9f0-2056-4c86-a809-170fd03ad737 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:10.839740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2a9f0-2056-4c86-a809-170fd03ad737 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:10.841115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 132/270] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:10.846708 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e242b-3355-4481-aa04-65e48a79f6c9 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:10.846997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e242b-3355-4481-aa04-65e48a79f6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:10.847278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e242b-3355-4481-aa04-65e48a79f6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:10.869870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a25e242b-3355-4481-aa04-65e48a79f6c9 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:10.871093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a25e242b-3355-4481-aa04-65e48a79f6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:10.916754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:10.955183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 139/271] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:10.981400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2a9f0-2056-4c86-a809-170fd03ad737 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:10.992184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae37118-1e95-46c1-9ee1-e1d67f2e18a2 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:10.992474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae37118-1e95-46c1-9ee1-e1d67f2e18a2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:10.992783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae37118-1e95-46c1-9ee1-e1d67f2e18a2 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:10.996321 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 140/272] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:11.000973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cb4a7-dca0-491f-b984-7d72340bdc8f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:11.001261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cb4a7-dca0-491f-b984-7d72340bdc8f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:11.001539 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cb4a7-dca0-491f-b984-7d72340bdc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:11.026152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:11.030136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-466cb4a7-dca0-491f-b984-7d72340bdc8f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:11.034239 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-466cb4a7-dca0-491f-b984-7d72340bdc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:11.141276 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 141/273] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:11.142697 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994039-aa86-4fda-9fcc-fc7bf0bb78d2 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:11.143098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994039-aa86-4fda-9fcc-fc7bf0bb78d2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:11.143451 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994039-aa86-4fda-9fcc-fc7bf0bb78d2 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:11.144824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 142/274] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:11.150349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2a9f0-2056-4c86-a809-170fd03ad737 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:11.150488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2376-15e1-47e9-a63a-b45afbe34c93 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:11.150689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2376-15e1-47e9-a63a-b45afbe34c93 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:11.150956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2376-15e1-47e9-a63a-b45afbe34c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:11.170192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6e2b2376-15e1-47e9-a63a-b45afbe34c93 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:11.171407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6e2b2376-15e1-47e9-a63a-b45afbe34c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:11.191092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fcceb-b36d-421d-aa79-387d0ee98850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:11.191894 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fcceb-b36d-421d-aa79-387d0ee98850 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:11.192622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fcceb-b36d-421d-aa79-387d0ee98850 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:11.192964 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fcceb-b36d-421d-aa79-387d0ee98850 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:11.194233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fcceb-b36d-421d-aa79-387d0ee98850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:11.195698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fcceb-b36d-421d-aa79-387d0ee98850 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:11.197376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 133/275] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:11.202486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fcceb-b36d-421d-aa79-387d0ee98850 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:11.242295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 143/276] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:11.243514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2376-15e1-47e9-a63a-b45afbe34c93 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:11.283741 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:11.304850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:11.314062 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fcceb-b36d-421d-aa79-387d0ee98850 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:11.352858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1299c-85d8-4d30-9838-27d34f19444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:11.353676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1299c-85d8-4d30-9838-27d34f19444e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:11.353964 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1299c-85d8-4d30-9838-27d34f19444e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:11.354244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1299c-85d8-4d30-9838-27d34f19444e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:11.355245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2376-15e1-47e9-a63a-b45afbe34c93 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:11.365445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1299c-85d8-4d30-9838-27d34f19444e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-b7a1299c-85d8-4d30-9838-27d34f19444e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:11.373353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:11.374229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 134/277] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:11.375740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1299c-85d8-4d30-9838-27d34f19444e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:11.394873 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c6092-3200-489a-b2e0-f09d820f4e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:11.395481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c6092-3200-489a-b2e0-f09d820f4e35 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:11.395767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c6092-3200-489a-b2e0-f09d820f4e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:11.396038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c6092-3200-489a-b2e0-f09d820f4e35 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:11.397029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c6092-3200-489a-b2e0-f09d820f4e35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:11.398460 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c6092-3200-489a-b2e0-f09d820f4e35 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:11.474937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1299c-85d8-4d30-9838-27d34f19444e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:11.491775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 144/278] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:53:11 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:53:11.505734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c6092-3200-489a-b2e0-f09d820f4e35 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:11.522661 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8780c2-a202-48b8-a64d-db6b31fdb2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:11.523649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8780c2-a202-48b8-a64d-db6b31fdb2de None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:11.524009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8780c2-a202-48b8-a64d-db6b31fdb2de None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:11.524398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8780c2-a202-48b8-a64d-db6b31fdb2de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:11.540953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8780c2-a202-48b8-a64d-db6b31fdb2de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-ca8780c2-a202-48b8-a64d-db6b31fdb2de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:11.553660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:11.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:11.555630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 135/279] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:11.570933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8780c2-a202-48b8-a64d-db6b31fdb2de None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:11.587866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:11.623662 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:11.636590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c6092-3200-489a-b2e0-f09d820f4e35 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:11.682409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82e654-968b-45e5-b342-6ab557ca7a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:11.682409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82e654-968b-45e5-b342-6ab557ca7a71 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:11.682409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82e654-968b-45e5-b342-6ab557ca7a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:11.682409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82e654-968b-45e5-b342-6ab557ca7a71 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:11.682808 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82e654-968b-45e5-b342-6ab557ca7a71 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:11.682808 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82e654-968b-45e5-b342-6ab557ca7a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:11.683898 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82e654-968b-45e5-b342-6ab557ca7a71 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:11.693872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 145/280] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:11.695007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21c9cb-4871-4401-a5fb-3225ebdbe281 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:11.695546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21c9cb-4871-4401-a5fb-3225ebdbe281 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:11.695662 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21c9cb-4871-4401-a5fb-3225ebdbe281 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:11.700962 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 146/281] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:11.701752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21c9cb-4871-4401-a5fb-3225ebdbe281 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:11.704474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8780c2-a202-48b8-a64d-db6b31fdb2de None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:11.747498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80fc63-d01c-4e4a-8bea-be126785fc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:11.748755 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80fc63-d01c-4e4a-8bea-be126785fc7e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:11.748755 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80fc63-d01c-4e4a-8bea-be126785fc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:11.750075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80fc63-d01c-4e4a-8bea-be126785fc7e None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:11.750980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80fc63-d01c-4e4a-8bea-be126785fc7e None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:11.750980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80fc63-d01c-4e4a-8bea-be126785fc7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:11.752567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80fc63-d01c-4e4a-8bea-be126785fc7e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:11.763105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 136/282] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:11.765630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4b1b4-a239-4be7-96f9-c39c5a34e7dd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:11.766107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4b1b4-a239-4be7-96f9-c39c5a34e7dd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:11.767056 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4b1b4-a239-4be7-96f9-c39c5a34e7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:11.790534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a2c4b1b4-a239-4be7-96f9-c39c5a34e7dd None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:11.791408 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a2c4b1b4-a239-4be7-96f9-c39c5a34e7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:11.842814 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21c9cb-4871-4401-a5fb-3225ebdbe281 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:11.881971 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 137/283] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:11.883293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4b1b4-a239-4be7-96f9-c39c5a34e7dd None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:11.886315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:11.886749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9619d-8d61-40e4-a111-bcf1f980df3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:11.887621 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9619d-8d61-40e4-a111-bcf1f980df3a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:11.887904 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9619d-8d61-40e4-a111-bcf1f980df3a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:11.888177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9619d-8d61-40e4-a111-bcf1f980df3a None admin] PATH_INFO: `/v3/users/a9e6d753e36e45ddb6e7955354850ce9` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:11.889363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9619d-8d61-40e4-a111-bcf1f980df3a None admin] RBAC: Authorizing `identity:get_user(user_id=a9e6d753e36e45ddb6e7955354850ce9)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:11.890906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9619d-8d61-40e4-a111-bcf1f980df3a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:11.892865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 147/284] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:11 2022] GET /identity/v3/users/a9e6d753e36e45ddb6e7955354850ce9 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:11.899282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9619d-8d61-40e4-a111-bcf1f980df3a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:11.921522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:12.009892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9619d-8d61-40e4-a111-bcf1f980df3a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:12.022322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4b1b4-a239-4be7-96f9-c39c5a34e7dd None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:12.052758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69090f-bdf5-46a8-8031-ec97275c3404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:12.053913 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69090f-bdf5-46a8-8031-ec97275c3404 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:12.054205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69090f-bdf5-46a8-8031-ec97275c3404 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:12.054495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69090f-bdf5-46a8-8031-ec97275c3404 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:12.056402 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69090f-bdf5-46a8-8031-ec97275c3404 None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:12.058554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69090f-bdf5-46a8-8031-ec97275c3404 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:12.060547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c174b64-5cb8-4110-b67d-e343d601f2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:12.060709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 148/285] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:11 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:12.061519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69090f-bdf5-46a8-8031-ec97275c3404 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:12.061653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c174b64-5cb8-4110-b67d-e343d601f2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:12.061925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c174b64-5cb8-4110-b67d-e343d601f2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:12.062256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c174b64-5cb8-4110-b67d-e343d601f2e7 None admin] PATH_INFO: `/v3/users/a16ad412e6dc4b8c95c470544bb3f805` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:12.082052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c174b64-5cb8-4110-b67d-e343d601f2e7 None admin] RBAC: Authorizing `identity:get_user(user_id=a16ad412e6dc4b8c95c470544bb3f805)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:12.083053 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c174b64-5cb8-4110-b67d-e343d601f2e7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:12.084885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 138/286] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:11 2022] GET /identity/v3/users/a16ad412e6dc4b8c95c470544bb3f805 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:12.085676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c174b64-5cb8-4110-b67d-e343d601f2e7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:12.153329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:12.175234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:12.195445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69090f-bdf5-46a8-8031-ec97275c3404 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:12.200493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c174b64-5cb8-4110-b67d-e343d601f2e7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:12.231285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8252154-488d-4ab8-b6e4-10aeb117f61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:12.232305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8252154-488d-4ab8-b6e4-10aeb117f61d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:12.232777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8252154-488d-4ab8-b6e4-10aeb117f61d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:12.233125 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8252154-488d-4ab8-b6e4-10aeb117f61d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:12.244047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8252154-488d-4ab8-b6e4-10aeb117f61d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:12.245262 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b4a59-584e-40b7-b200-79be525d17e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:12.246314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b4a59-584e-40b7-b200-79be525d17e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:12.246763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b4a59-584e-40b7-b200-79be525d17e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:12.247186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b4a59-584e-40b7-b200-79be525d17e4 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e/users/a9e6d753e36e45ddb6e7955354850ce9/roles/25b9d230b8374a58a3e9746a2893f6f2` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:12.249432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b4a59-584e-40b7-b200-79be525d17e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e, user_id=a9e6d753e36e45ddb6e7955354850ce9, role_id=25b9d230b8374a58a3e9746a2893f6f2)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:12.251020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b4a59-584e-40b7-b200-79be525d17e4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-b8252154-488d-4ab8-b6e4-10aeb117f61d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:12.252397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:12.253500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:12.254513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:12.254513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:12.254513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:12.254513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:12.254513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:12.254513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:12.254513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:12.254513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:12.254513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:12.254513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:12.254513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:12.254513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:12.256591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 149/287] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:12.257734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8252154-488d-4ab8-b6e4-10aeb117f61d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:12.325646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 139/288] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:12 2022] PUT /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e/users/a9e6d753e36e45ddb6e7955354850ce9/roles/25b9d230b8374a58a3e9746a2893f6f2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:12.326367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b4a59-584e-40b7-b200-79be525d17e4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:12.367599 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8252154-488d-4ab8-b6e4-10aeb117f61d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:12.425812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59e313-e1e7-4065-91dc-1b4cb1078d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:12.426482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59e313-e1e7-4065-91dc-1b4cb1078d60 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:12.426764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59e313-e1e7-4065-91dc-1b4cb1078d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:12.427038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59e313-e1e7-4065-91dc-1b4cb1078d60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:12.427880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59e313-e1e7-4065-91dc-1b4cb1078d60 None admin] RBAC: Adding query filter params (role.id=3b950540b0074582839238d2d27d159e, user.id=a16ad412e6dc4b8c95c470544bb3f805, scope.system=all) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:12.428197 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59e313-e1e7-4065-91dc-1b4cb1078d60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:12.429665 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59e313-e1e7-4065-91dc-1b4cb1078d60 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:12.441958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 150/289] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Jun 23 12:53:12 2022] GET /identity/v3/role_assignments?user.id=a16ad412e6dc4b8c95c470544bb3f805&scope.system=all&role.id=3b950540b0074582839238d2d27d159e => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:12.513076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b4a59-584e-40b7-b200-79be525d17e4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:12.537138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:12.553708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68cb2e-5247-45bf-930e-d39d404b34e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:12.554406 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68cb2e-5247-45bf-930e-d39d404b34e2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:12.554687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68cb2e-5247-45bf-930e-d39d404b34e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:12.554961 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68cb2e-5247-45bf-930e-d39d404b34e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:12.555716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68cb2e-5247-45bf-930e-d39d404b34e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:12.556022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68cb2e-5247-45bf-930e-d39d404b34e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:12.557518 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68cb2e-5247-45bf-930e-d39d404b34e2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:12.567663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 140/290] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:12.574751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59e313-e1e7-4065-91dc-1b4cb1078d60 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:12.589507 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:12.683316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59e313-e1e7-4065-91dc-1b4cb1078d60 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:12.717128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd715db1-69cd-4df3-b977-7c3cf9a72329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:12.718049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd715db1-69cd-4df3-b977-7c3cf9a72329 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:12.718378 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd715db1-69cd-4df3-b977-7c3cf9a72329 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:12.718659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd715db1-69cd-4df3-b977-7c3cf9a72329 None admin] PATH_INFO: `/v3/users/f7519141db254e3fb8dfd6b5aa805ed6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:12.719853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd715db1-69cd-4df3-b977-7c3cf9a72329 None admin] RBAC: Authorizing `identity:get_user(user_id=f7519141db254e3fb8dfd6b5aa805ed6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:12.721852 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd715db1-69cd-4df3-b977-7c3cf9a72329 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:12.723775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 151/291] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:12 2022] GET /identity/v3/users/f7519141db254e3fb8dfd6b5aa805ed6 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:12.729003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68cb2e-5247-45bf-930e-d39d404b34e2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:12.862969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68cb2e-5247-45bf-930e-d39d404b34e2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:12.914303 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb077df3-4ce6-492b-98b6-fd74effb1bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:12.915760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077df3-4ce6-492b-98b6-fd74effb1bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:12.916251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077df3-4ce6-492b-98b6-fd74effb1bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:12.916768 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077df3-4ce6-492b-98b6-fd74effb1bd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:12.976176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:12.994999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb077df3-4ce6-492b-98b6-fd74effb1bd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:12.996476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb077df3-4ce6-492b-98b6-fd74effb1bd5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:13.129725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 141/292] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 12:53:13.140457 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd715db1-69cd-4df3-b977-7c3cf9a72329 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:13.238637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:13.263386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd715db1-69cd-4df3-b977-7c3cf9a72329 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:13.310391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abdcd9-cd33-46be-afc1-1251d14296eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:13.311258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abdcd9-cd33-46be-afc1-1251d14296eb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:13.311540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abdcd9-cd33-46be-afc1-1251d14296eb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:13.311813 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abdcd9-cd33-46be-afc1-1251d14296eb None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:13.315366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abdcd9-cd33-46be-afc1-1251d14296eb None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:13.316900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abdcd9-cd33-46be-afc1-1251d14296eb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:13.318978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 152/293] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:13 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:13.324732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb077df3-4ce6-492b-98b6-fd74effb1bd5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:13.415611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:13.443744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb077df3-4ce6-492b-98b6-fd74effb1bd5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:13.490016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a879167-451a-46e2-84e4-cc47e840748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:13.490742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a879167-451a-46e2-84e4-cc47e840748b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:13.491034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a879167-451a-46e2-84e4-cc47e840748b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:13.491314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a879167-451a-46e2-84e4-cc47e840748b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:13.492156 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a879167-451a-46e2-84e4-cc47e840748b None admin] RBAC: Adding query filter params (role.id=3b950540b0074582839238d2d27d159e, scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e, user.id=f7519141db254e3fb8dfd6b5aa805ed6) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:13.492473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a879167-451a-46e2-84e4-cc47e840748b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:13.493956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a879167-451a-46e2-84e4-cc47e840748b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:13.505780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 142/294] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:13 2022] GET /identity/v3/role_assignments?user.id=f7519141db254e3fb8dfd6b5aa805ed6&scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e&role.id=3b950540b0074582839238d2d27d159e => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:13.912993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7612e1b-6425-441f-81de-e8aed02c453d None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:13.913391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7612e1b-6425-441f-81de-e8aed02c453d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:13.913566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7612e1b-6425-441f-81de-e8aed02c453d None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:13.915178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 153/295] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:13.920673 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7de81-6f62-4b9f-b45e-6894c3838823 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:13.921130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7de81-6f62-4b9f-b45e-6894c3838823 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:13.921227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7de81-6f62-4b9f-b45e-6894c3838823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:13.939359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d3e7de81-6f62-4b9f-b45e-6894c3838823 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:13.940598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d3e7de81-6f62-4b9f-b45e-6894c3838823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:14.015525 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 143/296] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:14.031766 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19338881-f1ec-41ad-8857-75c7f03ff7c2 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:14.032095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19338881-f1ec-41ad-8857-75c7f03ff7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:14.032317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19338881-f1ec-41ad-8857-75c7f03ff7c2 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:14.034616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 154/297] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:14.039060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7de81-6f62-4b9f-b45e-6894c3838823 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:14.039838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792c2bb-e2fb-401c-9c2e-40b0d90154bd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:14.040132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792c2bb-e2fb-401c-9c2e-40b0d90154bd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:14.040410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792c2bb-e2fb-401c-9c2e-40b0d90154bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:14.065942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8792c2bb-e2fb-401c-9c2e-40b0d90154bd None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:14.067257 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8792c2bb-e2fb-401c-9c2e-40b0d90154bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:14.133260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:14.161948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7de81-6f62-4b9f-b45e-6894c3838823 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:14.163558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 155/298] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:14.189549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792c2bb-e2fb-401c-9c2e-40b0d90154bd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:14.200105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a41e38-f61e-4b7b-89a5-fb449d383b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:14.201187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a41e38-f61e-4b7b-89a5-fb449d383b05 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:14.201801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a41e38-f61e-4b7b-89a5-fb449d383b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:14.202260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a41e38-f61e-4b7b-89a5-fb449d383b05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:14.203611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a41e38-f61e-4b7b-89a5-fb449d383b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:14.205317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a41e38-f61e-4b7b-89a5-fb449d383b05 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:14.211698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 144/299] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:14.213066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a41e38-f61e-4b7b-89a5-fb449d383b05 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:14.270943 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:14.293867 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792c2bb-e2fb-401c-9c2e-40b0d90154bd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:14.320090 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a41e38-f61e-4b7b-89a5-fb449d383b05 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:14.328315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a6db-a01b-43a4-944e-72b049ea0e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:14.329347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a6db-a01b-43a4-944e-72b049ea0e00 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:14.329771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a6db-a01b-43a4-944e-72b049ea0e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:14.330186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a6db-a01b-43a4-944e-72b049ea0e00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:14.341245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953a6db-a01b-43a4-944e-72b049ea0e00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d953a6db-a01b-43a4-944e-72b049ea0e00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:14.349260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:14.350140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:14.350912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:14.350912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:14.350912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:14.350912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:14.350912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:14.350912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:14.350912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:14.350912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:14.350912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:14.350912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:14.350912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:14.350912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:14.358658 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 156/300] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:14.359417 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a6db-a01b-43a4-944e-72b049ea0e00 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:14.362203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa72d6-2dbc-4b54-ba6d-3cce7f9a87d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:14.362895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa72d6-2dbc-4b54-ba6d-3cce7f9a87d7 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:14.363179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa72d6-2dbc-4b54-ba6d-3cce7f9a87d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:14.363598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa72d6-2dbc-4b54-ba6d-3cce7f9a87d7 None admin] PATH_INFO: `/v3/groups` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:14.364187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa72d6-2dbc-4b54-ba6d-3cce7f9a87d7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:14.365661 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa72d6-2dbc-4b54-ba6d-3cce7f9a87d7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:14.448574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 145/301] 10.222.0.33 () {60 vars in 1134 bytes} [Thu Jun 23 12:53:14 2022] POST /identity/v3/groups => generated 229 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:53:14.471988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a6db-a01b-43a4-944e-72b049ea0e00 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:14.510745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d811f4-e533-4124-b7e4-03e38ab8e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:14.511852 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d811f4-e533-4124-b7e4-03e38ab8e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:14.512334 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d811f4-e533-4124-b7e4-03e38ab8e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:14.512858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d811f4-e533-4124-b7e4-03e38ab8e3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:14.513999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d811f4-e533-4124-b7e4-03e38ab8e3e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:14.514557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d811f4-e533-4124-b7e4-03e38ab8e3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:14.516214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d811f4-e533-4124-b7e4-03e38ab8e3e0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:14.520284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:14.531240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 157/302] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:14.537434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa72d6-2dbc-4b54-ba6d-3cce7f9a87d7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:14.542196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:14.650050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa72d6-2dbc-4b54-ba6d-3cce7f9a87d7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:14.685129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786c5ee-ec3d-4f13-b391-01f453897ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:14.686453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786c5ee-ec3d-4f13-b391-01f453897ace None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:14.686915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786c5ee-ec3d-4f13-b391-01f453897ace None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:14.687394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786c5ee-ec3d-4f13-b391-01f453897ace None admin] PATH_INFO: `/v3/users/7454b066e9664966961c7c0120af9ca5` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:14.703627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786c5ee-ec3d-4f13-b391-01f453897ace None admin] RBAC: Authorizing `identity:get_user(user_id=7454b066e9664966961c7c0120af9ca5)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:14.705503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786c5ee-ec3d-4f13-b391-01f453897ace None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:14.707844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 146/303] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:14 2022] GET /identity/v3/users/7454b066e9664966961c7c0120af9ca5 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:14.713576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d811f4-e533-4124-b7e4-03e38ab8e3e0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:14.823437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d811f4-e533-4124-b7e4-03e38ab8e3e0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:14.845521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af9f8a-d798-49c3-9c3f-de77ff3615f8 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:14.846686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af9f8a-d798-49c3-9c3f-de77ff3615f8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:14.847404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af9f8a-d798-49c3-9c3f-de77ff3615f8 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:14.849790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 147/304] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:14.855249 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba10c2-7194-4fc2-8f91-3fe46328a118 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:14.855535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba10c2-7194-4fc2-8f91-3fe46328a118 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:14.855812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba10c2-7194-4fc2-8f91-3fe46328a118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:14.863901 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97975dc-7e2c-4012-afd6-824814cba0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:14.864897 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97975dc-7e2c-4012-afd6-824814cba0ff None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:14.865458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97975dc-7e2c-4012-afd6-824814cba0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:14.865935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97975dc-7e2c-4012-afd6-824814cba0ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:14.867018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97975dc-7e2c-4012-afd6-824814cba0ff None admin] RBAC: Adding query filter params (role.id=25b9d230b8374a58a3e9746a2893f6f2, user.id=7454b066e9664966961c7c0120af9ca5, scope.system=all) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:14.867533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97975dc-7e2c-4012-afd6-824814cba0ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:14.869240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97975dc-7e2c-4012-afd6-824814cba0ff None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:14.874188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-93ba10c2-7194-4fc2-8f91-3fe46328a118 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:14.875361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 158/305] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Jun 23 12:53:14 2022] GET /identity/v3/role_assignments?user.id=7454b066e9664966961c7c0120af9ca5&scope.system=all&role.id=25b9d230b8374a58a3e9746a2893f6f2 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:14.875594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-93ba10c2-7194-4fc2-8f91-3fe46328a118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:14.953151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:14.968331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 148/306] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:15.002880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97975dc-7e2c-4012-afd6-824814cba0ff None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:15.014245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbdb89-ff71-465f-a579-b8266ea1e46f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.014245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbdb89-ff71-465f-a579-b8266ea1e46f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.014495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbdb89-ff71-465f-a579-b8266ea1e46f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.016096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 149/307] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:15.022152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad35b3-6030-4fe9-ac18-63c621a8647c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.022484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad35b3-6030-4fe9-ac18-63c621a8647c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.022719 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad35b3-6030-4fe9-ac18-63c621a8647c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.041672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6fad35b3-6030-4fe9-ac18-63c621a8647c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:15.042878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6fad35b3-6030-4fe9-ac18-63c621a8647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:15.076212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:15.118814 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97975dc-7e2c-4012-afd6-824814cba0ff None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:15.129682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 150/308] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:15.158083 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36aff6-8c8a-46d8-9e2f-09eb0d5bc2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:15.159127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36aff6-8c8a-46d8-9e2f-09eb0d5bc2dc None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.159307 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36aff6-8c8a-46d8-9e2f-09eb0d5bc2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.159685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36aff6-8c8a-46d8-9e2f-09eb0d5bc2dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.167115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad35b3-6030-4fe9-ac18-63c621a8647c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:15.173905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36aff6-8c8a-46d8-9e2f-09eb0d5bc2dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-df36aff6-8c8a-46d8-9e2f-09eb0d5bc2dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:15.182819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:15.183711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:15.184503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:15.184503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:15.184503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:15.184503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:15.184503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:15.184503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:15.184503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:15.184503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:15.184503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:15.184503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:15.184503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:15.184503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:15.187193 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 159/309] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:15.193130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36aff6-8c8a-46d8-9e2f-09eb0d5bc2dc None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:15.281275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad35b3-6030-4fe9-ac18-63c621a8647c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:15.306573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:15.320831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0d8a8-9c31-4abc-9a24-39acf28291e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:15.336283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0d8a8-9c31-4abc-9a24-39acf28291e4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.336283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0d8a8-9c31-4abc-9a24-39acf28291e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.336283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0d8a8-9c31-4abc-9a24-39acf28291e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.336532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36aff6-8c8a-46d8-9e2f-09eb0d5bc2dc None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:15.336608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0d8a8-9c31-4abc-9a24-39acf28291e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-3eb0d8a8-9c31-4abc-9a24-39acf28291e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:15.345812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:15.347295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:15.348081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:15.348081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:15.348081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:15.348081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:15.348081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:15.348081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:15.348081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:15.348081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:15.348081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:15.348081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:15.348081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:15.348081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:15.348739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 151/310] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:15.353752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:15.358166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0d8a8-9c31-4abc-9a24-39acf28291e4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:15.367534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce1ad1-fb4d-4831-9cdd-0ab6c6f36ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:15.368246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce1ad1-fb4d-4831-9cdd-0ab6c6f36ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.368533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce1ad1-fb4d-4831-9cdd-0ab6c6f36ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.368862 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce1ad1-fb4d-4831-9cdd-0ab6c6f36ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.369625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce1ad1-fb4d-4831-9cdd-0ab6c6f36ff7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:15.369934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce1ad1-fb4d-4831-9cdd-0ab6c6f36ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:15.371314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce1ad1-fb4d-4831-9cdd-0ab6c6f36ff7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:15.391761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 160/311] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:15.397757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce1ad1-fb4d-4831-9cdd-0ab6c6f36ff7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:15.552391 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0d8a8-9c31-4abc-9a24-39acf28291e4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:15.584496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce1ad1-fb4d-4831-9cdd-0ab6c6f36ff7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:15.593832 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6061d7-1b60-451f-aa36-a542211dad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:15.594688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6061d7-1b60-451f-aa36-a542211dad72 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.594799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6061d7-1b60-451f-aa36-a542211dad72 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.595060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6061d7-1b60-451f-aa36-a542211dad72 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.596335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6061d7-1b60-451f-aa36-a542211dad72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:15.596650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6061d7-1b60-451f-aa36-a542211dad72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:15.598071 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6061d7-1b60-451f-aa36-a542211dad72 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:15.606734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 152/312] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:15.612101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6061d7-1b60-451f-aa36-a542211dad72 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:15.630049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77652f-2359-4b24-b81e-8fd296a500f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:15.631488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77652f-2359-4b24-b81e-8fd296a500f5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.632344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77652f-2359-4b24-b81e-8fd296a500f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.632849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77652f-2359-4b24-b81e-8fd296a500f5 None admin] PATH_INFO: `/v3/users/a9e6d753e36e45ddb6e7955354850ce9` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.634238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77652f-2359-4b24-b81e-8fd296a500f5 None admin] RBAC: Authorizing `identity:get_user(user_id=a9e6d753e36e45ddb6e7955354850ce9)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:15.636685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77652f-2359-4b24-b81e-8fd296a500f5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:15.639578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 161/313] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:15 2022] GET /identity/v3/users/a9e6d753e36e45ddb6e7955354850ce9 => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:15.644650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77652f-2359-4b24-b81e-8fd296a500f5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:15.668338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:15.718221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:15.739121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6061d7-1b60-451f-aa36-a542211dad72 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:15.781969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77652f-2359-4b24-b81e-8fd296a500f5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:15.783455 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a872bc-8644-47df-b811-0c9d6b3798cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:15.785018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a872bc-8644-47df-b811-0c9d6b3798cc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.785299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a872bc-8644-47df-b811-0c9d6b3798cc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.785717 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a872bc-8644-47df-b811-0c9d6b3798cc None admin] PATH_INFO: `/v3/users/a16ad412e6dc4b8c95c470544bb3f805` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.787771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a872bc-8644-47df-b811-0c9d6b3798cc None admin] RBAC: Authorizing `identity:get_user(user_id=a16ad412e6dc4b8c95c470544bb3f805)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:15.789243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a872bc-8644-47df-b811-0c9d6b3798cc None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:15.792692 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 153/314] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:15 2022] GET /identity/v3/users/a16ad412e6dc4b8c95c470544bb3f805 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:15.797193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a872bc-8644-47df-b811-0c9d6b3798cc None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:15.832247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeb748-2a8d-46bb-a448-dc7856efc690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:15.833892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeb748-2a8d-46bb-a448-dc7856efc690 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.834642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeb748-2a8d-46bb-a448-dc7856efc690 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.835122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeb748-2a8d-46bb-a448-dc7856efc690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.921268 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a872bc-8644-47df-b811-0c9d6b3798cc None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:15.925762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeb748-2a8d-46bb-a448-dc7856efc690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:15.927448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeb748-2a8d-46bb-a448-dc7856efc690 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:15.936347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:15.961851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e60ba-7cc4-4a03-811a-0453705673d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:15.963233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e60ba-7cc4-4a03-811a-0453705673d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.963521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e60ba-7cc4-4a03-811a-0453705673d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.963801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e60ba-7cc4-4a03-811a-0453705673d7 None admin] PATH_INFO: `/v3/system/users/a16ad412e6dc4b8c95c470544bb3f805/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.965902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e60ba-7cc4-4a03-811a-0453705673d7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a16ad412e6dc4b8c95c470544bb3f805, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:15.967849 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e60ba-7cc4-4a03-811a-0453705673d7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:15.990745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:16.037214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 162/315] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:16.042386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeb748-2a8d-46bb-a448-dc7856efc690 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:16.104840 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 154/316] 10.222.0.33 () {58 vars in 1334 bytes} [Thu Jun 23 12:53:15 2022] PUT /identity/v3/system/users/a16ad412e6dc4b8c95c470544bb3f805/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:16.160184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeb748-2a8d-46bb-a448-dc7856efc690 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:16.200114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d131-6596-4c4f-9ac0-9196b8bf51d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:16.201828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d131-6596-4c4f-9ac0-9196b8bf51d7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:16.202396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d131-6596-4c4f-9ac0-9196b8bf51d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:16.202872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d131-6596-4c4f-9ac0-9196b8bf51d7 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:16.204380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d131-6596-4c4f-9ac0-9196b8bf51d7 None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:16.206167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d131-6596-4c4f-9ac0-9196b8bf51d7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:16.208565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 163/317] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:16 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:16.214987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e60ba-7cc4-4a03-811a-0453705673d7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:16.325804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e60ba-7cc4-4a03-811a-0453705673d7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:16.360875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb040ab-8437-4058-ba89-973aaa59fd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:16.361921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb040ab-8437-4058-ba89-973aaa59fd40 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:16.362513 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb040ab-8437-4058-ba89-973aaa59fd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:16.363044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb040ab-8437-4058-ba89-973aaa59fd40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:16.364065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb040ab-8437-4058-ba89-973aaa59fd40 None admin] RBAC: Adding query filter params (role.id=25b9d230b8374a58a3e9746a2893f6f2, scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e, user.id=a9e6d753e36e45ddb6e7955354850ce9) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:16.364576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb040ab-8437-4058-ba89-973aaa59fd40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:16.366232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb040ab-8437-4058-ba89-973aaa59fd40 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:16.373028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 155/318] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:16 2022] GET /identity/v3/role_assignments?user.id=a9e6d753e36e45ddb6e7955354850ce9&scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e&role.id=25b9d230b8374a58a3e9746a2893f6f2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:16.626024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b7c39-21a9-419c-aa77-305ba9b62970 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:16.626357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b7c39-21a9-419c-aa77-305ba9b62970 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:16.626530 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b7c39-21a9-419c-aa77-305ba9b62970 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:16.628641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 164/319] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:16.633622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce1f76-e0e5-4277-b083-f4df31664407 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:16.633915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce1f76-e0e5-4277-b083-f4df31664407 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:16.634196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce1f76-e0e5-4277-b083-f4df31664407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:16.651067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-bbce1f76-e0e5-4277-b083-f4df31664407 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:16.652247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bbce1f76-e0e5-4277-b083-f4df31664407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:16.687228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:16.719330 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 156/320] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:16.741963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b7c39-21a9-419c-aa77-305ba9b62970 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:16.765661 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:16.890150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b7c39-21a9-419c-aa77-305ba9b62970 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:16.923116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2c30d-be82-46c4-a855-c4b33c43e566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:16.924508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2c30d-be82-46c4-a855-c4b33c43e566 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:16.924849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2c30d-be82-46c4-a855-c4b33c43e566 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:16.925127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2c30d-be82-46c4-a855-c4b33c43e566 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:16.926281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2c30d-be82-46c4-a855-c4b33c43e566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:16.927699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2c30d-be82-46c4-a855-c4b33c43e566 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:16.929512 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 165/321] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:16.934844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce1f76-e0e5-4277-b083-f4df31664407 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:17.035264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce1f76-e0e5-4277-b083-f4df31664407 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:17.071334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6699c39-0ccc-4db9-bcbc-ae26e6677445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:17.072002 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699c39-0ccc-4db9-bcbc-ae26e6677445 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:17.072284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699c39-0ccc-4db9-bcbc-ae26e6677445 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:17.072559 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699c39-0ccc-4db9-bcbc-ae26e6677445 None admin] PATH_INFO: `/v3/groups` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:17.073280 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6699c39-0ccc-4db9-bcbc-ae26e6677445 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:17.074747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6699c39-0ccc-4db9-bcbc-ae26e6677445 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:17.110993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735d879-5073-4921-b349-7a12a7ae353c None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:17.111278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735d879-5073-4921-b349-7a12a7ae353c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:17.112175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735d879-5073-4921-b349-7a12a7ae353c None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:17.113613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 166/322] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:53:17.118338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359c6eb-2808-4395-b34f-c0dba3c555a6 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:17.118622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359c6eb-2808-4395-b34f-c0dba3c555a6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:17.119119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359c6eb-2808-4395-b34f-c0dba3c555a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:17.135395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a359c6eb-2808-4395-b34f-c0dba3c555a6 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:17.136557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a359c6eb-2808-4395-b34f-c0dba3c555a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:17.169033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 157/323] 10.222.0.33 () {60 vars in 1134 bytes} [Thu Jun 23 12:53:16 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:53:17.218422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 167/324] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:17.241421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6699c39-0ccc-4db9-bcbc-ae26e6677445 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:17.276693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:17.351891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6699c39-0ccc-4db9-bcbc-ae26e6677445 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:17.386750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c62e8f-056b-4464-97ff-73293820ea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:17.387948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c62e8f-056b-4464-97ff-73293820ea67 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:17.388236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c62e8f-056b-4464-97ff-73293820ea67 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:17.388514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c62e8f-056b-4464-97ff-73293820ea67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:17.399397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c62e8f-056b-4464-97ff-73293820ea67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-04c62e8f-056b-4464-97ff-73293820ea67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:17.407178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:17.408047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:17.408878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 158/325] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:17.414581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359c6eb-2808-4395-b34f-c0dba3c555a6 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:17.436039 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:17.523971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359c6eb-2808-4395-b34f-c0dba3c555a6 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:17.558571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09274c-f909-4024-a8c2-07772bf1b782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:17.559251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09274c-f909-4024-a8c2-07772bf1b782 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:17.559540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09274c-f909-4024-a8c2-07772bf1b782 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:17.559821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09274c-f909-4024-a8c2-07772bf1b782 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:17.560573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09274c-f909-4024-a8c2-07772bf1b782 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:17.560908 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09274c-f909-4024-a8c2-07772bf1b782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:17.562283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09274c-f909-4024-a8c2-07772bf1b782 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:17.571534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 168/326] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:17.576948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c62e8f-056b-4464-97ff-73293820ea67 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:17.686472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:17.698747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c62e8f-056b-4464-97ff-73293820ea67 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:17.735327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acc8fb-823f-401c-99d6-2389bf0f7b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:17.736627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acc8fb-823f-401c-99d6-2389bf0f7b88 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:17.737134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acc8fb-823f-401c-99d6-2389bf0f7b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:17.737579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acc8fb-823f-401c-99d6-2389bf0f7b88 None admin] PATH_INFO: `/v3/users/7454b066e9664966961c7c0120af9ca5` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:17.738976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acc8fb-823f-401c-99d6-2389bf0f7b88 None admin] RBAC: Authorizing `identity:get_user(user_id=7454b066e9664966961c7c0120af9ca5)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:17.743751 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acc8fb-823f-401c-99d6-2389bf0f7b88 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:17.743751 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 159/327] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:17 2022] GET /identity/v3/users/7454b066e9664966961c7c0120af9ca5 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:17.748559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09274c-f909-4024-a8c2-07772bf1b782 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:17.836599 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:17.859100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09274c-f909-4024-a8c2-07772bf1b782 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:17.899167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f75a65-793e-4245-8229-dd83405c8c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:17.900045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f75a65-793e-4245-8229-dd83405c8c0f None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:17.900332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f75a65-793e-4245-8229-dd83405c8c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:17.900707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f75a65-793e-4245-8229-dd83405c8c0f None admin] PATH_INFO: `/v3/system/users/7454b066e9664966961c7c0120af9ca5/roles/25b9d230b8374a58a3e9746a2893f6f2` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:17.904275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f75a65-793e-4245-8229-dd83405c8c0f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7454b066e9664966961c7c0120af9ca5, role_id=25b9d230b8374a58a3e9746a2893f6f2)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:17.905676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f75a65-793e-4245-8229-dd83405c8c0f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:17.989247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 169/328] 10.222.0.33 () {58 vars in 1334 bytes} [Thu Jun 23 12:53:17 2022] PUT /identity/v3/system/users/7454b066e9664966961c7c0120af9ca5/roles/25b9d230b8374a58a3e9746a2893f6f2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:53:18.260048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5f30f-125a-425a-b3ef-5e51823c24cd None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:18.260529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5f30f-125a-425a-b3ef-5e51823c24cd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:18.260529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5f30f-125a-425a-b3ef-5e51823c24cd None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:18.262208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 160/329] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:18.267208 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb4b7f-d5bd-4ea2-96f0-2c464a6f26d3 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:18.268144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb4b7f-d5bd-4ea2-96f0-2c464a6f26d3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:18.268324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb4b7f-d5bd-4ea2-96f0-2c464a6f26d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:18.287836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a9fb4b7f-d5bd-4ea2-96f0-2c464a6f26d3 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:18.291437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a9fb4b7f-d5bd-4ea2-96f0-2c464a6f26d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:18.368613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 170/330] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:18.397596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5f30f-125a-425a-b3ef-5e51823c24cd None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:18.527863 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5f30f-125a-425a-b3ef-5e51823c24cd None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:18.564263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31305296-c5df-4671-bfc2-5489f5d9c758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:18.565670 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31305296-c5df-4671-bfc2-5489f5d9c758 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:18.565953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31305296-c5df-4671-bfc2-5489f5d9c758 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:18.566228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31305296-c5df-4671-bfc2-5489f5d9c758 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:18.581803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31305296-c5df-4671-bfc2-5489f5d9c758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-31305296-c5df-4671-bfc2-5489f5d9c758 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:18.589836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:18.590792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:18.591591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 161/331] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:18.597632 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb4b7f-d5bd-4ea2-96f0-2c464a6f26d3 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:18.710643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:18.735328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb4b7f-d5bd-4ea2-96f0-2c464a6f26d3 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:18.775644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde67159-1897-481c-b67d-619501781731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:18.776320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde67159-1897-481c-b67d-619501781731 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:18.776604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde67159-1897-481c-b67d-619501781731 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:18.776906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde67159-1897-481c-b67d-619501781731 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:18.777665 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde67159-1897-481c-b67d-619501781731 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:18.778025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde67159-1897-481c-b67d-619501781731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:18.779347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde67159-1897-481c-b67d-619501781731 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:18.792474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 171/332] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:18.797963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31305296-c5df-4671-bfc2-5489f5d9c758 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:18.836183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:18.941877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31305296-c5df-4671-bfc2-5489f5d9c758 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:18.991252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292359d-af83-428c-ac78-0654c4870131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:18.992137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292359d-af83-428c-ac78-0654c4870131 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:18.992424 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292359d-af83-428c-ac78-0654c4870131 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:18.992729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292359d-af83-428c-ac78-0654c4870131 None admin] PATH_INFO: `/v3/users/a16ad412e6dc4b8c95c470544bb3f805` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:18.997377 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292359d-af83-428c-ac78-0654c4870131 None admin] RBAC: Authorizing `identity:get_user(user_id=a16ad412e6dc4b8c95c470544bb3f805)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:18.998825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292359d-af83-428c-ac78-0654c4870131 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:19.000812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 162/333] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:18 2022] GET /identity/v3/users/a16ad412e6dc4b8c95c470544bb3f805 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:19.007131 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde67159-1897-481c-b67d-619501781731 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:19.128565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde67159-1897-481c-b67d-619501781731 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:19.171129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edbd50-af61-4376-921a-00fec9bfa8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:19.171790 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edbd50-af61-4376-921a-00fec9bfa8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:19.172075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edbd50-af61-4376-921a-00fec9bfa8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:19.172355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edbd50-af61-4376-921a-00fec9bfa8c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:19.173219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edbd50-af61-4376-921a-00fec9bfa8c8 None admin] RBAC: Adding query filter params (role.id=3b950540b0074582839238d2d27d159e, user.id=a16ad412e6dc4b8c95c470544bb3f805, scope.system=all) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:19.173533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edbd50-af61-4376-921a-00fec9bfa8c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:19.175580 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edbd50-af61-4376-921a-00fec9bfa8c8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:19.181874 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:19.193155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 172/334] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Jun 23 12:53:19 2022] GET /identity/v3/role_assignments?user.id=a16ad412e6dc4b8c95c470544bb3f805&scope.system=all&role.id=3b950540b0074582839238d2d27d159e => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:20.401950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b9c50-fc3b-4e24-aab9-7e6738efce03 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:20.402987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b9c50-fc3b-4e24-aab9-7e6738efce03 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:20.403476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b9c50-fc3b-4e24-aab9-7e6738efce03 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:20.405482 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 163/335] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:20.413916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad05b85-dcad-4c6d-92d7-11cffa7be7f5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:20.414795 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad05b85-dcad-4c6d-92d7-11cffa7be7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:20.415273 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad05b85-dcad-4c6d-92d7-11cffa7be7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:20.437656 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6ad05b85-dcad-4c6d-92d7-11cffa7be7f5 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:20.439190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6ad05b85-dcad-4c6d-92d7-11cffa7be7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:20.522641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 173/336] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:20.538405 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d49eff-27e9-4c74-b0f1-b14d95869ee7 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:20.538999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d49eff-27e9-4c74-b0f1-b14d95869ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:20.539510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d49eff-27e9-4c74-b0f1-b14d95869ee7 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:20.541126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 164/337] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:20.546541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb3c17-728e-4db8-99ef-fbc9e22fd379 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:20.547054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb3c17-728e-4db8-99ef-fbc9e22fd379 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:20.547530 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb3c17-728e-4db8-99ef-fbc9e22fd379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:20.560079 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d49eff-27e9-4c74-b0f1-b14d95869ee7 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:20.581679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5eeb3c17-728e-4db8-99ef-fbc9e22fd379 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:20.583213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5eeb3c17-728e-4db8-99ef-fbc9e22fd379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:20.727529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:20.736028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d49eff-27e9-4c74-b0f1-b14d95869ee7 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:20.782399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 174/338] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:20.798296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c97a-0507-4136-b429-dfe4cb3da1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:20.799489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c97a-0507-4136-b429-dfe4cb3da1af None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:20.799931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c97a-0507-4136-b429-dfe4cb3da1af None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:20.800359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c97a-0507-4136-b429-dfe4cb3da1af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:20.821179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3c97a-0507-4136-b429-dfe4cb3da1af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:20.830160 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb3c17-728e-4db8-99ef-fbc9e22fd379 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-6cf3c97a-0507-4136-b429-dfe4cb3da1af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:20.832804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:20.833686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:20.834478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:20.834478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:20.834478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:20.834478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:20.834478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:20.834478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:20.834478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:20.834478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:20.834478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:20.834478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:20.834478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:20.834478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:20.837152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 165/339] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:20.843350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c97a-0507-4136-b429-dfe4cb3da1af None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:20.963209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c97a-0507-4136-b429-dfe4cb3da1af None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:20.971745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:21.005556 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4f931-d9f0-474f-9294-825b8b585e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:21.006160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4f931-d9f0-474f-9294-825b8b585e55 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.006453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4f931-d9f0-474f-9294-825b8b585e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.006729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4f931-d9f0-474f-9294-825b8b585e55 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.007482 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4f931-d9f0-474f-9294-825b8b585e55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:21.007793 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4f931-d9f0-474f-9294-825b8b585e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:21.009206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4f931-d9f0-474f-9294-825b8b585e55 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:21.029558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 166/340] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:21.030906 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98217b-3a3f-4b45-ad4b-2332804e6fd7 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.031197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98217b-3a3f-4b45-ad4b-2332804e6fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.031478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98217b-3a3f-4b45-ad4b-2332804e6fd7 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.035485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 167/341] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:21.037594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98217b-3a3f-4b45-ad4b-2332804e6fd7 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:21.060750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:21.090685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb3c17-728e-4db8-99ef-fbc9e22fd379 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:21.164488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f50ab-d7a3-45bc-9340-d598912583bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:21.165566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f50ab-d7a3-45bc-9340-d598912583bf None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.165990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f50ab-d7a3-45bc-9340-d598912583bf None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.166434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f50ab-d7a3-45bc-9340-d598912583bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.183604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f50ab-d7a3-45bc-9340-d598912583bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-942f50ab-d7a3-45bc-9340-d598912583bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:21.192584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:21.193494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:21.194284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:21.194284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:21.194284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:21.194284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:21.194284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:21.194284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:21.194284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:21.194284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:21.194284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:21.194284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:21.194284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:21.194284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:21.199688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 175/342] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:53:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:21.202325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397f984-0ca9-4161-b5f7-aa56a7584217 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.202893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397f984-0ca9-4161-b5f7-aa56a7584217 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.203363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397f984-0ca9-4161-b5f7-aa56a7584217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.222515 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4397f984-0ca9-4161-b5f7-aa56a7584217 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:21.223909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4397f984-0ca9-4161-b5f7-aa56a7584217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:21.226463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98217b-3a3f-4b45-ad4b-2332804e6fd7 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:21.263486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03638b73-9501-4488-a29f-05a64e5546f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:21.264515 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03638b73-9501-4488-a29f-05a64e5546f4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.265141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03638b73-9501-4488-a29f-05a64e5546f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.265662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03638b73-9501-4488-a29f-05a64e5546f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.300119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 176/343] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:21.308690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24237-688b-48f8-b097-d661f7da0140 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.309302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24237-688b-48f8-b097-d661f7da0140 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.309759 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24237-688b-48f8-b097-d661f7da0140 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.311663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 177/344] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:21.312738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee24237-688b-48f8-b097-d661f7da0140 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:21.341275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03638b73-9501-4488-a29f-05a64e5546f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:21.344569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03638b73-9501-4488-a29f-05a64e5546f4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:21.354022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:21.384488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:21.448852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 168/345] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:21.449788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee24237-688b-48f8-b097-d661f7da0140 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:21.450316 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10624176-eee2-4aff-a772-ed14714ea769 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.450717 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10624176-eee2-4aff-a772-ed14714ea769 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.451061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10624176-eee2-4aff-a772-ed14714ea769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.469528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-10624176-eee2-4aff-a772-ed14714ea769 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:21.471387 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-10624176-eee2-4aff-a772-ed14714ea769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:21.489460 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff08700-1c3d-4324-81c7-56f8476e45e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:21.490354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff08700-1c3d-4324-81c7-56f8476e45e0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.490783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff08700-1c3d-4324-81c7-56f8476e45e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.491203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff08700-1c3d-4324-81c7-56f8476e45e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.492115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff08700-1c3d-4324-81c7-56f8476e45e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:21.492569 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff08700-1c3d-4324-81c7-56f8476e45e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:21.494099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff08700-1c3d-4324-81c7-56f8476e45e0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:21.504778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 178/346] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:21.505773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff08700-1c3d-4324-81c7-56f8476e45e0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:21.563888 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 169/347] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:21.565207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c754d-1619-4c98-879d-06b5459f1eae None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.565496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c754d-1619-4c98-879d-06b5459f1eae None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.565776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c754d-1619-4c98-879d-06b5459f1eae None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.568306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 170/348] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:21.568306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c754d-1619-4c98-879d-06b5459f1eae None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:21.634273 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff08700-1c3d-4324-81c7-56f8476e45e0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:21.639289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:21.644330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:21.673305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9f793-4a9f-45dc-b093-a1490f522d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:21.674174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9f793-4a9f-45dc-b093-a1490f522d97 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.674736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9f793-4a9f-45dc-b093-a1490f522d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.675022 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9f793-4a9f-45dc-b093-a1490f522d97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.688161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9f793-4a9f-45dc-b093-a1490f522d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-feb9f793-4a9f-45dc-b093-a1490f522d97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:21.696986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:21.698207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:21.699017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 179/349] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:21.699682 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9f793-4a9f-45dc-b093-a1490f522d97 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:21.717388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c754d-1619-4c98-879d-06b5459f1eae None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:21.757311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d65f8-50ff-4025-a728-2c774cccafdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:21.758176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d65f8-50ff-4025-a728-2c774cccafdb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.759091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d65f8-50ff-4025-a728-2c774cccafdb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.759091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d65f8-50ff-4025-a728-2c774cccafdb None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.760037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d65f8-50ff-4025-a728-2c774cccafdb None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:21.761531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d65f8-50ff-4025-a728-2c774cccafdb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:21.763254 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 171/350] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:21 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:21.764407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0012d3-8378-4844-9770-008d858fb8b8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.764751 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0012d3-8378-4844-9770-008d858fb8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.765001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0012d3-8378-4844-9770-008d858fb8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.788513 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4c0012d3-8378-4844-9770-008d858fb8b8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:21.790278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4c0012d3-8378-4844-9770-008d858fb8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:21.854482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9f793-4a9f-45dc-b093-a1490f522d97 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:21.899099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff798d-cdde-4669-a220-4940e0749197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:21.899761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff798d-cdde-4669-a220-4940e0749197 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.900047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff798d-cdde-4669-a220-4940e0749197 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.900325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff798d-cdde-4669-a220-4940e0749197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.908124 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 172/351] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:21.909104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0012d3-8378-4844-9770-008d858fb8b8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:21.952889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:21.959726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:21.987803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff798d-cdde-4669-a220-4940e0749197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:21.990137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff798d-cdde-4669-a220-4940e0749197 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:22.041656 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0012d3-8378-4844-9770-008d858fb8b8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:22.096498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591cde4-9660-49df-ac0c-905858fe2413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:22.097474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591cde4-9660-49df-ac0c-905858fe2413 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:22.097976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591cde4-9660-49df-ac0c-905858fe2413 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:22.098444 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591cde4-9660-49df-ac0c-905858fe2413 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:22.112788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591cde4-9660-49df-ac0c-905858fe2413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:22.116957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 180/352] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:22.118018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff798d-cdde-4669-a220-4940e0749197 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-a591cde4-9660-49df-ac0c-905858fe2413 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:22.126075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:22.127105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:22.127918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 173/353] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:53:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:22.128562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591cde4-9660-49df-ac0c-905858fe2413 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:22.199777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:22.240211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff798d-cdde-4669-a220-4940e0749197 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:22.253673 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:22.259382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591cde4-9660-49df-ac0c-905858fe2413 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:22.281788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9271c-0579-4453-b8c2-2eb1d144d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:22.282909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9271c-0579-4453-b8c2-2eb1d144d30c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:22.283243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9271c-0579-4453-b8c2-2eb1d144d30c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:22.283525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9271c-0579-4453-b8c2-2eb1d144d30c None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:22.284557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9271c-0579-4453-b8c2-2eb1d144d30c None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:22.284929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9271c-0579-4453-b8c2-2eb1d144d30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:22.286305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9271c-0579-4453-b8c2-2eb1d144d30c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:22.295575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 181/354] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:22.296574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9271c-0579-4453-b8c2-2eb1d144d30c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:22.300531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ce7c8-743b-4f67-b219-ad54e4e449f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:22.301484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ce7c8-743b-4f67-b219-ad54e4e449f5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:22.301923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ce7c8-743b-4f67-b219-ad54e4e449f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:22.302369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ce7c8-743b-4f67-b219-ad54e4e449f5 None admin] PATH_INFO: `/v3/groups/b7e7a231b1c24cae8dc850a671c14512` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:22.309292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ce7c8-743b-4f67-b219-ad54e4e449f5 None admin] RBAC: Authorizing `identity:get_group(group_id=b7e7a231b1c24cae8dc850a671c14512)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:22.312047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ce7c8-743b-4f67-b219-ad54e4e449f5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:22.312450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 174/355] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:22 2022] GET /identity/v3/groups/b7e7a231b1c24cae8dc850a671c14512 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:22.316013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ce7c8-743b-4f67-b219-ad54e4e449f5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:22.416314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9271c-0579-4453-b8c2-2eb1d144d30c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:22.425351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ce7c8-743b-4f67-b219-ad54e4e449f5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:22.447987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:22.457178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9b55a-cf99-4b76-82b1-c5e621a3ed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:22.464888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9b55a-cf99-4b76-82b1-c5e621a3ed53 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:22.464888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9b55a-cf99-4b76-82b1-c5e621a3ed53 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:22.464888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9b55a-cf99-4b76-82b1-c5e621a3ed53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:22.468744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5ad29-eb0c-417a-b968-feee9daea3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:22.470127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5ad29-eb0c-417a-b968-feee9daea3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:22.470408 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5ad29-eb0c-417a-b968-feee9daea3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:22.471223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5ad29-eb0c-417a-b968-feee9daea3a1 None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:22.471324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9b55a-cf99-4b76-82b1-c5e621a3ed53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:22.473473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5ad29-eb0c-417a-b968-feee9daea3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:22.474915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5ad29-eb0c-417a-b968-feee9daea3a1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:22.476875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 175/356] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:22 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:22.477424 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5ad29-eb0c-417a-b968-feee9daea3a1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a4d9b55a-cf99-4b76-82b1-c5e621a3ed53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:22.478910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:22.479975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:22.481108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 182/357] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:22.486857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd36eba-d1c3-4b18-b2bc-5d8fd84e2393 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:22.487156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd36eba-d1c3-4b18-b2bc-5d8fd84e2393 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:22.487443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd36eba-d1c3-4b18-b2bc-5d8fd84e2393 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:22.489688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 183/358] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:22.489688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd36eba-d1c3-4b18-b2bc-5d8fd84e2393 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:22.523690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:22.613472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5ad29-eb0c-417a-b968-feee9daea3a1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:22.614226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd36eba-d1c3-4b18-b2bc-5d8fd84e2393 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:22.653070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb92071-6bd8-4afe-a802-8ff4e6915f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:22.653782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb92071-6bd8-4afe-a802-8ff4e6915f37 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:22.654067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb92071-6bd8-4afe-a802-8ff4e6915f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:22.654340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb92071-6bd8-4afe-a802-8ff4e6915f37 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:22.655078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb92071-6bd8-4afe-a802-8ff4e6915f37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:22.655383 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb92071-6bd8-4afe-a802-8ff4e6915f37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:22.656813 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb92071-6bd8-4afe-a802-8ff4e6915f37 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:22.662415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f7e08-b4c3-4218-8a1f-41bc67eabb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:22.663519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f7e08-b4c3-4218-8a1f-41bc67eabb77 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:22.663974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f7e08-b4c3-4218-8a1f-41bc67eabb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:22.664243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f7e08-b4c3-4218-8a1f-41bc67eabb77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:22.665961 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 176/359] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:22.669351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb92071-6bd8-4afe-a802-8ff4e6915f37 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:22.731622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:22.748475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f7e08-b4c3-4218-8a1f-41bc67eabb77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:22.749792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f7e08-b4c3-4218-8a1f-41bc67eabb77 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:22.779663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:22.791807 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb92071-6bd8-4afe-a802-8ff4e6915f37 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:22.837620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35faac6-9752-4686-8356-4cdc951122dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:22.839835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35faac6-9752-4686-8356-4cdc951122dd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:22.839835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35faac6-9752-4686-8356-4cdc951122dd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:22.839835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35faac6-9752-4686-8356-4cdc951122dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:22.839835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35faac6-9752-4686-8356-4cdc951122dd None admin] RBAC: Adding query filter params (group.id=b7e7a231b1c24cae8dc850a671c14512, role.id=3b950540b0074582839238d2d27d159e, scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:22.840173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35faac6-9752-4686-8356-4cdc951122dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:22.841455 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35faac6-9752-4686-8356-4cdc951122dd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:22.847345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 177/360] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 23 12:53:22 2022] GET /identity/v3/role_assignments?group.id=b7e7a231b1c24cae8dc850a671c14512&scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e&role.id=3b950540b0074582839238d2d27d159e => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:22.849274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35faac6-9752-4686-8356-4cdc951122dd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:22.881540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 184/361] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:22.882745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f7e08-b4c3-4218-8a1f-41bc67eabb77 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:22.987492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35faac6-9752-4686-8356-4cdc951122dd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:23.005357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:23.020119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f7e08-b4c3-4218-8a1f-41bc67eabb77 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:23.037115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b3e3e-5f4a-4445-b6c2-cc6fc807d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:23.037115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b3e3e-5f4a-4445-b6c2-cc6fc807d725 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.037115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b3e3e-5f4a-4445-b6c2-cc6fc807d725 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.037115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b3e3e-5f4a-4445-b6c2-cc6fc807d725 None admin] PATH_INFO: `/v3/groups/b7e7a231b1c24cae8dc850a671c14512` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.038438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b3e3e-5f4a-4445-b6c2-cc6fc807d725 None admin] RBAC: Authorizing `identity:get_group(group_id=b7e7a231b1c24cae8dc850a671c14512)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:23.039908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b3e3e-5f4a-4445-b6c2-cc6fc807d725 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:23.041901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 178/362] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:22 2022] GET /identity/v3/groups/b7e7a231b1c24cae8dc850a671c14512 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:23.043098 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89279f-4a1e-4151-9ac7-24858e3c053e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.043390 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89279f-4a1e-4151-9ac7-24858e3c053e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.043672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89279f-4a1e-4151-9ac7-24858e3c053e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.062130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6b89279f-4a1e-4151-9ac7-24858e3c053e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:23.062952 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c456c-d415-4e9e-9db1-31aab8b4c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:23.063445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6b89279f-4a1e-4151-9ac7-24858e3c053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:23.063635 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c456c-d415-4e9e-9db1-31aab8b4c0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.063920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c456c-d415-4e9e-9db1-31aab8b4c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.064200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c456c-d415-4e9e-9db1-31aab8b4c0e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.065513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c456c-d415-4e9e-9db1-31aab8b4c0e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:23.067123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c456c-d415-4e9e-9db1-31aab8b4c0e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:23.067387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c456c-d415-4e9e-9db1-31aab8b4c0e7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:23.078286 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 185/363] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:23.079208 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c456c-d415-4e9e-9db1-31aab8b4c0e7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:23.087771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:23.148684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 179/364] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:23.148684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89279f-4a1e-4151-9ac7-24858e3c053e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:23.207526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c456c-d415-4e9e-9db1-31aab8b4c0e7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:23.242260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687156c-8b3e-4b4b-901d-d101365a6ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:23.242840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687156c-8b3e-4b4b-901d-d101365a6ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.243125 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687156c-8b3e-4b4b-901d-d101365a6ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.243410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687156c-8b3e-4b4b-901d-d101365a6ca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.247564 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89279f-4a1e-4151-9ac7-24858e3c053e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:23.262639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:23.285578 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae51820-5c98-4e9a-bd53-9b18c9c4802c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:23.286445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae51820-5c98-4e9a-bd53-9b18c9c4802c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.286730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae51820-5c98-4e9a-bd53-9b18c9c4802c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.287183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae51820-5c98-4e9a-bd53-9b18c9c4802c None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.288198 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae51820-5c98-4e9a-bd53-9b18c9c4802c None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:23.289662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae51820-5c98-4e9a-bd53-9b18c9c4802c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:23.295913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 180/365] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:23 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:23.295913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae51820-5c98-4e9a-bd53-9b18c9c4802c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:23.319596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:23.320422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687156c-8b3e-4b4b-901d-d101365a6ca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:23.322236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687156c-8b3e-4b4b-901d-d101365a6ca9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:23.401520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae51820-5c98-4e9a-bd53-9b18c9c4802c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:23.430387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 186/366] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:23.431496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687156c-8b3e-4b4b-901d-d101365a6ca9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:23.441254 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053f04f-dd3e-4d9b-b8fe-0acb1e0103dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:23.441911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053f04f-dd3e-4d9b-b8fe-0acb1e0103dc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.442197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053f04f-dd3e-4d9b-b8fe-0acb1e0103dc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.442467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053f04f-dd3e-4d9b-b8fe-0acb1e0103dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.443288 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053f04f-dd3e-4d9b-b8fe-0acb1e0103dc None admin] RBAC: Adding query filter params (group.id=b7e7a231b1c24cae8dc850a671c14512, role.id=aa5b9dc3549b47aaabedcc3d727351c0, scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:23.443598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053f04f-dd3e-4d9b-b8fe-0acb1e0103dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:23.445032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053f04f-dd3e-4d9b-b8fe-0acb1e0103dc None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:23.451044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 181/367] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 23 12:53:23 2022] GET /identity/v3/role_assignments?group.id=b7e7a231b1c24cae8dc850a671c14512&scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e&role.id=aa5b9dc3549b47aaabedcc3d727351c0 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:23.451803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053f04f-dd3e-4d9b-b8fe-0acb1e0103dc None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:23.505570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:23.551929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:23.572265 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053f04f-dd3e-4d9b-b8fe-0acb1e0103dc None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:23.581723 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687156c-8b3e-4b4b-901d-d101365a6ca9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:23.617023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6b155-39ec-4d63-afe9-d29221ef2811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:23.618013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6b155-39ec-4d63-afe9-d29221ef2811 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.618399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6b155-39ec-4d63-afe9-d29221ef2811 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.618686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6b155-39ec-4d63-afe9-d29221ef2811 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.630205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ac2be-c903-4e18-8652-1e999d80dc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:23.631363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ac2be-c903-4e18-8652-1e999d80dc3e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.631479 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6b155-39ec-4d63-afe9-d29221ef2811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:23.631650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ac2be-c903-4e18-8652-1e999d80dc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.631925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ac2be-c903-4e18-8652-1e999d80dc3e None admin] PATH_INFO: `/v3/users/7454b066e9664966961c7c0120af9ca5` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.633178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ac2be-c903-4e18-8652-1e999d80dc3e None admin] RBAC: Authorizing `identity:get_user(user_id=7454b066e9664966961c7c0120af9ca5)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:23.634696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ac2be-c903-4e18-8652-1e999d80dc3e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:23.636793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 187/368] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:23 2022] GET /identity/v3/users/7454b066e9664966961c7c0120af9ca5 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:23.637640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ac2be-c903-4e18-8652-1e999d80dc3e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-84f6b155-39ec-4d63-afe9-d29221ef2811 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:23.648594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:23.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:23.650420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 182/369] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:23.651108 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6b155-39ec-4d63-afe9-d29221ef2811 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:23.766732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6b155-39ec-4d63-afe9-d29221ef2811 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:23.771123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ac2be-c903-4e18-8652-1e999d80dc3e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:23.810497 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:23.810844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9c7d0-ddd1-45d5-9c97-2a9db5300413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:23.812148 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9c7d0-ddd1-45d5-9c97-2a9db5300413 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.812633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9c7d0-ddd1-45d5-9c97-2a9db5300413 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.813179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9c7d0-ddd1-45d5-9c97-2a9db5300413 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.813614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe5a35-7d2c-4c20-a598-17b108fcf64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:23.815123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe5a35-7d2c-4c20-a598-17b108fcf64e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.815407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe5a35-7d2c-4c20-a598-17b108fcf64e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.815683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe5a35-7d2c-4c20-a598-17b108fcf64e None admin] PATH_INFO: `/v3/groups/b7e7a231b1c24cae8dc850a671c14512` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.816046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9c7d0-ddd1-45d5-9c97-2a9db5300413 None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:23.816977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe5a35-7d2c-4c20-a598-17b108fcf64e None admin] RBAC: Authorizing `identity:get_group(group_id=b7e7a231b1c24cae8dc850a671c14512)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:23.823899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9c7d0-ddd1-45d5-9c97-2a9db5300413 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:23.824017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe5a35-7d2c-4c20-a598-17b108fcf64e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:23.824089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 183/370] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:23 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:23.824089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9c7d0-ddd1-45d5-9c97-2a9db5300413 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:23.824744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 188/371] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:23 2022] GET /identity/v3/groups/b7e7a231b1c24cae8dc850a671c14512 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:23.825598 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe5a35-7d2c-4c20-a598-17b108fcf64e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:23.842863 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:23.932139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9c7d0-ddd1-45d5-9c97-2a9db5300413 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:23.965003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe5a35-7d2c-4c20-a598-17b108fcf64e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:23.976418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc54ea-2378-4b01-8c44-a44363301780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:23.977159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc54ea-2378-4b01-8c44-a44363301780 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.977443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc54ea-2378-4b01-8c44-a44363301780 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.977728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc54ea-2378-4b01-8c44-a44363301780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.979222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc54ea-2378-4b01-8c44-a44363301780 None admin] RBAC: Adding query filter params (role.id=25b9d230b8374a58a3e9746a2893f6f2, user.id=7454b066e9664966961c7c0120af9ca5, scope.system=all) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:23.979545 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc54ea-2378-4b01-8c44-a44363301780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:23.981834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc54ea-2378-4b01-8c44-a44363301780 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.008690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 184/372] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Jun 23 12:53:23 2022] GET /identity/v3/role_assignments?user.id=7454b066e9664966961c7c0120af9ca5&scope.system=all&role.id=25b9d230b8374a58a3e9746a2893f6f2 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:24.008690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc54ea-2378-4b01-8c44-a44363301780 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:24.033650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebc31f-9053-4824-8ae5-4cbc2a003b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.034807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebc31f-9053-4824-8ae5-4cbc2a003b75 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.035306 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebc31f-9053-4824-8ae5-4cbc2a003b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.035783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebc31f-9053-4824-8ae5-4cbc2a003b75 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.036772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebc31f-9053-4824-8ae5-4cbc2a003b75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:24.037275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebc31f-9053-4824-8ae5-4cbc2a003b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:24.038860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebc31f-9053-4824-8ae5-4cbc2a003b75 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.071493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 189/373] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:24.072698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebc31f-9053-4824-8ae5-4cbc2a003b75 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:24.088498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:24.127753 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc54ea-2378-4b01-8c44-a44363301780 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:24.177995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2bb08-0e2a-43eb-98a2-7f9672316344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.181039 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2bb08-0e2a-43eb-98a2-7f9672316344 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.181593 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2bb08-0e2a-43eb-98a2-7f9672316344 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.184087 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2bb08-0e2a-43eb-98a2-7f9672316344 None admin] PATH_INFO: `/v3/groups/b7e7a231b1c24cae8dc850a671c14512` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.185732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2bb08-0e2a-43eb-98a2-7f9672316344 None admin] RBAC: Authorizing `identity:get_group(group_id=b7e7a231b1c24cae8dc850a671c14512)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:24.187425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2bb08-0e2a-43eb-98a2-7f9672316344 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.197473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 185/374] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:24 2022] GET /identity/v3/groups/b7e7a231b1c24cae8dc850a671c14512 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:24.198498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2bb08-0e2a-43eb-98a2-7f9672316344 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:24.201262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:24.260101 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebc31f-9053-4824-8ae5-4cbc2a003b75 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:24.295213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbdc8a-9ea1-42cb-8ace-bd603e33ba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.296232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbdc8a-9ea1-42cb-8ace-bd603e33ba7e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.296738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbdc8a-9ea1-42cb-8ace-bd603e33ba7e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.297222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbdc8a-9ea1-42cb-8ace-bd603e33ba7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.298243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbdc8a-9ea1-42cb-8ace-bd603e33ba7e None admin] RBAC: Adding query filter params (group.id=b7e7a231b1c24cae8dc850a671c14512, role.id=3b950540b0074582839238d2d27d159e, scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:24.299279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbdc8a-9ea1-42cb-8ace-bd603e33ba7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:24.300964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbdc8a-9ea1-42cb-8ace-bd603e33ba7e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.307232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 190/375] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 23 12:53:24 2022] GET /identity/v3/role_assignments?group.id=b7e7a231b1c24cae8dc850a671c14512&scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e&role.id=3b950540b0074582839238d2d27d159e => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:24.308240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbdc8a-9ea1-42cb-8ace-bd603e33ba7e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:24.330917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2bb08-0e2a-43eb-98a2-7f9672316344 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:24.368355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa5a74-efc8-47b4-9bdf-6f8ea2f30ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.369076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa5a74-efc8-47b4-9bdf-6f8ea2f30ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.369379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa5a74-efc8-47b4-9bdf-6f8ea2f30ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.369613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa5a74-efc8-47b4-9bdf-6f8ea2f30ff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.379881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:24.421151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbdc8a-9ea1-42cb-8ace-bd603e33ba7e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:24.436182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:24.445871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa5a74-efc8-47b4-9bdf-6f8ea2f30ff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:24.447363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa5a74-efc8-47b4-9bdf-6f8ea2f30ff0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.461092 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9dcee-e510-4a13-84f6-c93dae921b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.462130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9dcee-e510-4a13-84f6-c93dae921b28 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.462637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9dcee-e510-4a13-84f6-c93dae921b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.463118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9dcee-e510-4a13-84f6-c93dae921b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.464179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9dcee-e510-4a13-84f6-c93dae921b28 None admin] RBAC: Adding query filter params (group.id=b7e7a231b1c24cae8dc850a671c14512, role.id=aa5b9dc3549b47aaabedcc3d727351c0, scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:24.464721 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9dcee-e510-4a13-84f6-c93dae921b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:24.466358 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9dcee-e510-4a13-84f6-c93dae921b28 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.474005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 191/376] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 23 12:53:24 2022] GET /identity/v3/role_assignments?group.id=b7e7a231b1c24cae8dc850a671c14512&scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e&role.id=aa5b9dc3549b47aaabedcc3d727351c0 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:24.562721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 186/377] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:24.569064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9dcee-e510-4a13-84f6-c93dae921b28 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:24.710964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9dcee-e510-4a13-84f6-c93dae921b28 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:24.745964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001fb6a-ad36-4c38-9def-569185c9d4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.747232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001fb6a-ad36-4c38-9def-569185c9d4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.747725 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001fb6a-ad36-4c38-9def-569185c9d4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.748192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001fb6a-ad36-4c38-9def-569185c9d4b2 None admin] PATH_INFO: `/v3/projects/573a8643ae104193ab15bb005adb20d6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.749604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001fb6a-ad36-4c38-9def-569185c9d4b2 None admin] RBAC: Authorizing `identity:get_project(project_id=573a8643ae104193ab15bb005adb20d6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:24.751256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001fb6a-ad36-4c38-9def-569185c9d4b2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.754030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 192/378] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:24 2022] GET /identity/v3/projects/573a8643ae104193ab15bb005adb20d6 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:24.759362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa5a74-efc8-47b4-9bdf-6f8ea2f30ff0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:24.818633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:24.913127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa5a74-efc8-47b4-9bdf-6f8ea2f30ff0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:24.959096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4aac2-0712-40c5-9b35-1643614609d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.959971 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4aac2-0712-40c5-9b35-1643614609d6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.960259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4aac2-0712-40c5-9b35-1643614609d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.960540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4aac2-0712-40c5-9b35-1643614609d6 None admin] PATH_INFO: `/v3/groups/b64ef64725a644498798d1cd69d23d90` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.969691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4aac2-0712-40c5-9b35-1643614609d6 None admin] RBAC: Authorizing `identity:get_group(group_id=b64ef64725a644498798d1cd69d23d90)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:24.971198 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4aac2-0712-40c5-9b35-1643614609d6 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.973291 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 187/379] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:24 2022] GET /identity/v3/groups/b64ef64725a644498798d1cd69d23d90 => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:24.979117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001fb6a-ad36-4c38-9def-569185c9d4b2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:25.007782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b34d-f2e9-49e0-8082-e2891ba8bb60 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:25.007967 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b34d-f2e9-49e0-8082-e2891ba8bb60 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:25.008237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b34d-f2e9-49e0-8082-e2891ba8bb60 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:25.009950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 188/380] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:53:25.015356 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad17cb-53fb-45d0-93d3-5405a73b4051 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:25.015650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad17cb-53fb-45d0-93d3-5405a73b4051 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:25.015938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad17cb-53fb-45d0-93d3-5405a73b4051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:25.039566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-70ad17cb-53fb-45d0-93d3-5405a73b4051 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:25.041124 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-70ad17cb-53fb-45d0-93d3-5405a73b4051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:25.069474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:25.141707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 189/381] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:25.161886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001fb6a-ad36-4c38-9def-569185c9d4b2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:25.177854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad17cb-53fb-45d0-93d3-5405a73b4051 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:25.222163 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281eb98-bc97-4951-b872-8e3c89d92eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:25.222836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281eb98-bc97-4951-b872-8e3c89d92eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:25.223121 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281eb98-bc97-4951-b872-8e3c89d92eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:25.223541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281eb98-bc97-4951-b872-8e3c89d92eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:25.225119 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:25.225249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281eb98-bc97-4951-b872-8e3c89d92eb5 None admin] RBAC: Adding query filter params (group.id=b64ef64725a644498798d1cd69d23d90, role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=573a8643ae104193ab15bb005adb20d6) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:25.225523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281eb98-bc97-4951-b872-8e3c89d92eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:25.227085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281eb98-bc97-4951-b872-8e3c89d92eb5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:25.235865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 193/382] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 23 12:53:24 2022] GET /identity/v3/role_assignments?group.id=b64ef64725a644498798d1cd69d23d90&scope.project.id=573a8643ae104193ab15bb005adb20d6&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:25.333175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad17cb-53fb-45d0-93d3-5405a73b4051 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:25.377539 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097dcdd-0f37-43eb-a9d0-0ee5fc6e2731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:25.378346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097dcdd-0f37-43eb-a9d0-0ee5fc6e2731 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:25.378634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097dcdd-0f37-43eb-a9d0-0ee5fc6e2731 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:25.378910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097dcdd-0f37-43eb-a9d0-0ee5fc6e2731 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:25.393652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097dcdd-0f37-43eb-a9d0-0ee5fc6e2731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8097dcdd-0f37-43eb-a9d0-0ee5fc6e2731 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:25.401839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:25.402683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:25.403477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:25.403477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:25.403477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:25.403477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:25.403477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:25.403477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:25.403477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:25.403477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:25.403477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:25.403477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:25.403477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:25.403477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:25.404546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 190/383] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:25.410003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281eb98-bc97-4951-b872-8e3c89d92eb5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:25.546177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281eb98-bc97-4951-b872-8e3c89d92eb5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:25.556329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:25.587131 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791626bb-a433-4c40-8159-7c64bb2864f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:25.587849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791626bb-a433-4c40-8159-7c64bb2864f1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:25.588011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791626bb-a433-4c40-8159-7c64bb2864f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:25.588262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791626bb-a433-4c40-8159-7c64bb2864f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:25.589061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791626bb-a433-4c40-8159-7c64bb2864f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:25.589371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791626bb-a433-4c40-8159-7c64bb2864f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:25.590738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791626bb-a433-4c40-8159-7c64bb2864f1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:25.600315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 194/384] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:25.605702 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097dcdd-0f37-43eb-a9d0-0ee5fc6e2731 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:25.712464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:25.722012 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097dcdd-0f37-43eb-a9d0-0ee5fc6e2731 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:25.769004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647ca16-1231-4e86-8168-e125f0c1316e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:25.769874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647ca16-1231-4e86-8168-e125f0c1316e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:25.770201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647ca16-1231-4e86-8168-e125f0c1316e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:25.770486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647ca16-1231-4e86-8168-e125f0c1316e None admin] PATH_INFO: `/v3/groups/b7e7a231b1c24cae8dc850a671c14512` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:25.772041 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647ca16-1231-4e86-8168-e125f0c1316e None admin] RBAC: Authorizing `identity:get_group(group_id=b7e7a231b1c24cae8dc850a671c14512)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:25.773510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647ca16-1231-4e86-8168-e125f0c1316e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:25.775434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 191/385] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:25 2022] GET /identity/v3/groups/b7e7a231b1c24cae8dc850a671c14512 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:25.780882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791626bb-a433-4c40-8159-7c64bb2864f1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:25.919544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791626bb-a433-4c40-8159-7c64bb2864f1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:25.966336 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f033b01-b2bb-48f7-a241-45feb24e4453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:25.967214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f033b01-b2bb-48f7-a241-45feb24e4453 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:25.967492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f033b01-b2bb-48f7-a241-45feb24e4453 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:25.967767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f033b01-b2bb-48f7-a241-45feb24e4453 None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:25.971633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f033b01-b2bb-48f7-a241-45feb24e4453 None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:25.973139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f033b01-b2bb-48f7-a241-45feb24e4453 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:25.974879 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 195/386] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:25 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:25.985713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647ca16-1231-4e86-8168-e125f0c1316e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:26.067030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303064fb-6668-4684-8f09-aa7ede7ae88a None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:26.067585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303064fb-6668-4684-8f09-aa7ede7ae88a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:26.067870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303064fb-6668-4684-8f09-aa7ede7ae88a None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:26.069988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 196/387] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:53:26.078894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba933-a6a0-4843-b0d1-58435577314c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:26.079167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba933-a6a0-4843-b0d1-58435577314c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:26.079987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba933-a6a0-4843-b0d1-58435577314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:26.111009 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-383ba933-a6a0-4843-b0d1-58435577314c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:26.112242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-383ba933-a6a0-4843-b0d1-58435577314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:26.140547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647ca16-1231-4e86-8168-e125f0c1316e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:26.169034 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:26.176711 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77e241-8292-48d2-b6ec-df20b14bc5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:26.177943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77e241-8292-48d2-b6ec-df20b14bc5ef None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:26.178441 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77e241-8292-48d2-b6ec-df20b14bc5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:26.178931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77e241-8292-48d2-b6ec-df20b14bc5ef None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e/groups/b7e7a231b1c24cae8dc850a671c14512/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:26.181132 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77e241-8292-48d2-b6ec-df20b14bc5ef None admin] RBAC: Authorizing `identity:create_grant(project_id=8591f06cadbb400b9aa7b13fdd7f109e, group_id=b7e7a231b1c24cae8dc850a671c14512, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:26.182913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77e241-8292-48d2-b6ec-df20b14bc5ef None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:26.215315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 197/388] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:26.237915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ba933-a6a0-4843-b0d1-58435577314c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:26.299146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 192/389] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jun 23 12:53:25 2022] PUT /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e/groups/b7e7a231b1c24cae8dc850a671c14512/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:26.343565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ba933-a6a0-4843-b0d1-58435577314c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:26.381635 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f6411-c9e2-4bd1-97b8-1329b84e3016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:26.382458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f6411-c9e2-4bd1-97b8-1329b84e3016 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:26.382741 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f6411-c9e2-4bd1-97b8-1329b84e3016 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:26.383017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f6411-c9e2-4bd1-97b8-1329b84e3016 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:26.394547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f6411-c9e2-4bd1-97b8-1329b84e3016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-963f6411-c9e2-4bd1-97b8-1329b84e3016 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:26.403215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:26.404695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:26.405956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:26.405956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:26.405956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:26.405956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:26.405956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:26.405956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:26.405956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:26.405956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:26.405956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:26.405956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:26.405956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:26.405956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:26.408858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 198/390] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:53:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:26.414204 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77e241-8292-48d2-b6ec-df20b14bc5ef None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:26.461286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:26.568943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77e241-8292-48d2-b6ec-df20b14bc5ef None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:26.607760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671b91d-b38c-4860-9f20-5b784254fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:26.609284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671b91d-b38c-4860-9f20-5b784254fc46 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:26.609781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671b91d-b38c-4860-9f20-5b784254fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:26.610249 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671b91d-b38c-4860-9f20-5b784254fc46 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:26.611713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671b91d-b38c-4860-9f20-5b784254fc46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:26.612226 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671b91d-b38c-4860-9f20-5b784254fc46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:26.613821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671b91d-b38c-4860-9f20-5b784254fc46 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:26.622975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 193/391] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:26.628443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f6411-c9e2-4bd1-97b8-1329b84e3016 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:26.677066 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:26.773636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f6411-c9e2-4bd1-97b8-1329b84e3016 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:26.808987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b09b03-afd2-41ac-a593-e6f0eabaee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:26.810187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b09b03-afd2-41ac-a593-e6f0eabaee47 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:26.810664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b09b03-afd2-41ac-a593-e6f0eabaee47 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:26.811132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b09b03-afd2-41ac-a593-e6f0eabaee47 None admin] PATH_INFO: `/v3/groups/b7e7a231b1c24cae8dc850a671c14512` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:26.812484 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b09b03-afd2-41ac-a593-e6f0eabaee47 None admin] RBAC: Authorizing `identity:get_group(group_id=b7e7a231b1c24cae8dc850a671c14512)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:26.814770 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b09b03-afd2-41ac-a593-e6f0eabaee47 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:26.821035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 199/392] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:26 2022] GET /identity/v3/groups/b7e7a231b1c24cae8dc850a671c14512 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:26.822762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671b91d-b38c-4860-9f20-5b784254fc46 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:26.878204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f759b-8a9b-4a3c-aaa6-68989a49773b None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:26.878825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f759b-8a9b-4a3c-aaa6-68989a49773b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:26.879317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f759b-8a9b-4a3c-aaa6-68989a49773b None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:26.882272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 200/393] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:26.886511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16960f3f-5050-4bdd-976e-01f3c4773dea None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:26.887019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16960f3f-5050-4bdd-976e-01f3c4773dea None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:26.887508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16960f3f-5050-4bdd-976e-01f3c4773dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:26.905030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-16960f3f-5050-4bdd-976e-01f3c4773dea None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:26.906625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-16960f3f-5050-4bdd-976e-01f3c4773dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:26.976810 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 201/394] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:26.985034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:27.009049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671b91d-b38c-4860-9f20-5b784254fc46 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:27.028727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16960f3f-5050-4bdd-976e-01f3c4773dea None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:27.069811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:27.109366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2497a4-8035-4598-b144-a8c8c75e975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:27.110433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2497a4-8035-4598-b144-a8c8c75e975b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.110541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2497a4-8035-4598-b144-a8c8c75e975b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.110774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2497a4-8035-4598-b144-a8c8c75e975b None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.117380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2497a4-8035-4598-b144-a8c8c75e975b None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:27.118855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2497a4-8035-4598-b144-a8c8c75e975b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:27.124689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 194/395] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:26 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:27.133516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2497a4-8035-4598-b144-a8c8c75e975b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:27.140613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16960f3f-5050-4bdd-976e-01f3c4773dea None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:27.175868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c94291-a6fe-44fc-9001-5096e3dca194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:27.177025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c94291-a6fe-44fc-9001-5096e3dca194 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.177502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c94291-a6fe-44fc-9001-5096e3dca194 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.177984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c94291-a6fe-44fc-9001-5096e3dca194 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.189905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c94291-a6fe-44fc-9001-5096e3dca194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-34c94291-a6fe-44fc-9001-5096e3dca194 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:27.201331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:27.205128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:27.205945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:27.205945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:27.205945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:27.205945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:27.205945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:27.205945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:27.205945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:27.205945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:27.205945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:27.205945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:27.205945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:27.205945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:27.213219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 202/396] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:27.215617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c94291-a6fe-44fc-9001-5096e3dca194 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:27.317049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:27.321718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2497a4-8035-4598-b144-a8c8c75e975b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:27.389091 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c94291-a6fe-44fc-9001-5096e3dca194 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:27.389244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebd07a-a107-4aca-ab06-eeb164137435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:27.389244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebd07a-a107-4aca-ab06-eeb164137435 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.389244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebd07a-a107-4aca-ab06-eeb164137435 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.389244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebd07a-a107-4aca-ab06-eeb164137435 None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e/groups/b7e7a231b1c24cae8dc850a671c14512/roles/aa5b9dc3549b47aaabedcc3d727351c0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.389536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebd07a-a107-4aca-ab06-eeb164137435 None admin] RBAC: Authorizing `identity:create_grant(project_id=8591f06cadbb400b9aa7b13fdd7f109e, group_id=b7e7a231b1c24cae8dc850a671c14512, role_id=aa5b9dc3549b47aaabedcc3d727351c0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:27.389536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebd07a-a107-4aca-ab06-eeb164137435 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:27.389667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe933cf-ca1b-4101-8fbc-6b988c747baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:27.389667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe933cf-ca1b-4101-8fbc-6b988c747baa None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.389667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe933cf-ca1b-4101-8fbc-6b988c747baa None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.389667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe933cf-ca1b-4101-8fbc-6b988c747baa None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.389935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe933cf-ca1b-4101-8fbc-6b988c747baa None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:27.389935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe933cf-ca1b-4101-8fbc-6b988c747baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:27.389935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe933cf-ca1b-4101-8fbc-6b988c747baa None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:27.389935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 203/397] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:27.389935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ec612-8779-45a0-a8ad-023a705703d1 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.389935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ec612-8779-45a0-a8ad-023a705703d1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.390288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ec612-8779-45a0-a8ad-023a705703d1 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.390288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 204/398] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:27.394008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62c9d-094a-4a57-95dd-42ede4507d89 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.394300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62c9d-094a-4a57-95dd-42ede4507d89 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.394605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62c9d-094a-4a57-95dd-42ede4507d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.411383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-dca62c9d-094a-4a57-95dd-42ede4507d89 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:27.412540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dca62c9d-094a-4a57-95dd-42ede4507d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:27.453774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 195/399] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jun 23 12:53:27 2022] PUT /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e/groups/b7e7a231b1c24cae8dc850a671c14512/roles/aa5b9dc3549b47aaabedcc3d727351c0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:27.453991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebd07a-a107-4aca-ab06-eeb164137435 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:27.497073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:27.522528 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 205/400] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:27.585425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca62c9d-094a-4a57-95dd-42ede4507d89 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:27.648409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebd07a-a107-4aca-ab06-eeb164137435 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:27.691136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:27.721436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca62c9d-094a-4a57-95dd-42ede4507d89 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:27.725143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6841436-6a69-4bd8-92b3-6e1119af4e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:27.726022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6841436-6a69-4bd8-92b3-6e1119af4e7d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.726306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6841436-6a69-4bd8-92b3-6e1119af4e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.726582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6841436-6a69-4bd8-92b3-6e1119af4e7d None admin] PATH_INFO: `/v3/groups/b7e7a231b1c24cae8dc850a671c14512` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.728517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6841436-6a69-4bd8-92b3-6e1119af4e7d None admin] RBAC: Authorizing `identity:get_group(group_id=b7e7a231b1c24cae8dc850a671c14512)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:27.735011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6841436-6a69-4bd8-92b3-6e1119af4e7d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:27.737685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 196/401] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:27 2022] GET /identity/v3/groups/b7e7a231b1c24cae8dc850a671c14512 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:27.744410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6841436-6a69-4bd8-92b3-6e1119af4e7d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:27.810341 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b201e3e-b071-4157-8c99-32db53f7cf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:27.811272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b201e3e-b071-4157-8c99-32db53f7cf93 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.811470 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b201e3e-b071-4157-8c99-32db53f7cf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.811749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b201e3e-b071-4157-8c99-32db53f7cf93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.838983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:27.841638 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b201e3e-b071-4157-8c99-32db53f7cf93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-5b201e3e-b071-4157-8c99-32db53f7cf93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:27.858338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:27.859350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:27.860617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 206/402] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:53:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:27.866231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6841436-6a69-4bd8-92b3-6e1119af4e7d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:27.869580 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b201e3e-b071-4157-8c99-32db53f7cf93 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:27.921083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d7d84-655f-42a1-9e2b-4347f7e9d639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:27.921910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d7d84-655f-42a1-9e2b-4347f7e9d639 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.922202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d7d84-655f-42a1-9e2b-4347f7e9d639 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.922488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d7d84-655f-42a1-9e2b-4347f7e9d639 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.923726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d7d84-655f-42a1-9e2b-4347f7e9d639 None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:27.925203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d7d84-655f-42a1-9e2b-4347f7e9d639 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:27.926910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 197/403] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:27 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:27.928123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fbd78-fd08-4f82-ac2b-90fb9ea5cafc None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.928413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fbd78-fd08-4f82-ac2b-90fb9ea5cafc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.928709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fbd78-fd08-4f82-ac2b-90fb9ea5cafc None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.933572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 198/404] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:27.933572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fbd78-fd08-4f82-ac2b-90fb9ea5cafc None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:28.010269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b201e3e-b071-4157-8c99-32db53f7cf93 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:28.046438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926cee0-db39-4724-a5b9-ae90c6f57b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:28.047591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926cee0-db39-4724-a5b9-ae90c6f57b64 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:28.048114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926cee0-db39-4724-a5b9-ae90c6f57b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:28.048632 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926cee0-db39-4724-a5b9-ae90c6f57b64 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:28.049609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926cee0-db39-4724-a5b9-ae90c6f57b64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:28.050227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926cee0-db39-4724-a5b9-ae90c6f57b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:28.051800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926cee0-db39-4724-a5b9-ae90c6f57b64 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:28.057640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:28.063060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 207/405] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:28.064684 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca7cc9-a5fa-4618-ae51-8ef16eaec838 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:28.065168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca7cc9-a5fa-4618-ae51-8ef16eaec838 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:28.065668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca7cc9-a5fa-4618-ae51-8ef16eaec838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:28.069040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fbd78-fd08-4f82-ac2b-90fb9ea5cafc None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:28.091854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-23ca7cc9-a5fa-4618-ae51-8ef16eaec838 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:28.093683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-23ca7cc9-a5fa-4618-ae51-8ef16eaec838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:28.114843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb7238-7dcd-4f28-b35d-9346064cfbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:28.115777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb7238-7dcd-4f28-b35d-9346064cfbc6 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:28.116063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb7238-7dcd-4f28-b35d-9346064cfbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:28.116338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb7238-7dcd-4f28-b35d-9346064cfbc6 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e/groups/b7e7a231b1c24cae8dc850a671c14512/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:28.119103 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb7238-7dcd-4f28-b35d-9346064cfbc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e, group_id=b7e7a231b1c24cae8dc850a671c14512, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:28.120677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb7238-7dcd-4f28-b35d-9346064cfbc6 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:28.171187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 208/406] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:28.172454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca7cc9-a5fa-4618-ae51-8ef16eaec838 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:28.212253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 199/407] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jun 23 12:53:27 2022] PUT /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e/groups/b7e7a231b1c24cae8dc850a671c14512/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:28.213691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb7238-7dcd-4f28-b35d-9346064cfbc6 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:28.231776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:28.327723 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca7cc9-a5fa-4618-ae51-8ef16eaec838 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:28.365251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:28.367007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb487d3-615d-4e78-8be0-19235907221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:28.368099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb487d3-615d-4e78-8be0-19235907221f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:28.368718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb487d3-615d-4e78-8be0-19235907221f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:28.369232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb487d3-615d-4e78-8be0-19235907221f None admin] PATH_INFO: `/v3/groups/b7e7a231b1c24cae8dc850a671c14512` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:28.378314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb487d3-615d-4e78-8be0-19235907221f None admin] RBAC: Authorizing `identity:get_group(group_id=b7e7a231b1c24cae8dc850a671c14512)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:28.380350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb487d3-615d-4e78-8be0-19235907221f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:28.382297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 209/408] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:28 2022] GET /identity/v3/groups/b7e7a231b1c24cae8dc850a671c14512 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:28.397534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb487d3-615d-4e78-8be0-19235907221f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:28.402544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb7238-7dcd-4f28-b35d-9346064cfbc6 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:28.450082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078439b-0861-4c36-ae56-0448585a435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:28.450904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078439b-0861-4c36-ae56-0448585a435a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:28.451192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078439b-0861-4c36-ae56-0448585a435a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:28.451528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078439b-0861-4c36-ae56-0448585a435a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:28.479803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078439b-0861-4c36-ae56-0448585a435a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-7078439b-0861-4c36-ae56-0448585a435a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:28.488142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:28.489045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:28.489853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 200/409] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:28.495595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078439b-0861-4c36-ae56-0448585a435a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:28.522456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb487d3-615d-4e78-8be0-19235907221f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:28.566722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:28.569722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d4633-4290-49ed-b66c-1e175ea6a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:28.571034 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d4633-4290-49ed-b66c-1e175ea6a806 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:28.571549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d4633-4290-49ed-b66c-1e175ea6a806 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:28.572055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d4633-4290-49ed-b66c-1e175ea6a806 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:28.573555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d4633-4290-49ed-b66c-1e175ea6a806 None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:28.575737 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d4633-4290-49ed-b66c-1e175ea6a806 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:28.578436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 210/410] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:28 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:28.584756 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d4633-4290-49ed-b66c-1e175ea6a806 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:28.647259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078439b-0861-4c36-ae56-0448585a435a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:28.715611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7096185-ce27-4169-ab86-57e75b0706f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:28.716310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096185-ce27-4169-ab86-57e75b0706f6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:28.716633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096185-ce27-4169-ab86-57e75b0706f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:28.716944 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096185-ce27-4169-ab86-57e75b0706f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:28.717874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7096185-ce27-4169-ab86-57e75b0706f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:28.718241 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7096185-ce27-4169-ab86-57e75b0706f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:28.720722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7096185-ce27-4169-ab86-57e75b0706f6 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:28.724892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:28.731029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 201/411] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:28.737694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db7b0-7c20-4a20-b850-de573dd7c84a None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:28.737694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db7b0-7c20-4a20-b850-de573dd7c84a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:28.737694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db7b0-7c20-4a20-b850-de573dd7c84a None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:28.741845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 202/412] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:28.741845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1db7b0-7c20-4a20-b850-de573dd7c84a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:28.770924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d4633-4290-49ed-b66c-1e175ea6a806 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:28.822703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c288de0-5e70-4afb-b22e-85ccfdb937b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:28.823594 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c288de0-5e70-4afb-b22e-85ccfdb937b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:28.823936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c288de0-5e70-4afb-b22e-85ccfdb937b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:28.824365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c288de0-5e70-4afb-b22e-85ccfdb937b8 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e/groups/b7e7a231b1c24cae8dc850a671c14512/roles/aa5b9dc3549b47aaabedcc3d727351c0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:28.826886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c288de0-5e70-4afb-b22e-85ccfdb937b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e, group_id=b7e7a231b1c24cae8dc850a671c14512, role_id=aa5b9dc3549b47aaabedcc3d727351c0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:28.828599 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c288de0-5e70-4afb-b22e-85ccfdb937b8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:28.875264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1db7b0-7c20-4a20-b850-de573dd7c84a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:28.897550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 211/413] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jun 23 12:53:28 2022] PUT /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e/groups/b7e7a231b1c24cae8dc850a671c14512/roles/aa5b9dc3549b47aaabedcc3d727351c0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:28.899079 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe16ee-f8b1-4013-a76c-b1b0c0ef15a2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:28.899445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe16ee-f8b1-4013-a76c-b1b0c0ef15a2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:28.899847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe16ee-f8b1-4013-a76c-b1b0c0ef15a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:28.908925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:28.922258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ac237-7eab-4615-8c21-8101a78d3fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:28.924128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ac237-7eab-4615-8c21-8101a78d3fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:28.924556 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ac237-7eab-4615-8c21-8101a78d3fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:28.925154 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ac237-7eab-4615-8c21-8101a78d3fd5 None admin] PATH_INFO: `/v3/groups/b64ef64725a644498798d1cd69d23d90` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:28.935137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ac237-7eab-4615-8c21-8101a78d3fd5 None admin] RBAC: Authorizing `identity:get_group(group_id=b64ef64725a644498798d1cd69d23d90)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:28.935137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ac237-7eab-4615-8c21-8101a78d3fd5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:28.935137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 203/414] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:28 2022] GET /identity/v3/groups/b64ef64725a644498798d1cd69d23d90 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:28.935408 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-44fe16ee-f8b1-4013-a76c-b1b0c0ef15a2 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:28.935908 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-44fe16ee-f8b1-4013-a76c-b1b0c0ef15a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:28.936836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ac237-7eab-4615-8c21-8101a78d3fd5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:29.050093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ac237-7eab-4615-8c21-8101a78d3fd5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:29.069579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 212/415] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:29.095982 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4154b-384f-49b2-bffe-02ae4a4e64ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:29.097310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4154b-384f-49b2-bffe-02ae4a4e64ad None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:29.097848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4154b-384f-49b2-bffe-02ae4a4e64ad None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:29.098326 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4154b-384f-49b2-bffe-02ae4a4e64ad None admin] PATH_INFO: `/v3/projects/573a8643ae104193ab15bb005adb20d6` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:29.099851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4154b-384f-49b2-bffe-02ae4a4e64ad None admin] RBAC: Authorizing `identity:get_project(project_id=573a8643ae104193ab15bb005adb20d6)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:29.101591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4154b-384f-49b2-bffe-02ae4a4e64ad None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:29.103627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 204/416] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:28 2022] GET /identity/v3/projects/573a8643ae104193ab15bb005adb20d6 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:29.107898 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe16ee-f8b1-4013-a76c-b1b0c0ef15a2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:29.111018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4154b-384f-49b2-bffe-02ae4a4e64ad None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:29.178740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:29.235006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:29.239180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4154b-384f-49b2-bffe-02ae4a4e64ad None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:29.277223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e0eb8-4d12-421a-bbc3-bc01b1074d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:29.278176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e0eb8-4d12-421a-bbc3-bc01b1074d31 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:29.278524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e0eb8-4d12-421a-bbc3-bc01b1074d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:29.278799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e0eb8-4d12-421a-bbc3-bc01b1074d31 None admin] PATH_INFO: `/v3/projects/573a8643ae104193ab15bb005adb20d6/groups/b64ef64725a644498798d1cd69d23d90/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:29.280850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e0eb8-4d12-421a-bbc3-bc01b1074d31 None admin] RBAC: Authorizing `identity:create_grant(project_id=573a8643ae104193ab15bb005adb20d6, group_id=b64ef64725a644498798d1cd69d23d90, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:29.282301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e0eb8-4d12-421a-bbc3-bc01b1074d31 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:29.288969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe16ee-f8b1-4013-a76c-b1b0c0ef15a2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:29.325467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5eee-ea01-40f4-b81f-5f970e5436f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:29.326597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5eee-ea01-40f4-b81f-5f970e5436f2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:29.327042 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5eee-ea01-40f4-b81f-5f970e5436f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:29.327323 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5eee-ea01-40f4-b81f-5f970e5436f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:29.338390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc5eee-ea01-40f4-b81f-5f970e5436f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-0edc5eee-ea01-40f4-b81f-5f970e5436f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:29.346278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:29.347205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:29.348064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 213/417] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:29.353421 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5eee-ea01-40f4-b81f-5f970e5436f2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:29.369253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 205/418] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jun 23 12:53:29 2022] PUT /identity/v3/projects/573a8643ae104193ab15bb005adb20d6/groups/b64ef64725a644498798d1cd69d23d90/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:29.476691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5eee-ea01-40f4-b81f-5f970e5436f2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:29.495683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:29.515445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6226590-4650-4804-9ced-946e781f9166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:29.516132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6226590-4650-4804-9ced-946e781f9166 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:29.516464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6226590-4650-4804-9ced-946e781f9166 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:29.516778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6226590-4650-4804-9ced-946e781f9166 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:29.518172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6226590-4650-4804-9ced-946e781f9166 None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:29.518489 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6226590-4650-4804-9ced-946e781f9166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:29.519909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6226590-4650-4804-9ced-946e781f9166 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:29.531091 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 214/419] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:29.536851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e0eb8-4d12-421a-bbc3-bc01b1074d31 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:29.665109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e0eb8-4d12-421a-bbc3-bc01b1074d31 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:29.689787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:29.701021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4eea4-5142-44e0-ae33-b07d2d1dbeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:29.704758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4eea4-5142-44e0-ae33-b07d2d1dbeab None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:29.704758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4eea4-5142-44e0-ae33-b07d2d1dbeab None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:29.704758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4eea4-5142-44e0-ae33-b07d2d1dbeab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:29.780440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4eea4-5142-44e0-ae33-b07d2d1dbeab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:29.781918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4eea4-5142-44e0-ae33-b07d2d1dbeab None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:29.818126 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354bfb4-ffed-464e-ab4b-e13001d16839 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:29.818653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354bfb4-ffed-464e-ab4b-e13001d16839 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:29.818653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354bfb4-ffed-464e-ab4b-e13001d16839 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:29.820026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 215/420] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:53:29.827876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392edc-f48a-4151-87d7-c1d8b72aba92 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:29.828180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392edc-f48a-4151-87d7-c1d8b72aba92 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:29.828434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392edc-f48a-4151-87d7-c1d8b72aba92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:29.861679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-83392edc-f48a-4151-87d7-c1d8b72aba92 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:29.863060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-83392edc-f48a-4151-87d7-c1d8b72aba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:29.902238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 206/421] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:29.908463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4eea4-5142-44e0-ae33-b07d2d1dbeab None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:29.941575 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:30.015219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 216/422] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:30.040551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392edc-f48a-4151-87d7-c1d8b72aba92 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:30.060684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4eea4-5142-44e0-ae33-b07d2d1dbeab None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:30.124041 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890c152-f397-40a2-bd43-eb5947c5af6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:30.125477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c152-f397-40a2-bd43-eb5947c5af6e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.126060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c152-f397-40a2-bd43-eb5947c5af6e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.126580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c152-f397-40a2-bd43-eb5947c5af6e None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.127985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890c152-f397-40a2-bd43-eb5947c5af6e None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:30.129678 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890c152-f397-40a2-bd43-eb5947c5af6e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:30.137052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 207/423] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:29 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:30.140544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890c152-f397-40a2-bd43-eb5947c5af6e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:30.209071 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392edc-f48a-4151-87d7-c1d8b72aba92 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:30.225017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:30.276965 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:30.277868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e705-f4a2-4961-be28-57f8a030f835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:30.278690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e705-f4a2-4961-be28-57f8a030f835 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.278976 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e705-f4a2-4961-be28-57f8a030f835 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.279254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e705-f4a2-4961-be28-57f8a030f835 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.286467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890c152-f397-40a2-bd43-eb5947c5af6e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:30.307700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e705-f4a2-4961-be28-57f8a030f835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:30.322319 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32e7df-e018-40e0-a23b-0ed47b3d983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-b1c7e705-f4a2-4961-be28-57f8a030f835 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:30.323013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:30.323922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:30.324748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:30.324748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:30.324748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:30.324748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:30.324748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:30.324748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:30.324748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:30.324748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:30.324748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:30.324748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:30.324748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:30.324748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:30.325364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32e7df-e018-40e0-a23b-0ed47b3d983f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.325364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32e7df-e018-40e0-a23b-0ed47b3d983f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.325364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32e7df-e018-40e0-a23b-0ed47b3d983f None admin] PATH_INFO: `/v3/groups/b7e7a231b1c24cae8dc850a671c14512` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.325552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 217/424] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:30.329467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32e7df-e018-40e0-a23b-0ed47b3d983f None admin] RBAC: Authorizing `identity:get_group(group_id=b7e7a231b1c24cae8dc850a671c14512)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:30.331552 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32e7df-e018-40e0-a23b-0ed47b3d983f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:30.333694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 208/425] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/groups/b7e7a231b1c24cae8dc850a671c14512 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:30.334545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e705-f4a2-4961-be28-57f8a030f835 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:30.339333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32e7df-e018-40e0-a23b-0ed47b3d983f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:30.448887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32e7df-e018-40e0-a23b-0ed47b3d983f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:30.484580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc155c9-7ccd-4b3b-9679-36f07577a11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:30.485298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc155c9-7ccd-4b3b-9679-36f07577a11e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.485587 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc155c9-7ccd-4b3b-9679-36f07577a11e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.485942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc155c9-7ccd-4b3b-9679-36f07577a11e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.486834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc155c9-7ccd-4b3b-9679-36f07577a11e None admin] RBAC: Adding query filter params (group.id=b7e7a231b1c24cae8dc850a671c14512, role.id=3b950540b0074582839238d2d27d159e, scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:30.487156 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc155c9-7ccd-4b3b-9679-36f07577a11e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:30.488602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc155c9-7ccd-4b3b-9679-36f07577a11e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:30.495258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 209/426] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/role_assignments?group.id=b7e7a231b1c24cae8dc850a671c14512&scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e&role.id=3b950540b0074582839238d2d27d159e => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:30.532881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e705-f4a2-4961-be28-57f8a030f835 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:30.589758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89474e1-4605-4d51-b97d-faa580e46575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:30.590395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89474e1-4605-4d51-b97d-faa580e46575 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.590684 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89474e1-4605-4d51-b97d-faa580e46575 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.590966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89474e1-4605-4d51-b97d-faa580e46575 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.591729 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89474e1-4605-4d51-b97d-faa580e46575 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:30.592040 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89474e1-4605-4d51-b97d-faa580e46575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:30.593522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89474e1-4605-4d51-b97d-faa580e46575 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:30.607368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 218/427] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:30.612916 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc155c9-7ccd-4b3b-9679-36f07577a11e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:30.641044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:30.723614 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc155c9-7ccd-4b3b-9679-36f07577a11e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:30.737386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c9db-930b-48c5-9a9c-63736eb51712 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.737686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c9db-930b-48c5-9a9c-63736eb51712 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.738009 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c9db-930b-48c5-9a9c-63736eb51712 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.740212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 219/428] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:30.745833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee789e1-6bd4-4a03-8aab-cbcb9745aa6c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.746434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee789e1-6bd4-4a03-8aab-cbcb9745aa6c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.746723 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee789e1-6bd4-4a03-8aab-cbcb9745aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.766891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12c84-9ff1-45d9-94ea-c8fc4a64849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:30.768123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12c84-9ff1-45d9-94ea-c8fc4a64849c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.768497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12c84-9ff1-45d9-94ea-c8fc4a64849c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.768718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12c84-9ff1-45d9-94ea-c8fc4a64849c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.769482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9ee789e1-6bd4-4a03-8aab-cbcb9745aa6c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:30.770921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9ee789e1-6bd4-4a03-8aab-cbcb9745aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:30.805034 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:30.860725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12c84-9ff1-45d9-94ea-c8fc4a64849c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:30.862950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12c84-9ff1-45d9-94ea-c8fc4a64849c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:30.866752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 220/429] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:30.888961 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:30.897614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee789e1-6bd4-4a03-8aab-cbcb9745aa6c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:30.985126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 210/430] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:30.990758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12c84-9ff1-45d9-94ea-c8fc4a64849c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:31.025522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee789e1-6bd4-4a03-8aab-cbcb9745aa6c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:31.067368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5b78b-b0ff-4a28-9b6b-e8e80ceb5b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:31.068406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5b78b-b0ff-4a28-9b6b-e8e80ceb5b5b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:31.068960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5b78b-b0ff-4a28-9b6b-e8e80ceb5b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:31.069382 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5b78b-b0ff-4a28-9b6b-e8e80ceb5b5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:31.088798 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5b78b-b0ff-4a28-9b6b-e8e80ceb5b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-79d5b78b-b0ff-4a28-9b6b-e8e80ceb5b5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:31.097289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:31.098406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:31.099397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:31.099397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:31.099397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:31.099397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:31.099397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:31.099397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:31.099397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:31.099397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:31.099397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:31.099397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:31.099397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:53:31.099397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:31.103464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 221/431] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:31.109401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5b78b-b0ff-4a28-9b6b-e8e80ceb5b5b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:31.135268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:31.136896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12c84-9ff1-45d9-94ea-c8fc4a64849c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:31.162851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:31.176050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad83cc-b4b6-430f-9d4d-38b5db62137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:31.177365 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad83cc-b4b6-430f-9d4d-38b5db62137b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:31.177835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad83cc-b4b6-430f-9d4d-38b5db62137b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:31.186159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad83cc-b4b6-430f-9d4d-38b5db62137b None admin] PATH_INFO: `/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:31.186159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad83cc-b4b6-430f-9d4d-38b5db62137b None admin] RBAC: Authorizing `identity:get_project(project_id=8591f06cadbb400b9aa7b13fdd7f109e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:31.186159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad83cc-b4b6-430f-9d4d-38b5db62137b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:31.186159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 211/432] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/projects/8591f06cadbb400b9aa7b13fdd7f109e => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:31.189787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad83cc-b4b6-430f-9d4d-38b5db62137b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:31.223040 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5b78b-b0ff-4a28-9b6b-e8e80ceb5b5b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:31.269780 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6365-a341-49cd-a066-b5a1f94221cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:31.270872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6365-a341-49cd-a066-b5a1f94221cb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:31.271362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6365-a341-49cd-a066-b5a1f94221cb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:31.272216 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6365-a341-49cd-a066-b5a1f94221cb None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:31.274525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f6365-a341-49cd-a066-b5a1f94221cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:31.275039 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f6365-a341-49cd-a066-b5a1f94221cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:31.276652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f6365-a341-49cd-a066-b5a1f94221cb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:31.286192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 222/433] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:53:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:31.292799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6365-a341-49cd-a066-b5a1f94221cb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:31.316355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad83cc-b4b6-430f-9d4d-38b5db62137b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:31.357256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1af905-9887-4f5c-93db-61a632ae7693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:31.358404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1af905-9887-4f5c-93db-61a632ae7693 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:31.358689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1af905-9887-4f5c-93db-61a632ae7693 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:31.358965 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1af905-9887-4f5c-93db-61a632ae7693 None admin] PATH_INFO: `/v3/groups/b7e7a231b1c24cae8dc850a671c14512` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:31.362608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1af905-9887-4f5c-93db-61a632ae7693 None admin] RBAC: Authorizing `identity:get_group(group_id=b7e7a231b1c24cae8dc850a671c14512)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:31.363323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1af905-9887-4f5c-93db-61a632ae7693 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:31.366040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 212/434] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:31 2022] GET /identity/v3/groups/b7e7a231b1c24cae8dc850a671c14512 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:31.372133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1af905-9887-4f5c-93db-61a632ae7693 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:31.410462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:31.429730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6365-a341-49cd-a066-b5a1f94221cb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:31.445244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:31.468113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0243b-7b4a-433f-afa8-53370653a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:31.468804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0243b-7b4a-433f-afa8-53370653a0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:31.469070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0243b-7b4a-433f-afa8-53370653a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:31.469357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0243b-7b4a-433f-afa8-53370653a0e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:31.491573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1af905-9887-4f5c-93db-61a632ae7693 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:31.527053 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316126e-24a0-4e03-918a-0256ddc2595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:31.527806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316126e-24a0-4e03-918a-0256ddc2595c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:31.528158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316126e-24a0-4e03-918a-0256ddc2595c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:31.528504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316126e-24a0-4e03-918a-0256ddc2595c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:31.529421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316126e-24a0-4e03-918a-0256ddc2595c None admin] RBAC: Adding query filter params (group.id=b7e7a231b1c24cae8dc850a671c14512, role.id=aa5b9dc3549b47aaabedcc3d727351c0, scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:31.529799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316126e-24a0-4e03-918a-0256ddc2595c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:31.531293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316126e-24a0-4e03-918a-0256ddc2595c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:31.543978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 213/435] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 23 12:53:31 2022] GET /identity/v3/role_assignments?group.id=b7e7a231b1c24cae8dc850a671c14512&scope.project.id=8591f06cadbb400b9aa7b13fdd7f109e&role.id=aa5b9dc3549b47aaabedcc3d727351c0 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:31.543978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc76bf7-ef31-4089-aa26-65114a95e8b2 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:31.543978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc76bf7-ef31-4089-aa26-65114a95e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:31.543978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc76bf7-ef31-4089-aa26-65114a95e8b2 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:31.543978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 214/436] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:31.546265 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa19b0-f037-4e3a-bbee-a6aa7e694a33 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:31.546620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa19b0-f037-4e3a-bbee-a6aa7e694a33 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:31.546981 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa19b0-f037-4e3a-bbee-a6aa7e694a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:31.549755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0243b-7b4a-433f-afa8-53370653a0e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:31.551631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0243b-7b4a-433f-afa8-53370653a0e6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:31.567622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-2bfa19b0-f037-4e3a-bbee-a6aa7e694a33 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:31.568966 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2bfa19b0-f037-4e3a-bbee-a6aa7e694a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:31.657973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:31.674030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 215/437] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:31.681695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 223/438] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:31.688776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa19b0-f037-4e3a-bbee-a6aa7e694a33 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:31.697829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0243b-7b4a-433f-afa8-53370653a0e6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:31.752329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:31.817624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa19b0-f037-4e3a-bbee-a6aa7e694a33 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:31.830502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0243b-7b4a-433f-afa8-53370653a0e6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:31.871927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df34b26-9ad3-4e37-870d-20983c5016dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:31.872872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df34b26-9ad3-4e37-870d-20983c5016dd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:31.873162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df34b26-9ad3-4e37-870d-20983c5016dd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:31.873419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df34b26-9ad3-4e37-870d-20983c5016dd None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:31.875165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df34b26-9ad3-4e37-870d-20983c5016dd None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:31.875936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150cb35-33d4-4dcc-ac87-4b36fc28cf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:31.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df34b26-9ad3-4e37-870d-20983c5016dd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:31.877318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150cb35-33d4-4dcc-ac87-4b36fc28cf7e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:31.877601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150cb35-33d4-4dcc-ac87-4b36fc28cf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:31.877874 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150cb35-33d4-4dcc-ac87-4b36fc28cf7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:31.878719 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 216/439] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:31 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:31.883778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df34b26-9ad3-4e37-870d-20983c5016dd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:31.897934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150cb35-33d4-4dcc-ac87-4b36fc28cf7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-4150cb35-33d4-4dcc-ac87-4b36fc28cf7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:31.906347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:31.907248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:31.908077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 224/440] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:53:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:31.908840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a880351-1026-42b6-9b59-044502817ab8 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:31.909128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a880351-1026-42b6-9b59-044502817ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:31.909409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a880351-1026-42b6-9b59-044502817ab8 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:31.910783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 225/441] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:31.915145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a880351-1026-42b6-9b59-044502817ab8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:31.966689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:32.002463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df34b26-9ad3-4e37-870d-20983c5016dd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:32.025314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:32.029524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a880351-1026-42b6-9b59-044502817ab8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:32.036209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22162009-5690-4700-a438-2d28364e9a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:32.039851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22162009-5690-4700-a438-2d28364e9a01 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:32.039851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22162009-5690-4700-a438-2d28364e9a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:32.039851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22162009-5690-4700-a438-2d28364e9a01 None admin] PATH_INFO: `/v3/groups/b7e7a231b1c24cae8dc850a671c14512` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:32.039851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22162009-5690-4700-a438-2d28364e9a01 None admin] RBAC: Authorizing `identity:get_group(group_id=b7e7a231b1c24cae8dc850a671c14512)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:32.040331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22162009-5690-4700-a438-2d28364e9a01 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:32.042203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 217/442] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:31 2022] GET /identity/v3/groups/b7e7a231b1c24cae8dc850a671c14512 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:32.043113 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bdc96-8540-425b-a4dc-78fb42db7ff9 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:32.043401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bdc96-8540-425b-a4dc-78fb42db7ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:32.043681 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bdc96-8540-425b-a4dc-78fb42db7ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:32.059770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-633bdc96-8540-425b-a4dc-78fb42db7ff9 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:32.060990 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-633bdc96-8540-425b-a4dc-78fb42db7ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:32.066637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14f9b3-be77-4251-831f-76fb2382e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:32.067367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14f9b3-be77-4251-831f-76fb2382e4fa None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:32.067647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14f9b3-be77-4251-831f-76fb2382e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:32.067918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14f9b3-be77-4251-831f-76fb2382e4fa None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:32.068690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14f9b3-be77-4251-831f-76fb2382e4fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:32.069080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14f9b3-be77-4251-831f-76fb2382e4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:32.070437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14f9b3-be77-4251-831f-76fb2382e4fa None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:32.078778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 226/443] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:32.080269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14f9b3-be77-4251-831f-76fb2382e4fa None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:32.134915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 218/444] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:32.135743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bdc96-8540-425b-a4dc-78fb42db7ff9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:32.177213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14f9b3-be77-4251-831f-76fb2382e4fa None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:32.179413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:32.211085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040c95a-9c3c-48cd-829f-8fdb0b5b6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:32.211731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040c95a-9c3c-48cd-829f-8fdb0b5b6646 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:32.212017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040c95a-9c3c-48cd-829f-8fdb0b5b6646 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:32.212339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040c95a-9c3c-48cd-829f-8fdb0b5b6646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:32.213244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040c95a-9c3c-48cd-829f-8fdb0b5b6646 None admin] RBAC: Adding query filter params (group.id=b7e7a231b1c24cae8dc850a671c14512, role.id=3b950540b0074582839238d2d27d159e, scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:32.213824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040c95a-9c3c-48cd-829f-8fdb0b5b6646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:32.215760 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040c95a-9c3c-48cd-829f-8fdb0b5b6646 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:32.221502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 227/445] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 23 12:53:32 2022] GET /identity/v3/role_assignments?group.id=b7e7a231b1c24cae8dc850a671c14512&scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e&role.id=3b950540b0074582839238d2d27d159e => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:32.222214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040c95a-9c3c-48cd-829f-8fdb0b5b6646 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:32.237477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bdc96-8540-425b-a4dc-78fb42db7ff9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:32.261938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:32.278338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c4d6c-0e1e-496d-87f8-f09744059b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:32.279619 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c4d6c-0e1e-496d-87f8-f09744059b79 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:32.279868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c4d6c-0e1e-496d-87f8-f09744059b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:32.280297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c4d6c-0e1e-496d-87f8-f09744059b79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:32.334119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040c95a-9c3c-48cd-829f-8fdb0b5b6646 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:32.356922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c4d6c-0e1e-496d-87f8-f09744059b79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:32.358436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c4d6c-0e1e-496d-87f8-f09744059b79 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:32.370794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2156c49-501e-41e9-be59-f727727198f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:32.371595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2156c49-501e-41e9-be59-f727727198f1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:32.371879 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2156c49-501e-41e9-be59-f727727198f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:32.372156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2156c49-501e-41e9-be59-f727727198f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:32.383746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2156c49-501e-41e9-be59-f727727198f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a2156c49-501e-41e9-be59-f727727198f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:32.392823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:32.393698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:32.395061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 228/446] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:32.400090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2156c49-501e-41e9-be59-f727727198f1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:32.430279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:32.487465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 219/447] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:32.493162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c4d6c-0e1e-496d-87f8-f09744059b79 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:32.508193 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2156c49-501e-41e9-be59-f727727198f1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:32.519506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:32.547747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314562c-6746-44eb-9069-3eb1a2957ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:32.548457 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314562c-6746-44eb-9069-3eb1a2957ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:32.548781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314562c-6746-44eb-9069-3eb1a2957ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:32.549073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314562c-6746-44eb-9069-3eb1a2957ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:32.549818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314562c-6746-44eb-9069-3eb1a2957ec7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:32.550130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314562c-6746-44eb-9069-3eb1a2957ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:32.551873 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314562c-6746-44eb-9069-3eb1a2957ec7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:32.561297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 229/448] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:32.566764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314562c-6746-44eb-9069-3eb1a2957ec7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:32.613728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c4d6c-0e1e-496d-87f8-f09744059b79 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:32.647581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589c5e4-681d-4529-b48d-fcec3191b204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:32.648446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589c5e4-681d-4529-b48d-fcec3191b204 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:32.648759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589c5e4-681d-4529-b48d-fcec3191b204 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:32.649038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589c5e4-681d-4529-b48d-fcec3191b204 None admin] PATH_INFO: `/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:32.650313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589c5e4-681d-4529-b48d-fcec3191b204 None admin] RBAC: Authorizing `identity:get_project(project_id=d8e42bdf7b8d43eaa3da68e8fb7f466e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:32.651746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589c5e4-681d-4529-b48d-fcec3191b204 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:32.653478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 220/449] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:32 2022] GET /identity/v3/projects/d8e42bdf7b8d43eaa3da68e8fb7f466e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:32.659283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589c5e4-681d-4529-b48d-fcec3191b204 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:32.661749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:32.671266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314562c-6746-44eb-9069-3eb1a2957ec7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:32.704460 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f5b0e-7825-408c-9658-dca36d443bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:32.705138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f5b0e-7825-408c-9658-dca36d443bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:32.705427 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f5b0e-7825-408c-9658-dca36d443bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:32.705709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f5b0e-7825-408c-9658-dca36d443bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:32.745554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:32.757740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589c5e4-681d-4529-b48d-fcec3191b204 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:32.772617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f5b0e-7825-408c-9658-dca36d443bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:32.774108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f5b0e-7825-408c-9658-dca36d443bf2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:32.791287 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14724b40-bfe0-4f85-a866-58e498424eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:32.792507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724b40-bfe0-4f85-a866-58e498424eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:32.792823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724b40-bfe0-4f85-a866-58e498424eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:32.793098 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724b40-bfe0-4f85-a866-58e498424eb2 None admin] PATH_INFO: `/v3/groups/b7e7a231b1c24cae8dc850a671c14512` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:32.794939 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14724b40-bfe0-4f85-a866-58e498424eb2 None admin] RBAC: Authorizing `identity:get_group(group_id=b7e7a231b1c24cae8dc850a671c14512)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:32.795761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14724b40-bfe0-4f85-a866-58e498424eb2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:32.797415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 221/450] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:32 2022] GET /identity/v3/groups/b7e7a231b1c24cae8dc850a671c14512 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:32.803088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14724b40-bfe0-4f85-a866-58e498424eb2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:32.860026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:32.869964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 230/451] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 12:53:32.875531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f5b0e-7825-408c-9658-dca36d443bf2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:32.902401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14724b40-bfe0-4f85-a866-58e498424eb2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:32.935229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bffc1-ae6f-4216-a5d2-7f5a0b2eebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:32.935882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bffc1-ae6f-4216-a5d2-7f5a0b2eebcf None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:32.936176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bffc1-ae6f-4216-a5d2-7f5a0b2eebcf None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:32.936452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bffc1-ae6f-4216-a5d2-7f5a0b2eebcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:32.937326 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bffc1-ae6f-4216-a5d2-7f5a0b2eebcf None admin] RBAC: Adding query filter params (group.id=b7e7a231b1c24cae8dc850a671c14512, role.id=aa5b9dc3549b47aaabedcc3d727351c0, scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:32.937641 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bffc1-ae6f-4216-a5d2-7f5a0b2eebcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:32.939570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bffc1-ae6f-4216-a5d2-7f5a0b2eebcf None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:32.945336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 222/452] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 23 12:53:32 2022] GET /identity/v3/role_assignments?group.id=b7e7a231b1c24cae8dc850a671c14512&scope.project.id=d8e42bdf7b8d43eaa3da68e8fb7f466e&role.id=aa5b9dc3549b47aaabedcc3d727351c0 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:32.978508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f5b0e-7825-408c-9658-dca36d443bf2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:33.014455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e4adf-faa7-4f51-9213-9c120c9dd69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:33.015246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e4adf-faa7-4f51-9213-9c120c9dd69c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:33.015532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e4adf-faa7-4f51-9213-9c120c9dd69c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:33.015811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e4adf-faa7-4f51-9213-9c120c9dd69c None admin] PATH_INFO: `/v3/projects/573a8643ae104193ab15bb005adb20d6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:33.017655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e4adf-faa7-4f51-9213-9c120c9dd69c None admin] RBAC: Authorizing `identity:get_project(project_id=573a8643ae104193ab15bb005adb20d6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:33.019141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e4adf-faa7-4f51-9213-9c120c9dd69c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:33.020925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 231/453] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:32 2022] GET /identity/v3/projects/573a8643ae104193ab15bb005adb20d6 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:33.026767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bffc1-ae6f-4216-a5d2-7f5a0b2eebcf None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:33.059833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:33.141310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bffc1-ae6f-4216-a5d2-7f5a0b2eebcf None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:33.175236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ad83a-58cc-4264-80de-b6c054808f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:33.176090 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ad83a-58cc-4264-80de-b6c054808f90 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:33.176374 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ad83a-58cc-4264-80de-b6c054808f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:33.176647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ad83a-58cc-4264-80de-b6c054808f90 None admin] PATH_INFO: `/v3/groups/b64ef64725a644498798d1cd69d23d90` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:33.177837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ad83a-58cc-4264-80de-b6c054808f90 None admin] RBAC: Authorizing `identity:get_group(group_id=b64ef64725a644498798d1cd69d23d90)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:33.179278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ad83a-58cc-4264-80de-b6c054808f90 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:33.181164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 223/454] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 23 12:53:33 2022] GET /identity/v3/groups/b64ef64725a644498798d1cd69d23d90 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:33.186721 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e4adf-faa7-4f51-9213-9c120c9dd69c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:33.245171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:33.286501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e4adf-faa7-4f51-9213-9c120c9dd69c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:33.318845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096962b-1dc4-4c53-ae3e-dda77bace5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:33.319491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096962b-1dc4-4c53-ae3e-dda77bace5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:33.319778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096962b-1dc4-4c53-ae3e-dda77bace5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:33.320063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096962b-1dc4-4c53-ae3e-dda77bace5a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:33.320983 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096962b-1dc4-4c53-ae3e-dda77bace5a5 None admin] RBAC: Adding query filter params (group.id=b64ef64725a644498798d1cd69d23d90, role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=573a8643ae104193ab15bb005adb20d6) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:33.321300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096962b-1dc4-4c53-ae3e-dda77bace5a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:33.322718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096962b-1dc4-4c53-ae3e-dda77bace5a5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:33.328257 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 232/455] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 23 12:53:33 2022] GET /identity/v3/role_assignments?group.id=b64ef64725a644498798d1cd69d23d90&scope.project.id=573a8643ae104193ab15bb005adb20d6&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:35.782102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd62a4-e12b-4bfe-b365-cef53b60a8a9 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:35.783185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd62a4-e12b-4bfe-b365-cef53b60a8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:35.783185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd62a4-e12b-4bfe-b365-cef53b60a8a9 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:35.784800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 224/456] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:35.790158 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b74ca5-b310-44b3-a047-369bf0947072 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:35.790724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b74ca5-b310-44b3-a047-369bf0947072 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:35.790724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b74ca5-b310-44b3-a047-369bf0947072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:35.817782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-82b74ca5-b310-44b3-a047-369bf0947072 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:35.819152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-82b74ca5-b310-44b3-a047-369bf0947072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:35.909528 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 233/457] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:35.946424 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd62a4-e12b-4bfe-b365-cef53b60a8a9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:35.956227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd342510-4a6b-498e-922b-ba9d815de401 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:35.956512 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd342510-4a6b-498e-922b-ba9d815de401 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:35.956822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd342510-4a6b-498e-922b-ba9d815de401 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:35.958189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 234/458] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:53:35.963787 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ae719-0fbb-400f-81b2-88728aed6282 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:35.964073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ae719-0fbb-400f-81b2-88728aed6282 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:35.964785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ae719-0fbb-400f-81b2-88728aed6282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:35.984783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-471ae719-0fbb-400f-81b2-88728aed6282 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:35.986821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-471ae719-0fbb-400f-81b2-88728aed6282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:36.061122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:36.090565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 235/459] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:36.114868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ae719-0fbb-400f-81b2-88728aed6282 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:36.119785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:36.150425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd62a4-e12b-4bfe-b365-cef53b60a8a9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:36.203179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f76e0-c0ff-4285-b0e2-92619fc35a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:36.203974 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f76e0-c0ff-4285-b0e2-92619fc35a46 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.204258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f76e0-c0ff-4285-b0e2-92619fc35a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.205077 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f76e0-c0ff-4285-b0e2-92619fc35a46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.215495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f76e0-c0ff-4285-b0e2-92619fc35a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:36.217086 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f76e0-c0ff-4285-b0e2-92619fc35a46 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-6c0f76e0-c0ff-4285-b0e2-92619fc35a46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:36.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:36.237292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:36.238165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:36.238165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:36.238165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:36.238165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:36.238165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 225/460] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:36.238781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013057a5-c557-4ca1-822f-cb43e8cc183c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.239064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013057a5-c557-4ca1-822f-cb43e8cc183c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.242615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013057a5-c557-4ca1-822f-cb43e8cc183c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.242615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 226/461] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:36.245199 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013057a5-c557-4ca1-822f-cb43e8cc183c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:36.249730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ae719-0fbb-400f-81b2-88728aed6282 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:36.287336 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06205deb-079c-48e6-a8ba-f71260f8ea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:36.288189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06205deb-079c-48e6-a8ba-f71260f8ea64 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.288482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06205deb-079c-48e6-a8ba-f71260f8ea64 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.288810 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06205deb-079c-48e6-a8ba-f71260f8ea64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.300087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06205deb-079c-48e6-a8ba-f71260f8ea64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:36.301587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06205deb-079c-48e6-a8ba-f71260f8ea64 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-06205deb-079c-48e6-a8ba-f71260f8ea64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:36.321860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:36.322712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:36.323641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:36.323641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:36.323641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:36.323641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:36.323641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 236/462] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:36.326731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0ba47-e4e0-4bed-9d73-496df4e0f6be None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.326731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0ba47-e4e0-4bed-9d73-496df4e0f6be None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.326731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0ba47-e4e0-4bed-9d73-496df4e0f6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.346005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5fb0ba47-e4e0-4bed-9d73-496df4e0f6be None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:36.347830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5fb0ba47-e4e0-4bed-9d73-496df4e0f6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:36.351487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013057a5-c557-4ca1-822f-cb43e8cc183c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:36.379380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:36.393658 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa280d1-cb14-4f86-99ed-9ff9e7f2ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:36.394380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa280d1-cb14-4f86-99ed-9ff9e7f2ab8d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.394670 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa280d1-cb14-4f86-99ed-9ff9e7f2ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.395005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa280d1-cb14-4f86-99ed-9ff9e7f2ab8d None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.396232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa280d1-cb14-4f86-99ed-9ff9e7f2ab8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:36.396232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa280d1-cb14-4f86-99ed-9ff9e7f2ab8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:36.397785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa280d1-cb14-4f86-99ed-9ff9e7f2ab8d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:36.412342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:36.417759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 227/463] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:36.423209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa280d1-cb14-4f86-99ed-9ff9e7f2ab8d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:36.425694 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 237/464] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:36.426782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0ba47-e4e0-4bed-9d73-496df4e0f6be None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:36.532923 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0ba47-e4e0-4bed-9d73-496df4e0f6be None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:36.533821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa280d1-cb14-4f86-99ed-9ff9e7f2ab8d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:36.571109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9718a-563c-4fd7-affd-e800b476b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:36.571818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9718a-563c-4fd7-affd-e800b476b637 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.572160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9718a-563c-4fd7-affd-e800b476b637 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.572432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9718a-563c-4fd7-affd-e800b476b637 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.573196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9718a-563c-4fd7-affd-e800b476b637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:36.573506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9718a-563c-4fd7-affd-e800b476b637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:36.574173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f09f76-1c17-4958-9cab-46d15676e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:36.574946 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9718a-563c-4fd7-affd-e800b476b637 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:36.575293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f09f76-1c17-4958-9cab-46d15676e2b6 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.575781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f09f76-1c17-4958-9cab-46d15676e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.576376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f09f76-1c17-4958-9cab-46d15676e2b6 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.577427 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f09f76-1c17-4958-9cab-46d15676e2b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:36.579081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f09f76-1c17-4958-9cab-46d15676e2b6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:36.587555 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 228/465] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:36.588772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9718a-563c-4fd7-affd-e800b476b637 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:36.648228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:36.689077 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9718a-563c-4fd7-affd-e800b476b637 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:36.701767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 238/466] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:53:36 2022] POST /identity/v3/users => generated 246 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:53:36.703024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f09f76-1c17-4958-9cab-46d15676e2b6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:36.735501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569b127-a18e-4262-a8b0-f2d32a5369ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:36.736903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569b127-a18e-4262-a8b0-f2d32a5369ff None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.737240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569b127-a18e-4262-a8b0-f2d32a5369ff None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.737524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569b127-a18e-4262-a8b0-f2d32a5369ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.738034 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:36.750180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569b127-a18e-4262-a8b0-f2d32a5369ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:36.751808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569b127-a18e-4262-a8b0-f2d32a5369ff None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8569b127-a18e-4262-a8b0-f2d32a5369ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:36.772648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:36.773577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:36.774822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:36.774822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:36.774822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:36.774822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:36.774822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 229/467] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:36.775326 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39625a21-eb25-47e9-bb77-cbf562b403fa None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.775620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39625a21-eb25-47e9-bb77-cbf562b403fa None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.775945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39625a21-eb25-47e9-bb77-cbf562b403fa None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.777435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 230/468] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:36.782557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39625a21-eb25-47e9-bb77-cbf562b403fa None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:36.847337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f09f76-1c17-4958-9cab-46d15676e2b6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:36.890382 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f36c3-6990-4ac1-8802-13f77f5ceb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:36.891345 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f36c3-6990-4ac1-8802-13f77f5ceb2e None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.891628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f36c3-6990-4ac1-8802-13f77f5ceb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.892429 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f36c3-6990-4ac1-8802-13f77f5ceb2e None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.893171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f36c3-6990-4ac1-8802-13f77f5ceb2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:36.894667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f36c3-6990-4ac1-8802-13f77f5ceb2e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:36.910054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39625a21-eb25-47e9-bb77-cbf562b403fa None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:36.925733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:36.948246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253f7cb-d582-4328-984b-0b8775e4797e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:36.948959 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253f7cb-d582-4328-984b-0b8775e4797e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.949246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253f7cb-d582-4328-984b-0b8775e4797e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.949523 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253f7cb-d582-4328-984b-0b8775e4797e None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.950240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253f7cb-d582-4328-984b-0b8775e4797e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:36.950592 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253f7cb-d582-4328-984b-0b8775e4797e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:36.951965 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253f7cb-d582-4328-984b-0b8775e4797e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:36.964036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 231/469] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:36.965994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1e484-b4f9-458e-83ce-9d9927ca2dc2 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.965994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1e484-b4f9-458e-83ce-9d9927ca2dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.965994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1e484-b4f9-458e-83ce-9d9927ca2dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.982264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d0e1e484-b4f9-458e-83ce-9d9927ca2dc2 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:36.983613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d0e1e484-b4f9-458e-83ce-9d9927ca2dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:37.004270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 239/470] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:53:36 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:53:37.005903 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f36c3-6990-4ac1-8802-13f77f5ceb2e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:37.099604 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 232/471] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:37.108882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:37.131096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f36c3-6990-4ac1-8802-13f77f5ceb2e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:37.149766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1e484-b4f9-458e-83ce-9d9927ca2dc2 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:37.171809 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cae3a-67d0-4c8f-aeee-49258192806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:37.173086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cae3a-67d0-4c8f-aeee-49258192806c None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:37.173591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cae3a-67d0-4c8f-aeee-49258192806c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:37.174066 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cae3a-67d0-4c8f-aeee-49258192806c None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:37.175049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cae3a-67d0-4c8f-aeee-49258192806c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:37.176899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cae3a-67d0-4c8f-aeee-49258192806c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:37.263517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 240/472] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:53:37 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:53:37.265227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103016fe-e705-4f18-97fd-9f25a920ecef None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:37.265520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103016fe-e705-4f18-97fd-9f25a920ecef None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:37.265800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103016fe-e705-4f18-97fd-9f25a920ecef None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:37.267681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 241/473] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:37.273623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2b910-9589-475e-bd5c-155cb3342eb0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:37.274244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2b910-9589-475e-bd5c-155cb3342eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:37.274724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2b910-9589-475e-bd5c-155cb3342eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:37.282107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1e484-b4f9-458e-83ce-9d9927ca2dc2 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:37.284576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:37.308439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d3e2b910-9589-475e-bd5c-155cb3342eb0 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:37.310615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d3e2b910-9589-475e-bd5c-155cb3342eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:37.347256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffea08-dbd1-4761-b329-533424623f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:37.348077 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffea08-dbd1-4761-b329-533424623f04 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:37.348359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffea08-dbd1-4761-b329-533424623f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:37.348635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffea08-dbd1-4761-b329-533424623f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:37.366882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffea08-dbd1-4761-b329-533424623f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:37.368772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffea08-dbd1-4761-b329-533424623f04 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-02ffea08-dbd1-4761-b329-533424623f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:37.396885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:37.397815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:37.398647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:37.398647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:37.398647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:37.398647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:37.407920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 233/474] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:37.415230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffea08-dbd1-4761-b329-533424623f04 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:37.456703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 242/475] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:37.483436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2b910-9589-475e-bd5c-155cb3342eb0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:37.553256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffea08-dbd1-4761-b329-533424623f04 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:37.565256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:37.595352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb75242-9d47-4043-b2aa-2e611db99e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:37.596418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb75242-9d47-4043-b2aa-2e611db99e13 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:37.596955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb75242-9d47-4043-b2aa-2e611db99e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:37.597431 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb75242-9d47-4043-b2aa-2e611db99e13 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:37.598347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb75242-9d47-4043-b2aa-2e611db99e13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:37.598846 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb75242-9d47-4043-b2aa-2e611db99e13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:37.600429 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb75242-9d47-4043-b2aa-2e611db99e13 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:37.613055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2b910-9589-475e-bd5c-155cb3342eb0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:37.614343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 234/476] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:37.625470 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb75242-9d47-4043-b2aa-2e611db99e13 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:37.643281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:37.656899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce912ac-8c34-4ddc-97fe-284fa47fac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:37.658078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce912ac-8c34-4ddc-97fe-284fa47fac81 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:37.658520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce912ac-8c34-4ddc-97fe-284fa47fac81 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:37.659012 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce912ac-8c34-4ddc-97fe-284fa47fac81 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:37.659912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce912ac-8c34-4ddc-97fe-284fa47fac81 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:37.661600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce912ac-8c34-4ddc-97fe-284fa47fac81 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:37.710817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.sql.core [None req-6ce912ac-8c34-4ddc-97fe-284fa47fac81 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 12:53:37.710817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 12:53:37.710817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [parameters: {'id': 'fa4cd9be518e4176893d50c6dd947268', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 12:53:37.710817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80259) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-6ce912ac-8c34-4ddc-97fe-284fa47fac81 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application conn.query(q) Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application result.read() Jun 23 12:53:37.728788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 12:53:37.729683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application next(self.gen) Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application yield resource Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application next(self.gen) Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise self.value Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application session.commit() Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 12:53:37.730564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self.session.flush() Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application compat.raise_( Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 12:53:37.731389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 12:53:37.732376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application conn.query(q) Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application result.read() Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 12:53:37.734746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [parameters: {'id': 'fa4cd9be518e4176893d50c6dd947268', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:37.737278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 12:53:37.739305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:37.742852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb75242-9d47-4043-b2aa-2e611db99e13 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:37.743294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 243/477] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jun 23 12:53:37 2022] POST /identity/v3/roles => generated 144 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:37.749514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce912ac-8c34-4ddc-97fe-284fa47fac81 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:37.785155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938abfff-0eb8-4bf0-8299-a7a2ee33db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:37.785982 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938abfff-0eb8-4bf0-8299-a7a2ee33db75 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:37.786154 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938abfff-0eb8-4bf0-8299-a7a2ee33db75 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:37.788699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938abfff-0eb8-4bf0-8299-a7a2ee33db75 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:37.789826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938abfff-0eb8-4bf0-8299-a7a2ee33db75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:37.793344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938abfff-0eb8-4bf0-8299-a7a2ee33db75 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:37.912957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce912ac-8c34-4ddc-97fe-284fa47fac81 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:37.927582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 235/478] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:53:37 2022] POST /identity/v3/users => generated 249 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:53:37.945104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:37.961679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079fe91-ec4b-478d-955a-4ea605863061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:37.962500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079fe91-ec4b-478d-955a-4ea605863061 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:37.962785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079fe91-ec4b-478d-955a-4ea605863061 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:37.963061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079fe91-ec4b-478d-955a-4ea605863061 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:37.990249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079fe91-ec4b-478d-955a-4ea605863061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-6079fe91-ec4b-478d-955a-4ea605863061 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:38.003964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:38.005048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:38.005838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 244/479] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:53:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:38.011792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938abfff-0eb8-4bf0-8299-a7a2ee33db75 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:38.130943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:38.182651 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938abfff-0eb8-4bf0-8299-a7a2ee33db75 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:38.233034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f9d3-3926-45ea-8d7d-72eb36dfdecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:38.233716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f9d3-3926-45ea-8d7d-72eb36dfdecd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:38.234003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f9d3-3926-45ea-8d7d-72eb36dfdecd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:38.234282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f9d3-3926-45ea-8d7d-72eb36dfdecd None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:38.235094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69f9d3-3926-45ea-8d7d-72eb36dfdecd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:38.235439 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69f9d3-3926-45ea-8d7d-72eb36dfdecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:38.236915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69f9d3-3926-45ea-8d7d-72eb36dfdecd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:38.248697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 236/480] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:39.037472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb9584-cd90-4d02-bd64-19c900f33d34 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:39.037986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb9584-cd90-4d02-bd64-19c900f33d34 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:39.038059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb9584-cd90-4d02-bd64-19c900f33d34 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:39.039639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 245/481] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:39.044777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16e279-852a-4617-9e50-c60f71124970 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:39.045176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16e279-852a-4617-9e50-c60f71124970 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:39.045358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16e279-852a-4617-9e50-c60f71124970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:39.067995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ba16e279-852a-4617-9e50-c60f71124970 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:39.069203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ba16e279-852a-4617-9e50-c60f71124970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:39.170321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 237/482] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:39.207339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb9584-cd90-4d02-bd64-19c900f33d34 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:39.338351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb9584-cd90-4d02-bd64-19c900f33d34 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:39.377210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769be9e-6071-4b65-aa28-7f46b8d9519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:39.378002 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769be9e-6071-4b65-aa28-7f46b8d9519a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:39.378287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769be9e-6071-4b65-aa28-7f46b8d9519a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:39.378556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769be9e-6071-4b65-aa28-7f46b8d9519a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:39.388681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769be9e-6071-4b65-aa28-7f46b8d9519a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-2769be9e-6071-4b65-aa28-7f46b8d9519a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:39.397148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:39.398050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:39.398835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:39.398835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:39.398835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:39.398835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:39.398835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:39.398835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:39.398835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:39.398835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:39.398835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:39.398835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:39.398835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:39.398835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:39.399441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 246/483] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:39.405513 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743404f-38f8-400f-9f55-981fad2ed9b8 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:39.405913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743404f-38f8-400f-9f55-981fad2ed9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:39.406337 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743404f-38f8-400f-9f55-981fad2ed9b8 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:39.408083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 238/484] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:39.410388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769be9e-6071-4b65-aa28-7f46b8d9519a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:39.413255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50968d-249f-46d7-817b-07ef9f91d23b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:39.413534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50968d-249f-46d7-817b-07ef9f91d23b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:39.413808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50968d-249f-46d7-817b-07ef9f91d23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:39.441527 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7a50968d-249f-46d7-817b-07ef9f91d23b None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:39.442716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7a50968d-249f-46d7-817b-07ef9f91d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:39.501683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:39.540265 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769be9e-6071-4b65-aa28-7f46b8d9519a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:39.574756 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4f02d-f4ff-4cf7-8243-02230901a167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:39.575428 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4f02d-f4ff-4cf7-8243-02230901a167 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:39.575711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4f02d-f4ff-4cf7-8243-02230901a167 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:39.575988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4f02d-f4ff-4cf7-8243-02230901a167 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:39.576762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4f02d-f4ff-4cf7-8243-02230901a167 None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:39.577074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4f02d-f4ff-4cf7-8243-02230901a167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:39.578578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4f02d-f4ff-4cf7-8243-02230901a167 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:39.586950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 247/485] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:39.592323 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4f02d-f4ff-4cf7-8243-02230901a167 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:39.621750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:39.674439 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 239/486] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:39.694600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4f02d-f4ff-4cf7-8243-02230901a167 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:39.714328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:39.717712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50968d-249f-46d7-817b-07ef9f91d23b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:39.728215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad33340-52e1-4796-bf5f-277b569dafaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:39.729036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad33340-52e1-4796-bf5f-277b569dafaa None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:39.729317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad33340-52e1-4796-bf5f-277b569dafaa None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:39.729593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad33340-52e1-4796-bf5f-277b569dafaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:39.740265 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad33340-52e1-4796-bf5f-277b569dafaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:39.741836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad33340-52e1-4796-bf5f-277b569dafaa None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-5ad33340-52e1-4796-bf5f-277b569dafaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:39.762577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:39.763642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:39.764491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:39.764491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:39.764491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:39.764491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:39.764491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 248/487] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:39.773686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad33340-52e1-4796-bf5f-277b569dafaa None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:39.876774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad33340-52e1-4796-bf5f-277b569dafaa None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:39.900233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50968d-249f-46d7-817b-07ef9f91d23b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:39.938758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de931820-e317-42e7-8f89-65dc52f77f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:39.939564 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931820-e317-42e7-8f89-65dc52f77f56 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:39.939915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931820-e317-42e7-8f89-65dc52f77f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:39.940132 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931820-e317-42e7-8f89-65dc52f77f56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:39.948491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b69077-1cfb-41a0-8e13-728789e0f5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:39.949672 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b69077-1cfb-41a0-8e13-728789e0f5af None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:39.950150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b69077-1cfb-41a0-8e13-728789e0f5af None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:39.950619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b69077-1cfb-41a0-8e13-728789e0f5af None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:39.951534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b69077-1cfb-41a0-8e13-728789e0f5af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:39.952102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b69077-1cfb-41a0-8e13-728789e0f5af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:39.952389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de931820-e317-42e7-8f89-65dc52f77f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:39.953971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b69077-1cfb-41a0-8e13-728789e0f5af None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-de931820-e317-42e7-8f89-65dc52f77f56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:39.960737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:39.961634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:39.962419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 240/488] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:39.963585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c752281-0ae6-420f-965d-efd904d9e827 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:39.963881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c752281-0ae6-420f-965d-efd904d9e827 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:39.964165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c752281-0ae6-420f-965d-efd904d9e827 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:39.965724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 241/489] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:39.971014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c752281-0ae6-420f-965d-efd904d9e827 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:39.972189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 249/490] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:39.973648 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933732e-72eb-4d0b-844a-2270a4e094b0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:39.974230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933732e-72eb-4d0b-844a-2270a4e094b0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:39.974755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933732e-72eb-4d0b-844a-2270a4e094b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:39.992555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f933732e-72eb-4d0b-844a-2270a4e094b0 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:39.993949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f933732e-72eb-4d0b-844a-2270a4e094b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:40.009570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:40.028314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:40.071319 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 250/491] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:40.073033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933732e-72eb-4d0b-844a-2270a4e094b0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:40.097960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c752281-0ae6-420f-965d-efd904d9e827 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:40.139976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea8d46-19f8-45ec-859c-7b9baf341d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:40.140573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8d46-19f8-45ec-859c-7b9baf341d54 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.140941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8d46-19f8-45ec-859c-7b9baf341d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.141228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8d46-19f8-45ec-859c-7b9baf341d54 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.142050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea8d46-19f8-45ec-859c-7b9baf341d54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:40.142369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea8d46-19f8-45ec-859c-7b9baf341d54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:40.143846 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea8d46-19f8-45ec-859c-7b9baf341d54 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:40.153568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 242/492] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:40.154491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea8d46-19f8-45ec-859c-7b9baf341d54 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:40.194127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933732e-72eb-4d0b-844a-2270a4e094b0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:40.231260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b68cbf-599c-4cf7-b10c-c2b8a4cde9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:40.232489 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b68cbf-599c-4cf7-b10c-c2b8a4cde9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.232993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b68cbf-599c-4cf7-b10c-c2b8a4cde9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.233465 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b68cbf-599c-4cf7-b10c-c2b8a4cde9c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.241476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b68cbf-599c-4cf7-b10c-c2b8a4cde9c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:40.243344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b68cbf-599c-4cf7-b10c-c2b8a4cde9c8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:40.258193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea8d46-19f8-45ec-859c-7b9baf341d54 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-c1b68cbf-599c-4cf7-b10c-c2b8a4cde9c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:40.260933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:40.261832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:40.262791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:40.262791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:40.262791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:40.262791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:40.262791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:40.262791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:40.262791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:40.262791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:40.262791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:53:40.262791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:40.265570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 251/493] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 23 12:53:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:40.266554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b68cbf-599c-4cf7-b10c-c2b8a4cde9c8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:40.273000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:40.281864 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:40.294607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1f42e-24b0-4b0b-bb52-799ca9a7666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:40.295389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1f42e-24b0-4b0b-bb52-799ca9a7666e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.295722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1f42e-24b0-4b0b-bb52-799ca9a7666e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.296007 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1f42e-24b0-4b0b-bb52-799ca9a7666e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.307591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1f42e-24b0-4b0b-bb52-799ca9a7666e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c6e1f42e-24b0-4b0b-bb52-799ca9a7666e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:40.316522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:40.317553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:40.318350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 243/494] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:40.322504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1f42e-24b0-4b0b-bb52-799ca9a7666e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:40.378785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b68cbf-599c-4cf7-b10c-c2b8a4cde9c8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:40.413270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1be374-aa1f-4aae-a875-ce684140916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:40.414364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1be374-aa1f-4aae-a875-ce684140916c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.414842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1be374-aa1f-4aae-a875-ce684140916c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.415325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1be374-aa1f-4aae-a875-ce684140916c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.426370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1be374-aa1f-4aae-a875-ce684140916c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:40.428053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1be374-aa1f-4aae-a875-ce684140916c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:40.432412 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1f42e-24b0-4b0b-bb52-799ca9a7666e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-6b1be374-aa1f-4aae-a875-ce684140916c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:40.446161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:40.447095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:40.447919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:40.447919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:40.447919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:40.447919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:40.448907 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 252/495] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:40.449698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1be374-aa1f-4aae-a875-ce684140916c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:40.474127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21fc01-565a-4f59-8737-d861c906db04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:40.474796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21fc01-565a-4f59-8737-d861c906db04 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.475078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21fc01-565a-4f59-8737-d861c906db04 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.475372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21fc01-565a-4f59-8737-d861c906db04 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.476201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21fc01-565a-4f59-8737-d861c906db04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:40.476637 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21fc01-565a-4f59-8737-d861c906db04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:40.477946 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21fc01-565a-4f59-8737-d861c906db04 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:40.512883 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:40.513890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 244/496] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 23 12:53:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:40.515278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4042f4-184c-491b-b210-eef9665448ec None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.515572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4042f4-184c-491b-b210-eef9665448ec None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.515853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4042f4-184c-491b-b210-eef9665448ec None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.517831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 245/497] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:40.518435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4042f4-184c-491b-b210-eef9665448ec None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:40.551655 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:40.562000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1be374-aa1f-4aae-a875-ce684140916c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:40.599200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac32791-860f-4e89-8d53-86b8e2ee3328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:40.599861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac32791-860f-4e89-8d53-86b8e2ee3328 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.600262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac32791-860f-4e89-8d53-86b8e2ee3328 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.600542 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac32791-860f-4e89-8d53-86b8e2ee3328 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.601310 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac32791-860f-4e89-8d53-86b8e2ee3328 None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:40.601618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac32791-860f-4e89-8d53-86b8e2ee3328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:40.603118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac32791-860f-4e89-8d53-86b8e2ee3328 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:40.612129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 253/498] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:40.612944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac32791-860f-4e89-8d53-86b8e2ee3328 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:40.628943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4042f4-184c-491b-b210-eef9665448ec None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:40.666466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ffe98-2cdf-4750-b20a-00aaecda647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:40.667054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ffe98-2cdf-4750-b20a-00aaecda647d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.667333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ffe98-2cdf-4750-b20a-00aaecda647d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.667612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ffe98-2cdf-4750-b20a-00aaecda647d None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.668454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ffe98-2cdf-4750-b20a-00aaecda647d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:40.668910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ffe98-2cdf-4750-b20a-00aaecda647d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:40.670296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ffe98-2cdf-4750-b20a-00aaecda647d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:40.687647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 246/499] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:40.687647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3382a-ede7-424b-b125-0a7f41388c1e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.687647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3382a-ede7-424b-b125-0a7f41388c1e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.687647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3382a-ede7-424b-b125-0a7f41388c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.702205 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-bbd3382a-ede7-424b-b125-0a7f41388c1e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:40.703394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bbd3382a-ede7-424b-b125-0a7f41388c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:40.713656 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac32791-860f-4e89-8d53-86b8e2ee3328 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:40.736677 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:40.747305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a2997-d80e-490c-b7da-c41b688997d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:40.747952 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a2997-d80e-490c-b7da-c41b688997d5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.748234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a2997-d80e-490c-b7da-c41b688997d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.748511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a2997-d80e-490c-b7da-c41b688997d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.782367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 247/500] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:40.782367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3382a-ede7-424b-b125-0a7f41388c1e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:40.809687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:40.825018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a2997-d80e-490c-b7da-c41b688997d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:40.826496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a2997-d80e-490c-b7da-c41b688997d5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:40.889955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3382a-ede7-424b-b125-0a7f41388c1e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:40.925137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 254/501] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:40.925905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a2997-d80e-490c-b7da-c41b688997d5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:40.930319 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2092d-034a-48a7-bf46-866bfb45481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:40.931381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2092d-034a-48a7-bf46-866bfb45481d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.931865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2092d-034a-48a7-bf46-866bfb45481d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.932335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2092d-034a-48a7-bf46-866bfb45481d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.943478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2092d-034a-48a7-bf46-866bfb45481d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:40.945313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2092d-034a-48a7-bf46-866bfb45481d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:40.951456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-d3d2092d-034a-48a7-bf46-866bfb45481d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:40.964484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:40.967843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:40.968713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:40.968713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:40.968713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:40.968713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:40.968713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 248/502] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:40.968713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2092d-034a-48a7-bf46-866bfb45481d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.034019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a2997-d80e-490c-b7da-c41b688997d5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.047577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:41.074925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacc7da-8df7-47ff-afda-bbadeada6e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.075812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacc7da-8df7-47ff-afda-bbadeada6e9d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.076100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacc7da-8df7-47ff-afda-bbadeada6e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.076380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacc7da-8df7-47ff-afda-bbadeada6e9d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.077620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2092d-034a-48a7-bf46-866bfb45481d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.084062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacc7da-8df7-47ff-afda-bbadeada6e9d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:41.085679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacc7da-8df7-47ff-afda-bbadeada6e9d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-3bacc7da-8df7-47ff-afda-bbadeada6e9d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:41.100921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:41.101825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:41.102692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:41.102692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:41.102692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:41.102692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:41.102692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:41.102692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:41.102692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:41.102692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:41.102692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 12:53:41.102692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:41.102692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 255/503] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:41.103251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacc7da-8df7-47ff-afda-bbadeada6e9d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.113476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f4a18-6869-4c38-bd3e-a6446f25265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.114267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f4a18-6869-4c38-bd3e-a6446f25265c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.114547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f4a18-6869-4c38-bd3e-a6446f25265c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.114823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f4a18-6869-4c38-bd3e-a6446f25265c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.124854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f4a18-6869-4c38-bd3e-a6446f25265c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-186f4a18-6869-4c38-bd3e-a6446f25265c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:41.132436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:41.133362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:41.134142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 249/504] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:41.134791 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f4a18-6869-4c38-bd3e-a6446f25265c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.192631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:41.207407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacc7da-8df7-47ff-afda-bbadeada6e9d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.231957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f4a18-6869-4c38-bd3e-a6446f25265c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.240998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79561ff9-e994-4c68-9851-87426ebcf646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.241781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79561ff9-e994-4c68-9851-87426ebcf646 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.242063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79561ff9-e994-4c68-9851-87426ebcf646 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.242343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79561ff9-e994-4c68-9851-87426ebcf646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.251954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79561ff9-e994-4c68-9851-87426ebcf646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:41.253411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79561ff9-e994-4c68-9851-87426ebcf646 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:41.264547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94bac1-c694-4882-8882-124e6d8c6b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.265231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94bac1-c694-4882-8882-124e6d8c6b15 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.265511 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94bac1-c694-4882-8882-124e6d8c6b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.265788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94bac1-c694-4882-8882-124e6d8c6b15 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.266495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94bac1-c694-4882-8882-124e6d8c6b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:41.267328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94bac1-c694-4882-8882-124e6d8c6b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:41.268693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94bac1-c694-4882-8882-124e6d8c6b15 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:41.270114 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-79561ff9-e994-4c68-9851-87426ebcf646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:41.271332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:41.272449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:41.273327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:41.273327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:41.273327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:41.273327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:41.273327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 256/505] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:41.274152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0fa94-a611-40cc-a2d4-d532fa8cbf04 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.274443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0fa94-a611-40cc-a2d4-d532fa8cbf04 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.274725 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0fa94-a611-40cc-a2d4-d532fa8cbf04 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.276118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 257/506] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:41.276732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0fa94-a611-40cc-a2d4-d532fa8cbf04 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.287561 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 250/507] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:41.287561 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94bac1-c694-4882-8882-124e6d8c6b15 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.378659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0fa94-a611-40cc-a2d4-d532fa8cbf04 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.388824 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94bac1-c694-4882-8882-124e6d8c6b15 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.412167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46593cc-b4fc-42a7-8b5f-ffa124361bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.412860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46593cc-b4fc-42a7-8b5f-ffa124361bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.413144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46593cc-b4fc-42a7-8b5f-ffa124361bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.413422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46593cc-b4fc-42a7-8b5f-ffa124361bd9 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.414260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46593cc-b4fc-42a7-8b5f-ffa124361bd9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:41.414570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46593cc-b4fc-42a7-8b5f-ffa124361bd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:41.415976 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46593cc-b4fc-42a7-8b5f-ffa124361bd9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:41.422649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb0523-7ad6-4c5b-a68c-0676eef57f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.423311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb0523-7ad6-4c5b-a68c-0676eef57f58 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.423599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb0523-7ad6-4c5b-a68c-0676eef57f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.423881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb0523-7ad6-4c5b-a68c-0676eef57f58 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.424619 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb0523-7ad6-4c5b-a68c-0676eef57f58 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:41.424967 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb0523-7ad6-4c5b-a68c-0676eef57f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:41.426317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb0523-7ad6-4c5b-a68c-0676eef57f58 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:41.427301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:41.434373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 251/508] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:41.438605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb0523-7ad6-4c5b-a68c-0676eef57f58 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.451558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 258/509] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jun 23 12:53:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:41.452770 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b2c5a-2bc9-42d3-acf5-c6e1a2f82c3f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.453071 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b2c5a-2bc9-42d3-acf5-c6e1a2f82c3f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.453333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b2c5a-2bc9-42d3-acf5-c6e1a2f82c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.471241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a37b2c5a-2bc9-42d3-acf5-c6e1a2f82c3f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:41.472520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a37b2c5a-2bc9-42d3-acf5-c6e1a2f82c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:41.493606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:41.537206 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 259/510] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:41.537563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb0523-7ad6-4c5b-a68c-0676eef57f58 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.537917 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b2c5a-2bc9-42d3-acf5-c6e1a2f82c3f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.574032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83b22a-52b8-479b-9a48-8ba07143926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.574680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83b22a-52b8-479b-9a48-8ba07143926a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.574962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83b22a-52b8-479b-9a48-8ba07143926a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.575238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83b22a-52b8-479b-9a48-8ba07143926a None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.575950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83b22a-52b8-479b-9a48-8ba07143926a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:41.576249 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83b22a-52b8-479b-9a48-8ba07143926a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:41.577645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83b22a-52b8-479b-9a48-8ba07143926a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:41.589576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 252/511] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:41.590338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83b22a-52b8-479b-9a48-8ba07143926a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.634952 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b2c5a-2bc9-42d3-acf5-c6e1a2f82c3f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.658435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:41.668524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51f39a-c3da-463c-a0d0-40a4c3e68ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.669343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51f39a-c3da-463c-a0d0-40a4c3e68ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.669628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51f39a-c3da-463c-a0d0-40a4c3e68ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.669905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51f39a-c3da-463c-a0d0-40a4c3e68ab9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.676722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51f39a-c3da-463c-a0d0-40a4c3e68ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:41.678164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51f39a-c3da-463c-a0d0-40a4c3e68ab9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:41.686491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83b22a-52b8-479b-9a48-8ba07143926a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-cc51f39a-c3da-463c-a0d0-40a4c3e68ab9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:41.692781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:41.693801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:41.699302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:41.699302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:41.699302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:41.699302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:41.699302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:41.699302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:41.699302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:41.699302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:41.699302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:53:41.699302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:41.699302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 260/512] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:41.699302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51f39a-c3da-463c-a0d0-40a4c3e68ab9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.704852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:41.722029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5899b-6fef-4ae4-80b4-ea0c2f1d325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.722821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5899b-6fef-4ae4-80b4-ea0c2f1d325d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.723111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5899b-6fef-4ae4-80b4-ea0c2f1d325d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.723392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5899b-6fef-4ae4-80b4-ea0c2f1d325d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.733145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5899b-6fef-4ae4-80b4-ea0c2f1d325d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:41.734611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5899b-6fef-4ae4-80b4-ea0c2f1d325d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-e1c5899b-6fef-4ae4-80b4-ea0c2f1d325d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:41.752736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:41.753734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:41.754754 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:41.754754 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:41.754754 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:41.754754 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:41.756299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 253/513] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:41.757236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5899b-6fef-4ae4-80b4-ea0c2f1d325d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.794228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51f39a-c3da-463c-a0d0-40a4c3e68ab9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.829650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b2017-90fc-49f0-8994-53a1dd05a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.830335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b2017-90fc-49f0-8994-53a1dd05a182 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.830620 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b2017-90fc-49f0-8994-53a1dd05a182 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.830899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b2017-90fc-49f0-8994-53a1dd05a182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.856311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5899b-6fef-4ae4-80b4-ea0c2f1d325d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.880947 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:41.889392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f98a1-5216-4074-8a68-301210a531f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.890173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f98a1-5216-4074-8a68-301210a531f7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.890474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f98a1-5216-4074-8a68-301210a531f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.896154 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f98a1-5216-4074-8a68-301210a531f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.896420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b2017-90fc-49f0-8994-53a1dd05a182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:41.898166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b2017-90fc-49f0-8994-53a1dd05a182 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:41.901658 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f98a1-5216-4074-8a68-301210a531f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:41.903102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f98a1-5216-4074-8a68-301210a531f7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-e97f98a1-5216-4074-8a68-301210a531f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:41.920574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:41.921595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:41.923145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:41.923145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:41.923145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:41.923145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:41.923145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 254/514] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:41.923145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f98a1-5216-4074-8a68-301210a531f7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.946212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:41.995818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 261/515] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:41.997565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b2017-90fc-49f0-8994-53a1dd05a182 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:42.023391 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f98a1-5216-4074-8a68-301210a531f7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:42.056344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00709134-b13b-4789-8a96-4084b734d409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:42.057161 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00709134-b13b-4789-8a96-4084b734d409 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:42.057443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00709134-b13b-4789-8a96-4084b734d409 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:42.057725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00709134-b13b-4789-8a96-4084b734d409 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:42.064946 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00709134-b13b-4789-8a96-4084b734d409 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:42.066397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00709134-b13b-4789-8a96-4084b734d409 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:42.080291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-00709134-b13b-4789-8a96-4084b734d409 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:42.080747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:42.081596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:42.082413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:42.082413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:42.082413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:42.082413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:42.082413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:42.082413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:42.082413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:42.082413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:42.082811 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 255/516] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:42.083388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00709134-b13b-4789-8a96-4084b734d409 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:42.096463 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b2017-90fc-49f0-8994-53a1dd05a182 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:42.131026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a5678-ff84-433d-9726-13c15493eb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:42.131694 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a5678-ff84-433d-9726-13c15493eb3b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:42.131985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a5678-ff84-433d-9726-13c15493eb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:42.132266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a5678-ff84-433d-9726-13c15493eb3b None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:42.133128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a5678-ff84-433d-9726-13c15493eb3b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:42.133444 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a5678-ff84-433d-9726-13c15493eb3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:42.134878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a5678-ff84-433d-9726-13c15493eb3b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:42.152458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 262/517] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jun 23 12:53:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:42.153287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a5678-ff84-433d-9726-13c15493eb3b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:42.168757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:42.187341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00709134-b13b-4789-8a96-4084b734d409 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:42.221712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ba182-80f7-4f91-bd58-d4ae01790a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:42.222369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ba182-80f7-4f91-bd58-d4ae01790a48 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:42.222659 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ba182-80f7-4f91-bd58-d4ae01790a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:42.222942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ba182-80f7-4f91-bd58-d4ae01790a48 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:42.223667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ba182-80f7-4f91-bd58-d4ae01790a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:42.223979 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ba182-80f7-4f91-bd58-d4ae01790a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:42.225386 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ba182-80f7-4f91-bd58-d4ae01790a48 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:42.237599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 256/518] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:42.238379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ba182-80f7-4f91-bd58-d4ae01790a48 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:42.253896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a5678-ff84-433d-9726-13c15493eb3b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:42.287156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce6fc8-1202-4b25-97a8-97562c629342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:42.287814 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce6fc8-1202-4b25-97a8-97562c629342 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:42.288100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce6fc8-1202-4b25-97a8-97562c629342 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:42.288384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce6fc8-1202-4b25-97a8-97562c629342 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:42.289142 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce6fc8-1202-4b25-97a8-97562c629342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:42.289456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce6fc8-1202-4b25-97a8-97562c629342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:42.290818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce6fc8-1202-4b25-97a8-97562c629342 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:42.302207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 263/519] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:42.302825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce6fc8-1202-4b25-97a8-97562c629342 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:42.305973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:42.334006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ba182-80f7-4f91-bd58-d4ae01790a48 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:42.366934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde435ed-0f54-4db9-a212-1bf086a9df3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:42.367715 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde435ed-0f54-4db9-a212-1bf086a9df3f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:42.368006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde435ed-0f54-4db9-a212-1bf086a9df3f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:42.368285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde435ed-0f54-4db9-a212-1bf086a9df3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:42.376791 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:42.379096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde435ed-0f54-4db9-a212-1bf086a9df3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:42.380569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde435ed-0f54-4db9-a212-1bf086a9df3f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-dde435ed-0f54-4db9-a212-1bf086a9df3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:42.397978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:42.398950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:42.399978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:42.399978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:42.399978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:42.399978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:42.400676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce6fc8-1202-4b25-97a8-97562c629342 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:42.401520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 257/520] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:42.402295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde435ed-0f54-4db9-a212-1bf086a9df3f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:42.438904 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67230d-476e-48f3-bcdf-d1d51a0ddacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:42.439561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67230d-476e-48f3-bcdf-d1d51a0ddacd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:42.439845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67230d-476e-48f3-bcdf-d1d51a0ddacd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:42.440123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67230d-476e-48f3-bcdf-d1d51a0ddacd None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:42.440938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67230d-476e-48f3-bcdf-d1d51a0ddacd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:42.441253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67230d-476e-48f3-bcdf-d1d51a0ddacd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:42.442668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67230d-476e-48f3-bcdf-d1d51a0ddacd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:42.459681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 264/521] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:42.460469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67230d-476e-48f3-bcdf-d1d51a0ddacd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:42.500956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde435ed-0f54-4db9-a212-1bf086a9df3f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:42.520824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:42.535171 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0539a-5f24-464d-af28-4d02c1bfbf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:42.536499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0539a-5f24-464d-af28-4d02c1bfbf5f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:42.536499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0539a-5f24-464d-af28-4d02c1bfbf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:42.536499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0539a-5f24-464d-af28-4d02c1bfbf5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:42.557873 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67230d-476e-48f3-bcdf-d1d51a0ddacd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:42.590897 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0324a-fcc1-4889-b464-e18a63279c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:42.591686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0324a-fcc1-4889-b464-e18a63279c5b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:42.592003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0324a-fcc1-4889-b464-e18a63279c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:42.592127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:42.592304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0324a-fcc1-4889-b464-e18a63279c5b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:42.600341 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0324a-fcc1-4889-b464-e18a63279c5b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:42.605713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0539a-5f24-464d-af28-4d02c1bfbf5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:42.605824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0324a-fcc1-4889-b464-e18a63279c5b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:42.605912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0539a-5f24-464d-af28-4d02c1bfbf5f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-86f0324a-fcc1-4889-b464-e18a63279c5b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:42.616199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:42.617312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:42.618194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:42.618194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:42.618194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:42.618194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:42.618194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:42.618194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:42.618194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:42.618194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:42.618194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 12:53:42.618194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:42.618194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 265/522] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:42.618194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0324a-fcc1-4889-b464-e18a63279c5b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:42.704557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 258/523] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:42.705504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0539a-5f24-464d-af28-4d02c1bfbf5f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:42.716534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0324a-fcc1-4889-b464-e18a63279c5b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:42.740439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:42.751608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666573a6-0b50-4d3a-aad8-793b3baa85e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:42.752351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666573a6-0b50-4d3a-aad8-793b3baa85e6 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:42.752733 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666573a6-0b50-4d3a-aad8-793b3baa85e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:42.753015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666573a6-0b50-4d3a-aad8-793b3baa85e6 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:42.753707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666573a6-0b50-4d3a-aad8-793b3baa85e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:42.755143 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666573a6-0b50-4d3a-aad8-793b3baa85e6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:42.794029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:42.802223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0539a-5f24-464d-af28-4d02c1bfbf5f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:42.834710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1922b73-6367-4931-a760-8070b6a2418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:42.835366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1922b73-6367-4931-a760-8070b6a2418f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:42.835653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1922b73-6367-4931-a760-8070b6a2418f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:42.835934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1922b73-6367-4931-a760-8070b6a2418f None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:42.836653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1922b73-6367-4931-a760-8070b6a2418f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:42.836991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1922b73-6367-4931-a760-8070b6a2418f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:42.838348 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1922b73-6367-4931-a760-8070b6a2418f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:42.849758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 259/524] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:42.850522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1922b73-6367-4931-a760-8070b6a2418f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:42.861912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 266/525] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:53:42 2022] POST /identity/v3/users => generated 247 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:53:42.862648 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666573a6-0b50-4d3a-aad8-793b3baa85e6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:42.962982 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1922b73-6367-4931-a760-8070b6a2418f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:42.970324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666573a6-0b50-4d3a-aad8-793b3baa85e6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:42.999586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002557e-a2f0-48ee-aa58-ab203dedf742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.000255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002557e-a2f0-48ee-aa58-ab203dedf742 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.000539 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002557e-a2f0-48ee-aa58-ab203dedf742 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.000892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002557e-a2f0-48ee-aa58-ab203dedf742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.001741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002557e-a2f0-48ee-aa58-ab203dedf742 None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=5874e98df57242028c0f9983dee3b5e8) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:43.002056 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002557e-a2f0-48ee-aa58-ab203dedf742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.003504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002557e-a2f0-48ee-aa58-ab203dedf742 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:43.008439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c0114-96a8-4c13-b409-96e663c7df27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.009407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c0114-96a8-4c13-b409-96e663c7df27 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.009947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 260/526] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:42 2022] GET /identity/v3/role_assignments?user.id=5874e98df57242028c0f9983dee3b5e8&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:43.010321 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c0114-96a8-4c13-b409-96e663c7df27 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.010603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c0114-96a8-4c13-b409-96e663c7df27 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.010703 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002557e-a2f0-48ee-aa58-ab203dedf742 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.011448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c0114-96a8-4c13-b409-96e663c7df27 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:43.011756 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c0114-96a8-4c13-b409-96e663c7df27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.013361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c0114-96a8-4c13-b409-96e663c7df27 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:43.041093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:43.043283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 267/527] 10.222.0.33 () {56 vars in 1139 bytes} [Thu Jun 23 12:53:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:43.044320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c0114-96a8-4c13-b409-96e663c7df27 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.098923 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:43.162179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002557e-a2f0-48ee-aa58-ab203dedf742 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:43.200295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c0114-96a8-4c13-b409-96e663c7df27 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:43.203502 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8c25b-70a8-4960-b1a9-77a191ddb6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.204345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8c25b-70a8-4960-b1a9-77a191ddb6cf None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.204635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8c25b-70a8-4960-b1a9-77a191ddb6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.204963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8c25b-70a8-4960-b1a9-77a191ddb6cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.218447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8c25b-70a8-4960-b1a9-77a191ddb6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.220985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8c25b-70a8-4960-b1a9-77a191ddb6cf None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:43.238556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa40567-7d31-4299-9476-985f7642fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.239368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40567-7d31-4299-9476-985f7642fb7e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.239661 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40567-7d31-4299-9476-985f7642fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.239950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40567-7d31-4299-9476-985f7642fb7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-f4a8c25b-70a8-4960-b1a9-77a191ddb6cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:43.242393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:43.243244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:43.244110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:43.244110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:43.244110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:43.244110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:43.244110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 261/528] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:43.244994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8c25b-70a8-4960-b1a9-77a191ddb6cf None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.247365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa40567-7d31-4299-9476-985f7642fb7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.249165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa40567-7d31-4299-9476-985f7642fb7e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-7aa40567-7d31-4299-9476-985f7642fb7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:43.264469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:43.265415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:43.266245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:43.266245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:43.266245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:43.266245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:43.266245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:43.266245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:43.266245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:43.266245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:43.266245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 268/529] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:43.271204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa40567-7d31-4299-9476-985f7642fb7e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.317580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:43.353852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8c25b-70a8-4960-b1a9-77a191ddb6cf None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:43.389677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd57652-bb85-4b4d-bfad-05a56f72b5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.390382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd57652-bb85-4b4d-bfad-05a56f72b5ff None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.390662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd57652-bb85-4b4d-bfad-05a56f72b5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.390941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd57652-bb85-4b4d-bfad-05a56f72b5ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.391149 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:43.398747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa40567-7d31-4299-9476-985f7642fb7e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:43.440527 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b379e0-a853-425b-b5ce-b118ebd4ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.441601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b379e0-a853-425b-b5ce-b118ebd4ff68 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.442431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b379e0-a853-425b-b5ce-b118ebd4ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.443008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b379e0-a853-425b-b5ce-b118ebd4ff68 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.443993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b379e0-a853-425b-b5ce-b118ebd4ff68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:43.444625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b379e0-a853-425b-b5ce-b118ebd4ff68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.446485 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b379e0-a853-425b-b5ce-b118ebd4ff68 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:43.460113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 269/530] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:43.461055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b379e0-a853-425b-b5ce-b118ebd4ff68 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.467545 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd57652-bb85-4b4d-bfad-05a56f72b5ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.469255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd57652-bb85-4b4d-bfad-05a56f72b5ff None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:43.554399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:43.577395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b379e0-a853-425b-b5ce-b118ebd4ff68 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:43.586750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 262/531] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:43.587862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd57652-bb85-4b4d-bfad-05a56f72b5ff None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.622405 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d061c-690e-4da4-83d5-a91d0dd07675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.623202 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d061c-690e-4da4-83d5-a91d0dd07675 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.623841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d061c-690e-4da4-83d5-a91d0dd07675 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.624189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d061c-690e-4da4-83d5-a91d0dd07675 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.625092 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d061c-690e-4da4-83d5-a91d0dd07675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:43.625591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d061c-690e-4da4-83d5-a91d0dd07675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.627713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d061c-690e-4da4-83d5-a91d0dd07675 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:43.647747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 270/532] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:43.647747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d061c-690e-4da4-83d5-a91d0dd07675 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.697118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:43.717763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd57652-bb85-4b4d-bfad-05a56f72b5ff None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:43.757689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd29dc-3345-4eac-ae50-83393211035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.758762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd29dc-3345-4eac-ae50-83393211035f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.759052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd29dc-3345-4eac-ae50-83393211035f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.759337 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd29dc-3345-4eac-ae50-83393211035f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.761024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d061c-690e-4da4-83d5-a91d0dd07675 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:43.768327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd29dc-3345-4eac-ae50-83393211035f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.770373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd29dc-3345-4eac-ae50-83393211035f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-4ccd29dc-3345-4eac-ae50-83393211035f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:43.789761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:43.790642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:43.792081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:43.792081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:43.792081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:43.792081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:43.792081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:43.792081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:43.792081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:43.792081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:43.792081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 263/533] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:43.792081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd29dc-3345-4eac-ae50-83393211035f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.802375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e9566-5d9a-413c-bbf4-6e3d8e2f1e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.803452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e9566-5d9a-413c-bbf4-6e3d8e2f1e86 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.803957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e9566-5d9a-413c-bbf4-6e3d8e2f1e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.804452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e9566-5d9a-413c-bbf4-6e3d8e2f1e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.815871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e9566-5d9a-413c-bbf4-6e3d8e2f1e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.817567 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e9566-5d9a-413c-bbf4-6e3d8e2f1e86 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:43.829024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-0a1e9566-5d9a-413c-bbf4-6e3d8e2f1e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:43.836404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:43.846482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:43.847317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:43.847317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:43.847317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:43.847317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:43.847317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 271/534] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:43.847317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e9566-5d9a-413c-bbf4-6e3d8e2f1e86 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.914636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:43.926160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd29dc-3345-4eac-ae50-83393211035f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:43.949496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e9566-5d9a-413c-bbf4-6e3d8e2f1e86 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:43.972601 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2a683-1def-4fea-97ae-ff311570fbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.974226 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2a683-1def-4fea-97ae-ff311570fbbb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.974664 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2a683-1def-4fea-97ae-ff311570fbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.975332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2a683-1def-4fea-97ae-ff311570fbbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.976683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2a683-1def-4fea-97ae-ff311570fbbb None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=711d53a7deb94849b577c08dc9165ec8) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:43.977558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2a683-1def-4fea-97ae-ff311570fbbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.979668 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2a683-1def-4fea-97ae-ff311570fbbb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:43.986087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f454aa-a04a-4137-9e18-ab9f09c177ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.986823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f454aa-a04a-4137-9e18-ab9f09c177ce None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.987176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f454aa-a04a-4137-9e18-ab9f09c177ce None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.987383 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 264/535] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/role_assignments?user.id=711d53a7deb94849b577c08dc9165ec8&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:43.987736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f454aa-a04a-4137-9e18-ab9f09c177ce None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.988466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2a683-1def-4fea-97ae-ff311570fbbb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.989749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f454aa-a04a-4137-9e18-ab9f09c177ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:43.997246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f454aa-a04a-4137-9e18-ab9f09c177ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.998961 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f454aa-a04a-4137-9e18-ab9f09c177ce None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:44.021278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 272/536] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:44.027506 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f454aa-a04a-4137-9e18-ab9f09c177ce None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:44.169650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:44.182421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2a683-1def-4fea-97ae-ff311570fbbb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:44.226767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4695e8-4633-4ae4-a9f3-2fdfb0a48f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:44.227509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4695e8-4633-4ae4-a9f3-2fdfb0a48f4f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:44.227733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4695e8-4633-4ae4-a9f3-2fdfb0a48f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:44.228015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4695e8-4633-4ae4-a9f3-2fdfb0a48f4f None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:44.228947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4695e8-4633-4ae4-a9f3-2fdfb0a48f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:44.229370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4695e8-4633-4ae4-a9f3-2fdfb0a48f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:44.231033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4695e8-4633-4ae4-a9f3-2fdfb0a48f4f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:44.249472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 265/537] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:44.250128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f454aa-a04a-4137-9e18-ab9f09c177ce None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:44.255313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4695e8-4633-4ae4-a9f3-2fdfb0a48f4f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:44.299018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:44.313666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35115b40-23f1-4cd6-8bed-35d8a0881366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:44.314782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35115b40-23f1-4cd6-8bed-35d8a0881366 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:44.316486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35115b40-23f1-4cd6-8bed-35d8a0881366 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:44.317446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35115b40-23f1-4cd6-8bed-35d8a0881366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:44.318493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35115b40-23f1-4cd6-8bed-35d8a0881366 None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=c1c0a73d629a47e4bdbd67da236240af) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:44.319336 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35115b40-23f1-4cd6-8bed-35d8a0881366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:44.321831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35115b40-23f1-4cd6-8bed-35d8a0881366 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:44.338069 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 273/538] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:44 2022] GET /identity/v3/role_assignments?user.id=c1c0a73d629a47e4bdbd67da236240af&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:44.430013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4695e8-4633-4ae4-a9f3-2fdfb0a48f4f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:44.476317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487246a-c6ee-4eef-b618-64531c082a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:44.477172 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487246a-c6ee-4eef-b618-64531c082a35 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:44.477514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487246a-c6ee-4eef-b618-64531c082a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:44.477794 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487246a-c6ee-4eef-b618-64531c082a35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:44.486027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487246a-c6ee-4eef-b618-64531c082a35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:44.487505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487246a-c6ee-4eef-b618-64531c082a35 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-6487246a-c6ee-4eef-b618-64531c082a35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:44.501844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:44.502772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:44.503594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:44.503594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:44.503594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:44.503594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:44.503594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:44.503594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:44.503594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:44.503594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:44.503594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 266/539] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:44.508717 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35115b40-23f1-4cd6-8bed-35d8a0881366 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:44.641051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35115b40-23f1-4cd6-8bed-35d8a0881366 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:44.684145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3a69a-bfeb-42aa-bbd6-9833d1756a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:44.685219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3a69a-bfeb-42aa-bbd6-9833d1756a1c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:44.685706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3a69a-bfeb-42aa-bbd6-9833d1756a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:44.686204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3a69a-bfeb-42aa-bbd6-9833d1756a1c None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:44.687209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3a69a-bfeb-42aa-bbd6-9833d1756a1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:44.687721 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3a69a-bfeb-42aa-bbd6-9833d1756a1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:44.689954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3a69a-bfeb-42aa-bbd6-9833d1756a1c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:44.707381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 274/540] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:44.712852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487246a-c6ee-4eef-b618-64531c082a35 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:44.739574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:44.830537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487246a-c6ee-4eef-b618-64531c082a35 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:44.866269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ab71d-0e79-479d-93a1-53145a15cff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:44.866931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ab71d-0e79-479d-93a1-53145a15cff5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:44.867223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ab71d-0e79-479d-93a1-53145a15cff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:44.867507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ab71d-0e79-479d-93a1-53145a15cff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:44.868344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ab71d-0e79-479d-93a1-53145a15cff5 None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=b1eb257517674c63840d6a2090eb2200) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:44.868682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ab71d-0e79-479d-93a1-53145a15cff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:44.870118 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ab71d-0e79-479d-93a1-53145a15cff5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:44.876743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 267/541] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:44 2022] GET /identity/v3/role_assignments?user.id=b1eb257517674c63840d6a2090eb2200&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:45.157247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd881-e2c1-4c1e-95e2-397f6c47e9f2 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:45.157645 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd881-e2c1-4c1e-95e2-397f6c47e9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:45.158004 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd881-e2c1-4c1e-95e2-397f6c47e9f2 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:45.159739 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 275/542] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:45.165085 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba325a-b17a-4184-8a5c-e76b4b3617e6 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:45.165625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba325a-b17a-4184-8a5c-e76b4b3617e6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:45.166122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba325a-b17a-4184-8a5c-e76b4b3617e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:45.185533 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-50ba325a-b17a-4184-8a5c-e76b4b3617e6 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:45.187092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-50ba325a-b17a-4184-8a5c-e76b4b3617e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:45.194061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca0cf3-43ce-43f0-9816-8bb4a570a304 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:45.194364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca0cf3-43ce-43f0-9816-8bb4a570a304 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:45.194623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca0cf3-43ce-43f0-9816-8bb4a570a304 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:45.196115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 276/543] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:53:45.201533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af0a55-c531-4e78-8274-38fef8813c48 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:45.202053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af0a55-c531-4e78-8274-38fef8813c48 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:45.202650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af0a55-c531-4e78-8274-38fef8813c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:45.223123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-35af0a55-c531-4e78-8274-38fef8813c48 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:45.224756 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-35af0a55-c531-4e78-8274-38fef8813c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:45.282955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:45.306010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 277/544] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:45.322420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 268/545] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:45.330326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af0a55-c531-4e78-8274-38fef8813c48 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:45.370082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba325a-b17a-4184-8a5c-e76b4b3617e6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:45.389023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:45.438968 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af0a55-c531-4e78-8274-38fef8813c48 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:45.477513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a4b96-8f05-4519-8537-3b533e4bfe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:45.478403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a4b96-8f05-4519-8537-3b533e4bfe92 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:45.478691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a4b96-8f05-4519-8537-3b533e4bfe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:45.478965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a4b96-8f05-4519-8537-3b533e4bfe92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:45.492984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a4b96-8f05-4519-8537-3b533e4bfe92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d37a4b96-8f05-4519-8537-3b533e4bfe92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:45.502650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:45.503550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:45.504338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 278/546] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:45.510423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a4b96-8f05-4519-8537-3b533e4bfe92 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:45.562712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:45.607495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba325a-b17a-4184-8a5c-e76b4b3617e6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:45.656842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a4b96-8f05-4519-8537-3b533e4bfe92 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:45.674538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9888a84-bcb5-4246-b568-c377968ed413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:45.675617 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9888a84-bcb5-4246-b568-c377968ed413 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:45.676100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9888a84-bcb5-4246-b568-c377968ed413 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:45.676591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9888a84-bcb5-4246-b568-c377968ed413 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:45.700944 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9888a84-bcb5-4246-b568-c377968ed413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:45.706252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876ccce-fb06-4eb6-9bf3-66c90a6c24a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:45.706922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876ccce-fb06-4eb6-9bf3-66c90a6c24a9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:45.707260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876ccce-fb06-4eb6-9bf3-66c90a6c24a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:45.707548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876ccce-fb06-4eb6-9bf3-66c90a6c24a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:45.708371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876ccce-fb06-4eb6-9bf3-66c90a6c24a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:45.716764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876ccce-fb06-4eb6-9bf3-66c90a6c24a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:45.716764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876ccce-fb06-4eb6-9bf3-66c90a6c24a9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:45.718650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 279/547] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-d9888a84-bcb5-4246-b568-c377968ed413 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:45.719231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:45.720737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:45.721526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:45.721526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:45.721526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:45.721526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:45.721526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:45.721526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:45.721526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:45.721526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:45.721526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:45.721526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:45.721526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:45.721526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:45.724595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876ccce-fb06-4eb6-9bf3-66c90a6c24a9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:45.724858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 269/548] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:45.730138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9888a84-bcb5-4246-b568-c377968ed413 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:45.822277 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:45.861873 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9888a84-bcb5-4246-b568-c377968ed413 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:45.863724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876ccce-fb06-4eb6-9bf3-66c90a6c24a9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:45.874479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:45.902957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f313303-2cc0-4695-86af-4907e2b8cd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:45.904895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f313303-2cc0-4695-86af-4907e2b8cd4f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:45.906056 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f313303-2cc0-4695-86af-4907e2b8cd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:45.906695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f313303-2cc0-4695-86af-4907e2b8cd4f None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:45.907806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f313303-2cc0-4695-86af-4907e2b8cd4f None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:45.910912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f313303-2cc0-4695-86af-4907e2b8cd4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:45.912866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f313303-2cc0-4695-86af-4907e2b8cd4f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:45.928732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 270/549] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:45.932711 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f313303-2cc0-4695-86af-4907e2b8cd4f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:45.950098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cecbd9-ec18-4c46-a886-87a25b7157ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:45.950899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cecbd9-ec18-4c46-a886-87a25b7157ef None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:45.951182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cecbd9-ec18-4c46-a886-87a25b7157ef None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:45.951458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cecbd9-ec18-4c46-a886-87a25b7157ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:45.972590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cecbd9-ec18-4c46-a886-87a25b7157ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:45.974063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cecbd9-ec18-4c46-a886-87a25b7157ef None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a4cecbd9-ec18-4c46-a886-87a25b7157ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:46.010389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:46.011351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:46.012868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:46.012868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:46.012868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:46.012868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:46.012868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 280/550] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:46.017939 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cecbd9-ec18-4c46-a886-87a25b7157ef None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:46.122229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f313303-2cc0-4695-86af-4907e2b8cd4f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:46.175004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:46.180977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cecbd9-ec18-4c46-a886-87a25b7157ef None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:46.192947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433d8e6-de12-4369-b8fe-b94d27e4d851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:46.194018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d8e6-de12-4369-b8fe-b94d27e4d851 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.194989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d8e6-de12-4369-b8fe-b94d27e4d851 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.194989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d8e6-de12-4369-b8fe-b94d27e4d851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.212224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433d8e6-de12-4369-b8fe-b94d27e4d851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:46.215147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433d8e6-de12-4369-b8fe-b94d27e4d851 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-1433d8e6-de12-4369-b8fe-b94d27e4d851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:46.249102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:46.250130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:46.251505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:46.251505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:46.251505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:46.251505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:46.253425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7c03c-2e21-4dff-b996-0d426c35cf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:46.254367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7c03c-2e21-4dff-b996-0d426c35cf74 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.254849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7c03c-2e21-4dff-b996-0d426c35cf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.255318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7c03c-2e21-4dff-b996-0d426c35cf74 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.256258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7c03c-2e21-4dff-b996-0d426c35cf74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:46.256794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7c03c-2e21-4dff-b996-0d426c35cf74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:46.258346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 271/551] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:46.258719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7c03c-2e21-4dff-b996-0d426c35cf74 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:46.263433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433d8e6-de12-4369-b8fe-b94d27e4d851 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:46.276651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 281/552] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:46.283057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7c03c-2e21-4dff-b996-0d426c35cf74 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:46.320728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:46.452436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433d8e6-de12-4369-b8fe-b94d27e4d851 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:46.478291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7c03c-2e21-4dff-b996-0d426c35cf74 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:46.493253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c55853-6277-4d57-8c1c-ab1ccd92525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:46.494257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55853-6277-4d57-8c1c-ab1ccd92525c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.494763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55853-6277-4d57-8c1c-ab1ccd92525c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.495238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55853-6277-4d57-8c1c-ab1ccd92525c None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.496154 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c55853-6277-4d57-8c1c-ab1ccd92525c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:46.496690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c55853-6277-4d57-8c1c-ab1ccd92525c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:46.498363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c55853-6277-4d57-8c1c-ab1ccd92525c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:46.515582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 272/553] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:46.516500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1db26-716a-4047-8682-f580c4fae1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:46.517310 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1db26-716a-4047-8682-f580c4fae1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.517593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1db26-716a-4047-8682-f580c4fae1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.517870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1db26-716a-4047-8682-f580c4fae1c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.518292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1f187-15bb-4cf7-99e5-bcc5a9b40b5c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.518773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1f187-15bb-4cf7-99e5-bcc5a9b40b5c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.519245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1f187-15bb-4cf7-99e5-bcc5a9b40b5c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.520716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 273/554] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:46.522157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1f187-15bb-4cf7-99e5-bcc5a9b40b5c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:46.531428 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1db26-716a-4047-8682-f580c4fae1c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:46.532942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1db26-716a-4047-8682-f580c4fae1c6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d7b1db26-716a-4047-8682-f580c4fae1c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:46.549549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:46.550495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:46.551400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:46.551400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:46.551400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:46.551400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:46.551400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:46.551400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:46.551400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:46.551400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:46.551400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:53:46.551400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:46.554084 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 282/555] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 23 12:53:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:46.555589 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e83bbf-1b2b-4949-8224-4f55b15a971c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.556073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e83bbf-1b2b-4949-8224-4f55b15a971c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.556560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e83bbf-1b2b-4949-8224-4f55b15a971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.574556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a4e83bbf-1b2b-4949-8224-4f55b15a971c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:46.576209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a4e83bbf-1b2b-4949-8224-4f55b15a971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:46.597112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:46.648407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 283/556] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:46.649666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e83bbf-1b2b-4949-8224-4f55b15a971c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:46.653852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1f187-15bb-4cf7-99e5-bcc5a9b40b5c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:46.666803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:46.712635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e0c1-13ea-4836-80d9-8e667a907424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:46.714324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e0c1-13ea-4836-80d9-8e667a907424 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.714755 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e0c1-13ea-4836-80d9-8e667a907424 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.715426 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e0c1-13ea-4836-80d9-8e667a907424 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.725040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e0c1-13ea-4836-80d9-8e667a907424 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:46.726799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e0c1-13ea-4836-80d9-8e667a907424 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8124e0c1-13ea-4836-80d9-8e667a907424 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:46.743949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:46.745078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:46.746579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:46.746579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:46.746579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:46.746579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:46.746579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:46.746579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:46.746579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:46.746579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:46.746579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:53:46.746579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:46.748906 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 274/557] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:46.749814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e0c1-13ea-4836-80d9-8e667a907424 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:46.772526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e83bbf-1b2b-4949-8224-4f55b15a971c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:46.808396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7bc35-88c1-47ee-92a8-8b41412672d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:46.809099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7bc35-88c1-47ee-92a8-8b41412672d1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.809384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7bc35-88c1-47ee-92a8-8b41412672d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.809660 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7bc35-88c1-47ee-92a8-8b41412672d1 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.810491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7bc35-88c1-47ee-92a8-8b41412672d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:46.810807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7bc35-88c1-47ee-92a8-8b41412672d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:46.812226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7bc35-88c1-47ee-92a8-8b41412672d1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:46.835479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 284/558] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 23 12:53:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:46.836904 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b92ce6-888f-45a6-a498-7427ee79bb4f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.837195 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b92ce6-888f-45a6-a498-7427ee79bb4f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.837475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b92ce6-888f-45a6-a498-7427ee79bb4f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.838735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 285/559] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:46.839418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b92ce6-888f-45a6-a498-7427ee79bb4f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:46.858469 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:46.862491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e0c1-13ea-4836-80d9-8e667a907424 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:46.898642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317df2c-c4e9-4c72-ba2f-063d2c08a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:46.899439 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317df2c-c4e9-4c72-ba2f-063d2c08a356 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.899722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317df2c-c4e9-4c72-ba2f-063d2c08a356 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.900000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317df2c-c4e9-4c72-ba2f-063d2c08a356 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.905773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:46.911591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317df2c-c4e9-4c72-ba2f-063d2c08a356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-9317df2c-c4e9-4c72-ba2f-063d2c08a356 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:46.919153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:46.920372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 275/560] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:46.921216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317df2c-c4e9-4c72-ba2f-063d2c08a356 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:46.952197 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b92ce6-888f-45a6-a498-7427ee79bb4f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:46.987055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91acedf-a936-497c-a0ee-ff0511dfa5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:46.987642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91acedf-a936-497c-a0ee-ff0511dfa5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.987924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91acedf-a936-497c-a0ee-ff0511dfa5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.988201 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91acedf-a936-497c-a0ee-ff0511dfa5a7 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.989058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91acedf-a936-497c-a0ee-ff0511dfa5a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:46.989368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91acedf-a936-497c-a0ee-ff0511dfa5a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:46.990799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91acedf-a936-497c-a0ee-ff0511dfa5a7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.007547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 286/561] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jun 23 12:53:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:47.008792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080252-482f-4578-8a1e-16b5e509e442 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.009078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080252-482f-4578-8a1e-16b5e509e442 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.009352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080252-482f-4578-8a1e-16b5e509e442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.025644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7c080252-482f-4578-8a1e-16b5e509e442 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:47.026824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7c080252-482f-4578-8a1e-16b5e509e442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:47.033430 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317df2c-c4e9-4c72-ba2f-063d2c08a356 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.068846 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2b995-be8b-4139-8036-2752748b7bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.069643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2b995-be8b-4139-8036-2752748b7bac None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.069923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2b995-be8b-4139-8036-2752748b7bac None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.070201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2b995-be8b-4139-8036-2752748b7bac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.081151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2b995-be8b-4139-8036-2752748b7bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:47.082537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2b995-be8b-4139-8036-2752748b7bac None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-7af2b995-be8b-4139-8036-2752748b7bac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:47.100072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:47.105872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:47.106994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:47.106994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:47.106994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:47.106994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:47.106994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 276/562] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:47.106994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2b995-be8b-4139-8036-2752748b7bac None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.110248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 287/563] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:47.111315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080252-482f-4578-8a1e-16b5e509e442 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.123901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:47.171906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:47.209634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2b995-be8b-4139-8036-2752748b7bac None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.221061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080252-482f-4578-8a1e-16b5e509e442 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.244530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648c771-d94b-4191-903a-76b456126654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.245167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648c771-d94b-4191-903a-76b456126654 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.245450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648c771-d94b-4191-903a-76b456126654 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.245727 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648c771-d94b-4191-903a-76b456126654 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.246463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648c771-d94b-4191-903a-76b456126654 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:47.246772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648c771-d94b-4191-903a-76b456126654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:47.248149 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648c771-d94b-4191-903a-76b456126654 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.256587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8812ab-1352-4ddc-bef0-382f681a4d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.257452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8812ab-1352-4ddc-bef0-382f681a4d94 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.257736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8812ab-1352-4ddc-bef0-382f681a4d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.258008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 277/564] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:47.258396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8812ab-1352-4ddc-bef0-382f681a4d94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.264072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648c771-d94b-4191-903a-76b456126654 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.337680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8812ab-1352-4ddc-bef0-382f681a4d94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:47.339153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8812ab-1352-4ddc-bef0-382f681a4d94 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.341252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:47.368714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648c771-d94b-4191-903a-76b456126654 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.390679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:47.406074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13576af0-3d26-44b7-8e93-e11a5a26d5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.406744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13576af0-3d26-44b7-8e93-e11a5a26d5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.407085 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13576af0-3d26-44b7-8e93-e11a5a26d5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.407371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13576af0-3d26-44b7-8e93-e11a5a26d5d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.408094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13576af0-3d26-44b7-8e93-e11a5a26d5d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:47.408408 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13576af0-3d26-44b7-8e93-e11a5a26d5d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:47.409856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13576af0-3d26-44b7-8e93-e11a5a26d5d5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.421452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 278/565] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:47.422236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13576af0-3d26-44b7-8e93-e11a5a26d5d5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.443730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 288/566] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:47.443730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8812ab-1352-4ddc-bef0-382f681a4d94 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.523574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13576af0-3d26-44b7-8e93-e11a5a26d5d5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.533194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8812ab-1352-4ddc-bef0-382f681a4d94 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.556860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc30cfe-8026-4430-bcac-dfbbf0d92eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.557857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30cfe-8026-4430-bcac-dfbbf0d92eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.558297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30cfe-8026-4430-bcac-dfbbf0d92eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.558566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30cfe-8026-4430-bcac-dfbbf0d92eb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.560361 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:47.566461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae7b50-af01-4609-8d3d-377a00654201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.587868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae7b50-af01-4609-8d3d-377a00654201 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.587868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae7b50-af01-4609-8d3d-377a00654201 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.587868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae7b50-af01-4609-8d3d-377a00654201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc30cfe-8026-4430-bcac-dfbbf0d92eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-bcc30cfe-8026-4430-bcac-dfbbf0d92eb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:47.588104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:47.588936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:47.589796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:47.590529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae7b50-af01-4609-8d3d-377a00654201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:47.590598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 279/567] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:47.590664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae7b50-af01-4609-8d3d-377a00654201 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.590729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526fbeb-e916-4cf8-97bb-53c8821c606e None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.590729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526fbeb-e916-4cf8-97bb-53c8821c606e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.590729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526fbeb-e916-4cf8-97bb-53c8821c606e None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.590729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 280/568] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:47.590729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526fbeb-e916-4cf8-97bb-53c8821c606e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-18ae7b50-af01-4609-8d3d-377a00654201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:47.599222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:47.600394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:47.606628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:47.606628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:47.606628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:47.606628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:47.606628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 289/569] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:47.606628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae7b50-af01-4609-8d3d-377a00654201 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.606628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:47.684074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526fbeb-e916-4cf8-97bb-53c8821c606e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.700326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae7b50-af01-4609-8d3d-377a00654201 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.716620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907db4d3-8faf-47b5-978a-5dc0d75794be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.717434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907db4d3-8faf-47b5-978a-5dc0d75794be None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.717721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907db4d3-8faf-47b5-978a-5dc0d75794be None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.718029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907db4d3-8faf-47b5-978a-5dc0d75794be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.725438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907db4d3-8faf-47b5-978a-5dc0d75794be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:47.726875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907db4d3-8faf-47b5-978a-5dc0d75794be None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.732539 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd397c-079d-42db-a2a5-4e837a4e6abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.733365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd397c-079d-42db-a2a5-4e837a4e6abf None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.733647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd397c-079d-42db-a2a5-4e837a4e6abf None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.733920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd397c-079d-42db-a2a5-4e837a4e6abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-907db4d3-8faf-47b5-978a-5dc0d75794be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:47.742073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:47.760159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:47.761236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:47.761236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:47.761236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:47.761236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:47.761236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:47.761236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:47.761236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:47.761236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:47.761236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 281/570] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:47.761236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907db4d3-8faf-47b5-978a-5dc0d75794be None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.761768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd397c-079d-42db-a2a5-4e837a4e6abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:47.761768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd397c-079d-42db-a2a5-4e837a4e6abf None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-34fd397c-079d-42db-a2a5-4e837a4e6abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:47.764055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:47.765155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:47.766100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:47.766100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:47.766100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:47.766100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:47.766100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 290/571] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:47.766517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942724-663f-4c6e-b0e8-c883d7a50e95 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.766801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942724-663f-4c6e-b0e8-c883d7a50e95 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.767073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942724-663f-4c6e-b0e8-c883d7a50e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.783770 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5a942724-663f-4c6e-b0e8-c883d7a50e95 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:47.785019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5a942724-663f-4c6e-b0e8-c883d7a50e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:47.805103 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:47.835089 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:47.848390 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907db4d3-8faf-47b5-978a-5dc0d75794be None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.851226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 291/572] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:47.851984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a942724-663f-4c6e-b0e8-c883d7a50e95 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.882975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991559e-0862-477a-b813-2e2cb0a475a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.883636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991559e-0862-477a-b813-2e2cb0a475a0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.883922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991559e-0862-477a-b813-2e2cb0a475a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.884196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991559e-0862-477a-b813-2e2cb0a475a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.884980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991559e-0862-477a-b813-2e2cb0a475a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:47.885289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991559e-0862-477a-b813-2e2cb0a475a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:47.886654 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991559e-0862-477a-b813-2e2cb0a475a0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.894517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 282/573] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:47.895302 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991559e-0862-477a-b813-2e2cb0a475a0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.954930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a942724-663f-4c6e-b0e8-c883d7a50e95 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.988387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de0980-6315-4323-b00a-aae87be4bf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.989082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0980-6315-4323-b00a-aae87be4bf5d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.989374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0980-6315-4323-b00a-aae87be4bf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.989651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0980-6315-4323-b00a-aae87be4bf5d None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.990373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de0980-6315-4323-b00a-aae87be4bf5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:47.990681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de0980-6315-4323-b00a-aae87be4bf5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:47.992032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de0980-6315-4323-b00a-aae87be4bf5d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.994584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991559e-0862-477a-b813-2e2cb0a475a0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:48.003247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 292/574] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:48.004026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de0980-6315-4323-b00a-aae87be4bf5d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:48.011120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:48.028110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c369c9d-77f2-4cee-843f-b9164fdc746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:48.039899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c369c9d-77f2-4cee-843f-b9164fdc746c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:48.039899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c369c9d-77f2-4cee-843f-b9164fdc746c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:48.039899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c369c9d-77f2-4cee-843f-b9164fdc746c None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:48.039899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c369c9d-77f2-4cee-843f-b9164fdc746c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:48.039899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c369c9d-77f2-4cee-843f-b9164fdc746c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:48.039899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c369c9d-77f2-4cee-843f-b9164fdc746c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:48.049234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 283/575] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:48.050027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c369c9d-77f2-4cee-843f-b9164fdc746c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:48.057726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:48.111778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de0980-6315-4323-b00a-aae87be4bf5d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:48.144184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc66431-9e84-4098-810d-ba14bc67efd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:48.144865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc66431-9e84-4098-810d-ba14bc67efd6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:48.145158 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc66431-9e84-4098-810d-ba14bc67efd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:48.145434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc66431-9e84-4098-810d-ba14bc67efd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:48.146158 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc66431-9e84-4098-810d-ba14bc67efd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:48.146474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc66431-9e84-4098-810d-ba14bc67efd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:48.148440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc66431-9e84-4098-810d-ba14bc67efd6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:48.148759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c369c9d-77f2-4cee-843f-b9164fdc746c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:48.159801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 293/576] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:48.160593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc66431-9e84-4098-810d-ba14bc67efd6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:48.185202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986599b-ca50-4d9c-8c00-ef16e2032f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:48.186002 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986599b-ca50-4d9c-8c00-ef16e2032f78 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:48.186286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986599b-ca50-4d9c-8c00-ef16e2032f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:48.186563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986599b-ca50-4d9c-8c00-ef16e2032f78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:48.197048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986599b-ca50-4d9c-8c00-ef16e2032f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-e986599b-ca50-4d9c-8c00-ef16e2032f78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:48.204852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:48.205788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:48.206609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 284/577] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:48.207280 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986599b-ca50-4d9c-8c00-ef16e2032f78 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:48.241016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:48.264294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc66431-9e84-4098-810d-ba14bc67efd6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:48.272079 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:48.297931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee7dd1-5392-4cc4-9afd-296c493a55a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:48.298646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee7dd1-5392-4cc4-9afd-296c493a55a1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:48.298926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee7dd1-5392-4cc4-9afd-296c493a55a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:48.299204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee7dd1-5392-4cc4-9afd-296c493a55a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:48.305141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986599b-ca50-4d9c-8c00-ef16e2032f78 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:48.309508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee7dd1-5392-4cc4-9afd-296c493a55a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:48.310922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee7dd1-5392-4cc4-9afd-296c493a55a1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-60ee7dd1-5392-4cc4-9afd-296c493a55a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:48.328370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:48.329505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:48.330573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:48.330573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:48.330573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:48.330573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:48.330573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 294/578] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:48.330573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee7dd1-5392-4cc4-9afd-296c493a55a1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:48.342557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4861-c4bb-4315-b581-f0a3215eb83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:48.343355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4861-c4bb-4315-b581-f0a3215eb83d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:48.343643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4861-c4bb-4315-b581-f0a3215eb83d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:48.343925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4861-c4bb-4315-b581-f0a3215eb83d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:48.351417 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de4861-c4bb-4315-b581-f0a3215eb83d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:48.352908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de4861-c4bb-4315-b581-f0a3215eb83d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-38de4861-c4bb-4315-b581-f0a3215eb83d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:48.367289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:48.368201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:48.369202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:48.369202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:48.369202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:48.369202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:48.369202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:48.369202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:48.369202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:48.369202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:48.369202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 12:53:48.369202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:48.369202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 285/579] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:48.369785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4861-c4bb-4315-b581-f0a3215eb83d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:48.431130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee7dd1-5392-4cc4-9afd-296c493a55a1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:48.463009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:48.463867 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bb97b-2eda-4017-8485-77f12db228d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:48.464722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bb97b-2eda-4017-8485-77f12db228d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:48.465011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bb97b-2eda-4017-8485-77f12db228d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:48.465291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bb97b-2eda-4017-8485-77f12db228d9 None admin] PATH_INFO: `/v3/projects/311787f32b54485682be669bca9998f8/users/5874e98df57242028c0f9983dee3b5e8/roles/af902c13373445999fcf70be57ba260f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:48.468922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4861-c4bb-4315-b581-f0a3215eb83d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:48.482003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bb97b-2eda-4017-8485-77f12db228d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=311787f32b54485682be669bca9998f8, user_id=5874e98df57242028c0f9983dee3b5e8, role_id=af902c13373445999fcf70be57ba260f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:48.483631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bb97b-2eda-4017-8485-77f12db228d9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:48.502684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed91270-36fd-49c3-b050-a6ee4640f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:48.503459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed91270-36fd-49c3-b050-a6ee4640f474 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:48.503748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed91270-36fd-49c3-b050-a6ee4640f474 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:48.504027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed91270-36fd-49c3-b050-a6ee4640f474 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:48.510531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed91270-36fd-49c3-b050-a6ee4640f474 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:48.511978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed91270-36fd-49c3-b050-a6ee4640f474 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-5ed91270-36fd-49c3-b050-a6ee4640f474 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:48.526186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:48.530667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:48.531758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:48.531758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:48.531758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:48.531758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:48.531758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:48.531758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:48.531758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:48.531758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:48.531758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 286/580] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:48.531758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed91270-36fd-49c3-b050-a6ee4640f474 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:48.553412 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 295/581] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:48 2022] PUT /identity/v3/projects/311787f32b54485682be669bca9998f8/users/5874e98df57242028c0f9983dee3b5e8/roles/af902c13373445999fcf70be57ba260f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:48.554421 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bb97b-2eda-4017-8485-77f12db228d9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:48.567309 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:48.642707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed91270-36fd-49c3-b050-a6ee4640f474 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:48.671178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bb97b-2eda-4017-8485-77f12db228d9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:48.681779 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f8760-072e-4517-b561-929495f27bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:48.682547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f8760-072e-4517-b561-929495f27bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:48.682740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f8760-072e-4517-b561-929495f27bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:48.683020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f8760-072e-4517-b561-929495f27bf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:48.683786 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f8760-072e-4517-b561-929495f27bf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:48.684149 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f8760-072e-4517-b561-929495f27bf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:48.685647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f8760-072e-4517-b561-929495f27bf0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:48.695301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 287/582] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:48.696060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f8760-072e-4517-b561-929495f27bf0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:48.721330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd24c1-d368-4cd6-9e30-99136a8e247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:48.721998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd24c1-d368-4cd6-9e30-99136a8e247d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:48.722279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd24c1-d368-4cd6-9e30-99136a8e247d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:48.722567 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd24c1-d368-4cd6-9e30-99136a8e247d None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:48.722785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:48.723290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd24c1-d368-4cd6-9e30-99136a8e247d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:48.723596 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd24c1-d368-4cd6-9e30-99136a8e247d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:48.726365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd24c1-d368-4cd6-9e30-99136a8e247d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:48.738044 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 296/583] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:48.738868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd24c1-d368-4cd6-9e30-99136a8e247d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:48.809351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:48.814184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f8760-072e-4517-b561-929495f27bf0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:48.845088 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd24c1-d368-4cd6-9e30-99136a8e247d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:48.849086 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43db3e-244c-429e-a40e-2a2e3fcdeadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:48.849763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43db3e-244c-429e-a40e-2a2e3fcdeadb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:48.850049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43db3e-244c-429e-a40e-2a2e3fcdeadb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:48.850330 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43db3e-244c-429e-a40e-2a2e3fcdeadb None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:48.851169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43db3e-244c-429e-a40e-2a2e3fcdeadb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:48.851483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43db3e-244c-429e-a40e-2a2e3fcdeadb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:48.852953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43db3e-244c-429e-a40e-2a2e3fcdeadb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:48.876398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 288/584] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jun 23 12:53:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:48.876398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43db3e-244c-429e-a40e-2a2e3fcdeadb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:48.885228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294c332-ee52-48c4-91c5-fa823096c000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:48.885890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294c332-ee52-48c4-91c5-fa823096c000 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:48.886174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294c332-ee52-48c4-91c5-fa823096c000 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:48.886452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294c332-ee52-48c4-91c5-fa823096c000 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:48.887240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294c332-ee52-48c4-91c5-fa823096c000 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:48.887547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294c332-ee52-48c4-91c5-fa823096c000 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:48.889004 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294c332-ee52-48c4-91c5-fa823096c000 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:48.901997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 297/585] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:48.902898 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294c332-ee52-48c4-91c5-fa823096c000 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:48.958058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:48.980759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43db3e-244c-429e-a40e-2a2e3fcdeadb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.006677 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294c332-ee52-48c4-91c5-fa823096c000 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.018866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c6690-8b83-44af-bbc6-87bb6a27bdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.019660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c6690-8b83-44af-bbc6-87bb6a27bdea None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.019945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c6690-8b83-44af-bbc6-87bb6a27bdea None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.020219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c6690-8b83-44af-bbc6-87bb6a27bdea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.031487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c6690-8b83-44af-bbc6-87bb6a27bdea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.032955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c6690-8b83-44af-bbc6-87bb6a27bdea None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.034890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:49.044059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd315d50-f6b1-4620-b2ba-8b3d4e06ff44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.044885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd315d50-f6b1-4620-b2ba-8b3d4e06ff44 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.045170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd315d50-f6b1-4620-b2ba-8b3d4e06ff44 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.045446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd315d50-f6b1-4620-b2ba-8b3d4e06ff44 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-fa0c6690-8b83-44af-bbc6-87bb6a27bdea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:49.050831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:49.051723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:49.052603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:49.052603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:49.052603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:49.052603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:49.052603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 289/586] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:49.052923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c6690-8b83-44af-bbc6-87bb6a27bdea None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:49.059739 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd315d50-f6b1-4620-b2ba-8b3d4e06ff44 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.061572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd315d50-f6b1-4620-b2ba-8b3d4e06ff44 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-dd315d50-f6b1-4620-b2ba-8b3d4e06ff44 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:49.077726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:49.078746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:49.079704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:49.079704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:49.079704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:49.079704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:49.079704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:49.079704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:49.079704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:49.079704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:49.079704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:53:49.079704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:49.084842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 298/587] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:49.085937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd315d50-f6b1-4620-b2ba-8b3d4e06ff44 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:49.166052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c6690-8b83-44af-bbc6-87bb6a27bdea None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.191187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd315d50-f6b1-4620-b2ba-8b3d4e06ff44 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.195782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:49.204891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9d080-e368-4de0-aa42-e2cbee2b68e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.206104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9d080-e368-4de0-aa42-e2cbee2b68e9 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.206518 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9d080-e368-4de0-aa42-e2cbee2b68e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.206933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9d080-e368-4de0-aa42-e2cbee2b68e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.217851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9d080-e368-4de0-aa42-e2cbee2b68e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.219789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9d080-e368-4de0-aa42-e2cbee2b68e9 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.225680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5d9f9-9632-4fd8-a31f-89668306772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.226342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5d9f9-9632-4fd8-a31f-89668306772f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.226630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5d9f9-9632-4fd8-a31f-89668306772f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.226904 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5d9f9-9632-4fd8-a31f-89668306772f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.227746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5d9f9-9632-4fd8-a31f-89668306772f None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=79d23f1644b94d51a4d0efe47f7aab3f) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:49.228063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5d9f9-9632-4fd8-a31f-89668306772f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.229510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5d9f9-9632-4fd8-a31f-89668306772f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.243710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 299/588] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/role_assignments?user.id=79d23f1644b94d51a4d0efe47f7aab3f&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:49.243710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5d9f9-9632-4fd8-a31f-89668306772f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-0fa9d080-e368-4de0-aa42-e2cbee2b68e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:49.243993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:49.245121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:49.246216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:49.246216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:49.246216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:49.246216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:49.246216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 290/589] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:49.246216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9d080-e368-4de0-aa42-e2cbee2b68e9 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:49.310940 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:49.364097 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5d9f9-9632-4fd8-a31f-89668306772f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.394228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9d080-e368-4de0-aa42-e2cbee2b68e9 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.403512 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d7eb9-6cb3-4d4c-8a49-65be0b1c503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.404305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d7eb9-6cb3-4d4c-8a49-65be0b1c503b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.404733 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d7eb9-6cb3-4d4c-8a49-65be0b1c503b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.405026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d7eb9-6cb3-4d4c-8a49-65be0b1c503b None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.405757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d7eb9-6cb3-4d4c-8a49-65be0b1c503b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:49.406073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d7eb9-6cb3-4d4c-8a49-65be0b1c503b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.407982 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d7eb9-6cb3-4d4c-8a49-65be0b1c503b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.428381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 300/590] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:49.429303 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d7eb9-6cb3-4d4c-8a49-65be0b1c503b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:49.439397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff87ff6-998d-4097-bd96-27f00b60cfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.440468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff87ff6-998d-4097-bd96-27f00b60cfed None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.440979 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff87ff6-998d-4097-bd96-27f00b60cfed None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.441505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff87ff6-998d-4097-bd96-27f00b60cfed None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.442583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff87ff6-998d-4097-bd96-27f00b60cfed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:49.443097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff87ff6-998d-4097-bd96-27f00b60cfed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.444881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff87ff6-998d-4097-bd96-27f00b60cfed None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.467921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 291/591] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:49.469006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff87ff6-998d-4097-bd96-27f00b60cfed None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:49.523986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:49.540298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d7eb9-6cb3-4d4c-8a49-65be0b1c503b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.557616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:49.576596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff87ff6-998d-4097-bd96-27f00b60cfed None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.585253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153703c-9e1c-4ec7-a2e9-2448c57e1da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.585922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153703c-9e1c-4ec7-a2e9-2448c57e1da1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.586206 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153703c-9e1c-4ec7-a2e9-2448c57e1da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.586481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153703c-9e1c-4ec7-a2e9-2448c57e1da1 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.587634 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153703c-9e1c-4ec7-a2e9-2448c57e1da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:49.587942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153703c-9e1c-4ec7-a2e9-2448c57e1da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.589676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153703c-9e1c-4ec7-a2e9-2448c57e1da1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.604628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 301/592] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:49.605509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153703c-9e1c-4ec7-a2e9-2448c57e1da1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:49.615898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88022ed-406d-4500-88ba-c4b5c9a4bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.617063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88022ed-406d-4500-88ba-c4b5c9a4bf1e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.617551 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88022ed-406d-4500-88ba-c4b5c9a4bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.618083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88022ed-406d-4500-88ba-c4b5c9a4bf1e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.626200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88022ed-406d-4500-88ba-c4b5c9a4bf1e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.627962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88022ed-406d-4500-88ba-c4b5c9a4bf1e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c88022ed-406d-4500-88ba-c4b5c9a4bf1e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:49.643211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:49.644145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:49.645082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:49.645082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:49.645082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:49.645082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:49.645082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:49.645082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:49.645082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:49.645082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:49.645082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 12:53:49.645082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:49.647879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 292/593] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:49.648995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88022ed-406d-4500-88ba-c4b5c9a4bf1e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:49.727322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153703c-9e1c-4ec7-a2e9-2448c57e1da1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.761597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045c403-1892-428e-80d4-9ef7eca35bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.761823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88022ed-406d-4500-88ba-c4b5c9a4bf1e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.762922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045c403-1892-428e-80d4-9ef7eca35bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.763456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045c403-1892-428e-80d4-9ef7eca35bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.763931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045c403-1892-428e-80d4-9ef7eca35bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.769539 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:49.776647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045c403-1892-428e-80d4-9ef7eca35bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.778409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045c403-1892-428e-80d4-9ef7eca35bf2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.796921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b29e76-8f02-4cb3-a395-16ebf2702cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-3045c403-1892-428e-80d4-9ef7eca35bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:49.797673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:49.798735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:49.799794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:49.799794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:49.799794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:49.799794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:49.800061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b29e76-8f02-4cb3-a395-16ebf2702cbe None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.800061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b29e76-8f02-4cb3-a395-16ebf2702cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.800061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b29e76-8f02-4cb3-a395-16ebf2702cbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.805035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b29e76-8f02-4cb3-a395-16ebf2702cbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.805969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 302/594] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:49.806759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b29e76-8f02-4cb3-a395-16ebf2702cbe None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.806977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045c403-1892-428e-80d4-9ef7eca35bf2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-02b29e76-8f02-4cb3-a395-16ebf2702cbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:49.821402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:49.822471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:49.823543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:49.823543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:49.823543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:49.823543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:49.823543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:49.823543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:49.823543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:49.823543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:49.823543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 293/595] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:49.829231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b29e76-8f02-4cb3-a395-16ebf2702cbe None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:49.836991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:49.929258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045c403-1892-428e-80d4-9ef7eca35bf2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.931760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b29e76-8f02-4cb3-a395-16ebf2702cbe None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.968543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480bba6-4166-4d6b-a822-4638ba325014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.969437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480bba6-4166-4d6b-a822-4638ba325014 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.969815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480bba6-4166-4d6b-a822-4638ba325014 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.970188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480bba6-4166-4d6b-a822-4638ba325014 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.971095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480bba6-4166-4d6b-a822-4638ba325014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:49.971499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480bba6-4166-4d6b-a822-4638ba325014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.971607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb4003-61a7-4aac-9d04-342c733589e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.972273 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb4003-61a7-4aac-9d04-342c733589e1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.972562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb4003-61a7-4aac-9d04-342c733589e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.972863 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb4003-61a7-4aac-9d04-342c733589e1 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.973326 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480bba6-4166-4d6b-a822-4638ba325014 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.973700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb4003-61a7-4aac-9d04-342c733589e1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:49.974010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb4003-61a7-4aac-9d04-342c733589e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.975607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb4003-61a7-4aac-9d04-342c733589e1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.985920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 294/596] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:49.986935 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480bba6-4166-4d6b-a822-4638ba325014 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.000443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 303/597] 10.222.0.33 () {56 vars in 1139 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:50.002003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb4003-61a7-4aac-9d04-342c733589e1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.012854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:50.099790 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:50.117969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480bba6-4166-4d6b-a822-4638ba325014 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:50.122591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb4003-61a7-4aac-9d04-342c733589e1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:50.158240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3731d-e8d5-441e-bf8d-aed9a4a94c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:50.159325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3731d-e8d5-441e-bf8d-aed9a4a94c4c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.159922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3731d-e8d5-441e-bf8d-aed9a4a94c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.160040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3731d-e8d5-441e-bf8d-aed9a4a94c4c None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.160938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3731d-e8d5-441e-bf8d-aed9a4a94c4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:50.161437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3731d-e8d5-441e-bf8d-aed9a4a94c4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:50.163418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3731d-e8d5-441e-bf8d-aed9a4a94c4c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:50.168835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7187ec9-01bb-478c-bda8-3f9d49469647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:50.169821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7187ec9-01bb-478c-bda8-3f9d49469647 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.170250 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7187ec9-01bb-478c-bda8-3f9d49469647 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.170760 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7187ec9-01bb-478c-bda8-3f9d49469647 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.176912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 295/598] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:50.177879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3731d-e8d5-441e-bf8d-aed9a4a94c4c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.179799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7187ec9-01bb-478c-bda8-3f9d49469647 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:50.182605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7187ec9-01bb-478c-bda8-3f9d49469647 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a7187ec9-01bb-478c-bda8-3f9d49469647 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:50.203670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:50.205350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:50.206426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:50.206426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:50.206426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:50.206426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:50.206426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:50.206426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:50.206426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:50.206426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:50.213800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 304/599] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:50.213800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7187ec9-01bb-478c-bda8-3f9d49469647 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.268726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:50.296255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3731d-e8d5-441e-bf8d-aed9a4a94c4c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:50.336747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7187ec9-01bb-478c-bda8-3f9d49469647 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:50.343310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89325db9-690f-4323-8b3b-48045ec7c38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:50.344903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89325db9-690f-4323-8b3b-48045ec7c38d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.345381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89325db9-690f-4323-8b3b-48045ec7c38d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.345845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89325db9-690f-4323-8b3b-48045ec7c38d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.361200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89325db9-690f-4323-8b3b-48045ec7c38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:50.363535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89325db9-690f-4323-8b3b-48045ec7c38d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:50.372592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5ec54-3da2-429e-bd78-dc2a222d5a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:50.373699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5ec54-3da2-429e-bd78-dc2a222d5a92 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.374436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5ec54-3da2-429e-bd78-dc2a222d5a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.374436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5ec54-3da2-429e-bd78-dc2a222d5a92 None admin] PATH_INFO: `/v3/projects/311787f32b54485682be669bca9998f8/users/711d53a7deb94849b577c08dc9165ec8/roles/af902c13373445999fcf70be57ba260f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.388178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-89325db9-690f-4323-8b3b-48045ec7c38d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:50.389594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:50.390486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:50.391922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:50.391922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:50.391922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:50.391922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:50.392151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 296/600] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:50.393267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89325db9-690f-4323-8b3b-48045ec7c38d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.395639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5ec54-3da2-429e-bd78-dc2a222d5a92 None admin] RBAC: Authorizing `identity:create_grant(project_id=311787f32b54485682be669bca9998f8, user_id=711d53a7deb94849b577c08dc9165ec8, role_id=af902c13373445999fcf70be57ba260f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:50.399067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5ec54-3da2-429e-bd78-dc2a222d5a92 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:50.485068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 305/601] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:50 2022] PUT /identity/v3/projects/311787f32b54485682be669bca9998f8/users/711d53a7deb94849b577c08dc9165ec8/roles/af902c13373445999fcf70be57ba260f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:50.486360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5ec54-3da2-429e-bd78-dc2a222d5a92 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.518665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89325db9-690f-4323-8b3b-48045ec7c38d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:50.586888 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:50.610001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d83872-88de-4e51-b2de-084035a3a965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:50.610688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d83872-88de-4e51-b2de-084035a3a965 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.610981 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d83872-88de-4e51-b2de-084035a3a965 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.611264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d83872-88de-4e51-b2de-084035a3a965 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.612078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d83872-88de-4e51-b2de-084035a3a965 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:50.612482 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d83872-88de-4e51-b2de-084035a3a965 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:50.613998 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d83872-88de-4e51-b2de-084035a3a965 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:50.620509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5ec54-3da2-429e-bd78-dc2a222d5a92 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:50.639379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 297/602] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:50.647078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d83872-88de-4e51-b2de-084035a3a965 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.671654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f188c-c5cd-4ddf-b5b6-67646a84fd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:50.672351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f188c-c5cd-4ddf-b5b6-67646a84fd2e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.672637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f188c-c5cd-4ddf-b5b6-67646a84fd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.672962 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f188c-c5cd-4ddf-b5b6-67646a84fd2e None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.673747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f188c-c5cd-4ddf-b5b6-67646a84fd2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:50.674055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f188c-c5cd-4ddf-b5b6-67646a84fd2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:50.675473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f188c-c5cd-4ddf-b5b6-67646a84fd2e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:50.692793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 306/603] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:50.694378 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f188c-c5cd-4ddf-b5b6-67646a84fd2e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.760366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:50.781021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d83872-88de-4e51-b2de-084035a3a965 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:50.819693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462432c-67da-4903-9451-864ed478fb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:50.821010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462432c-67da-4903-9451-864ed478fb8f None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.821569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462432c-67da-4903-9451-864ed478fb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.822066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462432c-67da-4903-9451-864ed478fb8f None admin] PATH_INFO: `/v3/projects/311787f32b54485682be669bca9998f8/users/c1c0a73d629a47e4bdbd67da236240af/roles/af902c13373445999fcf70be57ba260f` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.826766 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f188c-c5cd-4ddf-b5b6-67646a84fd2e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:50.839911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462432c-67da-4903-9451-864ed478fb8f None admin] RBAC: Authorizing `identity:create_grant(project_id=311787f32b54485682be669bca9998f8, user_id=c1c0a73d629a47e4bdbd67da236240af, role_id=af902c13373445999fcf70be57ba260f)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:50.841736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462432c-67da-4903-9451-864ed478fb8f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:50.865455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9945a71-7a87-4d58-9883-2757c6c10b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:50.866393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9945a71-7a87-4d58-9883-2757c6c10b64 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.866681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9945a71-7a87-4d58-9883-2757c6c10b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.866965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9945a71-7a87-4d58-9883-2757c6c10b64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.874156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9945a71-7a87-4d58-9883-2757c6c10b64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:50.876811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9945a71-7a87-4d58-9883-2757c6c10b64 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-c9945a71-7a87-4d58-9883-2757c6c10b64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:50.892157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:50.893370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:50.894241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:50.894241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:50.894241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:50.894241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:50.894241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:50.894241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:50.894241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:50.894241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:50.894241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 307/604] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:50.895184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b0f2f-dade-4310-bcb9-4fff93b82aec None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.895394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b0f2f-dade-4310-bcb9-4fff93b82aec None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.902758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b0f2f-dade-4310-bcb9-4fff93b82aec None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.902758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 308/605] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:50.902758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b0f2f-dade-4310-bcb9-4fff93b82aec None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.945757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 298/606] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:50 2022] PUT /identity/v3/projects/311787f32b54485682be669bca9998f8/users/c1c0a73d629a47e4bdbd67da236240af/roles/af902c13373445999fcf70be57ba260f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:53:50.947631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee029f95-9aae-4bef-bccc-7127b238790f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.948020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee029f95-9aae-4bef-bccc-7127b238790f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.948396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee029f95-9aae-4bef-bccc-7127b238790f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.990554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ee029f95-9aae-4bef-bccc-7127b238790f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:50.991970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ee029f95-9aae-4bef-bccc-7127b238790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:51.051948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b0f2f-dade-4310-bcb9-4fff93b82aec None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:51.089363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:51.089562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:51.127070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102f36f-fa9f-4c4e-be50-925e246b8ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:51.127870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102f36f-fa9f-4c4e-be50-925e246b8ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:51.128158 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102f36f-fa9f-4c4e-be50-925e246b8ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:51.128433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102f36f-fa9f-4c4e-be50-925e246b8ea3 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:51.129265 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102f36f-fa9f-4c4e-be50-925e246b8ea3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:51.129600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102f36f-fa9f-4c4e-be50-925e246b8ea3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:51.133177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102f36f-fa9f-4c4e-be50-925e246b8ea3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:51.140231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 299/607] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:51.153543 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 309/608] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:51.159740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee029f95-9aae-4bef-bccc-7127b238790f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:51.181922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102f36f-fa9f-4c4e-be50-925e246b8ea3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:51.271555 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee029f95-9aae-4bef-bccc-7127b238790f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:51.304771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102f36f-fa9f-4c4e-be50-925e246b8ea3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:51.307919 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2b8b9-e558-4ed4-a226-577693687aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:51.309018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2b8b9-e558-4ed4-a226-577693687aac None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:51.309451 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2b8b9-e558-4ed4-a226-577693687aac None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:51.309874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2b8b9-e558-4ed4-a226-577693687aac None admin] PATH_INFO: `/v3/projects/311787f32b54485682be669bca9998f8/users/b1eb257517674c63840d6a2090eb2200/roles/af902c13373445999fcf70be57ba260f` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:51.325734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2b8b9-e558-4ed4-a226-577693687aac None admin] RBAC: Authorizing `identity:create_grant(project_id=311787f32b54485682be669bca9998f8, user_id=b1eb257517674c63840d6a2090eb2200, role_id=af902c13373445999fcf70be57ba260f)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:51.327410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2b8b9-e558-4ed4-a226-577693687aac None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:51.346805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faa753-17ab-404f-8ddb-84b3f5e052d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:51.347799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faa753-17ab-404f-8ddb-84b3f5e052d8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:51.348156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faa753-17ab-404f-8ddb-84b3f5e052d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:51.348503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faa753-17ab-404f-8ddb-84b3f5e052d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:51.359650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2faa753-17ab-404f-8ddb-84b3f5e052d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d2faa753-17ab-404f-8ddb-84b3f5e052d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:51.369055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:51.370052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:51.370970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 310/609] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:51.378745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faa753-17ab-404f-8ddb-84b3f5e052d8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:51.402920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 300/610] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:51 2022] PUT /identity/v3/projects/311787f32b54485682be669bca9998f8/users/b1eb257517674c63840d6a2090eb2200/roles/af902c13373445999fcf70be57ba260f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:51.425430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:51.428929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2efae-e9a0-49f3-838b-9bb8c995c6fa None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:51.429216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2efae-e9a0-49f3-838b-9bb8c995c6fa None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:51.429493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2efae-e9a0-49f3-838b-9bb8c995c6fa None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:51.431108 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 301/611] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:53:51.440685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107f544-2900-4422-bb1f-079b707d3ba5 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:51.440685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107f544-2900-4422-bb1f-079b707d3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:51.440685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107f544-2900-4422-bb1f-079b707d3ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:51.455972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c107f544-2900-4422-bb1f-079b707d3ba5 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:51.457297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c107f544-2900-4422-bb1f-079b707d3ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:51.495908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:51.537323 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faa753-17ab-404f-8ddb-84b3f5e052d8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:51.579862 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e16558-2959-4ca5-ab76-6cb5afdcef3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:51.580542 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e16558-2959-4ca5-ab76-6cb5afdcef3c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:51.580849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e16558-2959-4ca5-ab76-6cb5afdcef3c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:51.581126 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e16558-2959-4ca5-ab76-6cb5afdcef3c None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:51.581887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e16558-2959-4ca5-ab76-6cb5afdcef3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:51.582194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e16558-2959-4ca5-ab76-6cb5afdcef3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:51.583578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e16558-2959-4ca5-ab76-6cb5afdcef3c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:51.604791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 311/612] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:51.605334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 302/613] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:53:51.611355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e16558-2959-4ca5-ab76-6cb5afdcef3c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:51.637895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107f544-2900-4422-bb1f-079b707d3ba5 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:51.747616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:51.761175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e16558-2959-4ca5-ab76-6cb5afdcef3c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:51.765541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107f544-2900-4422-bb1f-079b707d3ba5 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:51.832679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad2e48-795b-476a-a0e0-75fb8fe93bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:51.833584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2e48-795b-476a-a0e0-75fb8fe93bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:51.833871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2e48-795b-476a-a0e0-75fb8fe93bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:51.834152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2e48-795b-476a-a0e0-75fb8fe93bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:51.841356 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b65959-5716-45e1-b4ef-e47e5442a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:51.842915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65959-5716-45e1-b4ef-e47e5442a89c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:51.843409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65959-5716-45e1-b4ef-e47e5442a89c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:51.843887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65959-5716-45e1-b4ef-e47e5442a89c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:51.848738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad2e48-795b-476a-a0e0-75fb8fe93bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:51.851723 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad2e48-795b-476a-a0e0-75fb8fe93bb8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:51.867633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b65959-5716-45e1-b4ef-e47e5442a89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-44b65959-5716-45e1-b4ef-e47e5442a89c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:51.880375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:51.881329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:51.882175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:51.882175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:51.882175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:51.882175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:51.882175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:51.882175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:51.882175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:51.882175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:51.882175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:51.882175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:51.882175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:51.882175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-13ad2e48-795b-476a-a0e0-75fb8fe93bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:51.893029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:51.893935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:51.894823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:51.894823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:51.894823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:51.894823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:51.895793 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 303/614] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:51.897133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b65959-5716-45e1-b4ef-e47e5442a89c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:51.901393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 312/615] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:51.907871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad2e48-795b-476a-a0e0-75fb8fe93bb8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:51.923312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:52.067031 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad2e48-795b-476a-a0e0-75fb8fe93bb8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:52.112714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b65959-5716-45e1-b4ef-e47e5442a89c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:52.121375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a78d1e-bee2-4319-8db0-e9a679357ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:52.122258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a78d1e-bee2-4319-8db0-e9a679357ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:52.122699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a78d1e-bee2-4319-8db0-e9a679357ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:52.123148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a78d1e-bee2-4319-8db0-e9a679357ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:52.124059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a78d1e-bee2-4319-8db0-e9a679357ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:52.124534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a78d1e-bee2-4319-8db0-e9a679357ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:52.126650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a78d1e-bee2-4319-8db0-e9a679357ee5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:52.143820 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 313/616] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:52.149812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a78d1e-bee2-4319-8db0-e9a679357ee5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:52.150689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695baf3-e90f-400f-9641-85904dc36f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:52.151746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695baf3-e90f-400f-9641-85904dc36f2a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:52.152846 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695baf3-e90f-400f-9641-85904dc36f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:52.153678 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695baf3-e90f-400f-9641-85904dc36f2a None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:52.156346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695baf3-e90f-400f-9641-85904dc36f2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:52.156941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695baf3-e90f-400f-9641-85904dc36f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:52.158560 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695baf3-e90f-400f-9641-85904dc36f2a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:52.168230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 304/617] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:52.171885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:52.174605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695baf3-e90f-400f-9641-85904dc36f2a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:52.299085 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:52.330150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695baf3-e90f-400f-9641-85904dc36f2a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:52.350154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a78d1e-bee2-4319-8db0-e9a679357ee5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:52.389238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa369da6-465e-445e-be39-9c7c6359f260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:52.390238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa369da6-465e-445e-be39-9c7c6359f260 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:52.390543 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa369da6-465e-445e-be39-9c7c6359f260 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:52.390794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa369da6-465e-445e-be39-9c7c6359f260 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:52.395019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd75882-5442-4667-a34f-9d2cb87f3b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:52.395766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75882-5442-4667-a34f-9d2cb87f3b97 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:52.396049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75882-5442-4667-a34f-9d2cb87f3b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:52.396324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75882-5442-4667-a34f-9d2cb87f3b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:52.399871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa369da6-465e-445e-be39-9c7c6359f260 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:52.401466 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa369da6-465e-445e-be39-9c7c6359f260 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-fa369da6-465e-445e-be39-9c7c6359f260 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:52.417215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:52.418187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:52.419934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:52.419934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:52.419934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:52.419934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:52.419934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:52.419934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:52.419934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:52.419934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:52.419934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:53:52.419934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:52.419934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 314/618] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 23 12:53:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:52.424121 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa369da6-465e-445e-be39-9c7c6359f260 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:52.427775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd75882-5442-4667-a34f-9d2cb87f3b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:52.429287 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd75882-5442-4667-a34f-9d2cb87f3b97 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-5dd75882-5442-4667-a34f-9d2cb87f3b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:52.465632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:52.466607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:52.467519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:52.467519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:52.467519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:52.467519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:52.472121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 305/619] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:52.476774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd75882-5442-4667-a34f-9d2cb87f3b97 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:52.545000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:52.611306 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa369da6-465e-445e-be39-9c7c6359f260 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:52.660036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd75882-5442-4667-a34f-9d2cb87f3b97 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:52.689057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:52.696949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479d97e-286f-4767-8bb5-06611b2b10c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:52.697437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1dc4d-3eee-4c0d-b5dc-4211eea8ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:52.697614 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479d97e-286f-4767-8bb5-06611b2b10c8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:52.707142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479d97e-286f-4767-8bb5-06611b2b10c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:52.707285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1dc4d-3eee-4c0d-b5dc-4211eea8ce89 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:52.707380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479d97e-286f-4767-8bb5-06611b2b10c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:52.707455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1dc4d-3eee-4c0d-b5dc-4211eea8ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:52.707455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1dc4d-3eee-4c0d-b5dc-4211eea8ce89 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:52.707587 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479d97e-286f-4767-8bb5-06611b2b10c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:52.707587 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479d97e-286f-4767-8bb5-06611b2b10c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:52.707719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1dc4d-3eee-4c0d-b5dc-4211eea8ce89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:52.707719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1dc4d-3eee-4c0d-b5dc-4211eea8ce89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:52.707842 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479d97e-286f-4767-8bb5-06611b2b10c8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:52.707916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1dc4d-3eee-4c0d-b5dc-4211eea8ce89 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:52.713736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 306/620] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:52.720568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479d97e-286f-4767-8bb5-06611b2b10c8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:52.741324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 315/621] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 23 12:53:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:52.746975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1dc4d-3eee-4c0d-b5dc-4211eea8ce89 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:52.887835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479d97e-286f-4767-8bb5-06611b2b10c8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:52.921828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1dc4d-3eee-4c0d-b5dc-4211eea8ce89 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:52.924479 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d85f3-a2d6-4df1-aa6f-21581480fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:52.925321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d85f3-a2d6-4df1-aa6f-21581480fdab None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:52.925603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d85f3-a2d6-4df1-aa6f-21581480fdab None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:52.925875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d85f3-a2d6-4df1-aa6f-21581480fdab None admin] PATH_INFO: `/v3/users/swift` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:52.933450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d85f3-a2d6-4df1-aa6f-21581480fdab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:52.934904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d85f3-a2d6-4df1-aa6f-21581480fdab None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:52.950725 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-fa9d85f3-a2d6-4df1-aa6f-21581480fdab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:52.950887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:52.951769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:52.952730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:52.952730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:52.952730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:52.952730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:52.952730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:52.952730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:52.952730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:52.952730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:52.952730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:53:52.952730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:52.952730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 307/622] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:52.957878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162097d-a330-4cb5-ad3f-d511d6e819a8 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:52.958170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162097d-a330-4cb5-ad3f-d511d6e819a8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:52.958450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162097d-a330-4cb5-ad3f-d511d6e819a8 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:52.959948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 308/623] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:52.961401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162097d-a330-4cb5-ad3f-d511d6e819a8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:52.967854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c24995-0668-4de8-beca-600b95571f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:52.968842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c24995-0668-4de8-beca-600b95571f58 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:52.969868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c24995-0668-4de8-beca-600b95571f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:52.970339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c24995-0668-4de8-beca-600b95571f58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:53.019099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:53.061048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c24995-0668-4de8-beca-600b95571f58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:53.062758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c24995-0668-4de8-beca-600b95571f58 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:53.091526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162097d-a330-4cb5-ad3f-d511d6e819a8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:53.132784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c223d44-7bae-4fcf-8568-26d9ff461d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:53.134028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c223d44-7bae-4fcf-8568-26d9ff461d07 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:53.134907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c223d44-7bae-4fcf-8568-26d9ff461d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:53.135619 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c223d44-7bae-4fcf-8568-26d9ff461d07 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:53.136652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c223d44-7bae-4fcf-8568-26d9ff461d07 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:53.137193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c223d44-7bae-4fcf-8568-26d9ff461d07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:53.139683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c223d44-7bae-4fcf-8568-26d9ff461d07 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:53.164123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 309/624] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jun 23 12:53:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:53.165747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd205e38-10ed-4a35-beec-ec0391eb18bb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:53.166235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd205e38-10ed-4a35-beec-ec0391eb18bb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:53.166722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd205e38-10ed-4a35-beec-ec0391eb18bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:53.184593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 316/625] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 12:53:53.185379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-cd205e38-10ed-4a35-beec-ec0391eb18bb None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:53.186021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c24995-0668-4de8-beca-600b95571f58 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:53.186595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cd205e38-10ed-4a35-beec-ec0391eb18bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:53.219695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:53.256826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 310/626] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:53.257746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd205e38-10ed-4a35-beec-ec0391eb18bb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:53.290047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:53.306840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c24995-0668-4de8-beca-600b95571f58 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:53.341166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f34d84-ccd2-4cdf-9162-3c45459371cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:53.341886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f34d84-ccd2-4cdf-9162-3c45459371cc None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:53.342171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f34d84-ccd2-4cdf-9162-3c45459371cc None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:53.342450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f34d84-ccd2-4cdf-9162-3c45459371cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:53.354551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f34d84-ccd2-4cdf-9162-3c45459371cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:53.356023 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f34d84-ccd2-4cdf-9162-3c45459371cc None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:53.364251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd205e38-10ed-4a35-beec-ec0391eb18bb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-e9f34d84-ccd2-4cdf-9162-3c45459371cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:53.374032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:53.374937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:53.375885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:53.375885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:53.375885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:53.375885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:53.381053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 317/627] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:53.381053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f34d84-ccd2-4cdf-9162-3c45459371cc None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:53.399224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3167824-3ddd-4ef0-b628-36ea4f1251ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:53.400021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3167824-3ddd-4ef0-b628-36ea4f1251ac None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:53.400291 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3167824-3ddd-4ef0-b628-36ea4f1251ac None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:53.400565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3167824-3ddd-4ef0-b628-36ea4f1251ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:53.410731 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3167824-3ddd-4ef0-b628-36ea4f1251ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:53.412167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3167824-3ddd-4ef0-b628-36ea4f1251ac None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-e3167824-3ddd-4ef0-b628-36ea4f1251ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:53.430650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:53.431536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:53.432498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:53.432498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:53.432498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:53.432498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:53.432498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 311/628] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:53.433256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d7cb1-54a7-4507-8fc6-4baddde350b4 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:53.433759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d7cb1-54a7-4507-8fc6-4baddde350b4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:53.433759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d7cb1-54a7-4507-8fc6-4baddde350b4 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:53.436986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 312/629] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:53.438384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d7cb1-54a7-4507-8fc6-4baddde350b4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:53.468218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:53.492145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f34d84-ccd2-4cdf-9162-3c45459371cc None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:53.527343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59d85c-3c33-4fd4-baa9-d0057252d89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:53.528144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d85c-3c33-4fd4-baa9-d0057252d89f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:53.528472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d85c-3c33-4fd4-baa9-d0057252d89f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:53.528778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d85c-3c33-4fd4-baa9-d0057252d89f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:53.532572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:53.538969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59d85c-3c33-4fd4-baa9-d0057252d89f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-0a59d85c-3c33-4fd4-baa9-d0057252d89f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:53.546614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:53.548422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 318/630] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:53.549680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59d85c-3c33-4fd4-baa9-d0057252d89f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:53.553852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d7cb1-54a7-4507-8fc6-4baddde350b4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:53.589210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec48f93-899f-4653-9c14-fb0bd1faade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:53.589876 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec48f93-899f-4653-9c14-fb0bd1faade1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:53.590162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec48f93-899f-4653-9c14-fb0bd1faade1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:53.590440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec48f93-899f-4653-9c14-fb0bd1faade1 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:53.591157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec48f93-899f-4653-9c14-fb0bd1faade1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:53.591467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec48f93-899f-4653-9c14-fb0bd1faade1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:53.592867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec48f93-899f-4653-9c14-fb0bd1faade1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:53.604156 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 313/631] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:53.605379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9845-791d-441c-93b3-f12adb923e75 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:53.605662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9845-791d-441c-93b3-f12adb923e75 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:53.605935 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9845-791d-441c-93b3-f12adb923e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:53.625938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-235e9845-791d-441c-93b3-f12adb923e75 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:53.627133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-235e9845-791d-441c-93b3-f12adb923e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:53.662120 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59d85c-3c33-4fd4-baa9-d0057252d89f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:53.704768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0076f3-8599-4372-8b65-7d450002b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:53.704973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 314/632] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:53.705397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0076f3-8599-4372-8b65-7d450002b63c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:53.705485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e9845-791d-441c-93b3-f12adb923e75 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:53.705568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0076f3-8599-4372-8b65-7d450002b63c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:53.705568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0076f3-8599-4372-8b65-7d450002b63c None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:53.705568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0076f3-8599-4372-8b65-7d450002b63c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:53.705568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0076f3-8599-4372-8b65-7d450002b63c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:53.705568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0076f3-8599-4372-8b65-7d450002b63c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:53.712176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:53.712402 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 319/633] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:53.713899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0076f3-8599-4372-8b65-7d450002b63c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:53.785884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:53.811827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e9845-791d-441c-93b3-f12adb923e75 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:53.819537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0076f3-8599-4372-8b65-7d450002b63c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:53.846703 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb554758-1264-474d-9e9a-5733944a702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:53.847364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb554758-1264-474d-9e9a-5733944a702a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:53.847648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb554758-1264-474d-9e9a-5733944a702a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:53.847923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb554758-1264-474d-9e9a-5733944a702a None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:53.848682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb554758-1264-474d-9e9a-5733944a702a None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:53.848986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb554758-1264-474d-9e9a-5733944a702a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:53.850357 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb554758-1264-474d-9e9a-5733944a702a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:53.856700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d45e76-05b5-4b38-b590-21f244689c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:53.857499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d45e76-05b5-4b38-b590-21f244689c1a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:53.857783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d45e76-05b5-4b38-b590-21f244689c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:53.858061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d45e76-05b5-4b38-b590-21f244689c1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:53.858490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 315/634] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:53.859124 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb554758-1264-474d-9e9a-5733944a702a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:53.870182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d45e76-05b5-4b38-b590-21f244689c1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:53.872059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d45e76-05b5-4b38-b590-21f244689c1a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-81d45e76-05b5-4b38-b590-21f244689c1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:53.887488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:53.888410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:53.889646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:53.889646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:53.889646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:53.889646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:53.889646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:53.889646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:53.889646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:53.889646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:53.889646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 320/635] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:53.889646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d45e76-05b5-4b38-b590-21f244689c1a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:53.946365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:53.963058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb554758-1264-474d-9e9a-5733944a702a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:53.990019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d45e76-05b5-4b38-b590-21f244689c1a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:53.996450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909d2c0-b397-4a77-991f-cb6f474bb884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:53.997281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909d2c0-b397-4a77-991f-cb6f474bb884 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:53.997562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909d2c0-b397-4a77-991f-cb6f474bb884 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:53.997841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909d2c0-b397-4a77-991f-cb6f474bb884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.000525 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:54.004804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909d2c0-b397-4a77-991f-cb6f474bb884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:54.006244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909d2c0-b397-4a77-991f-cb6f474bb884 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-e909d2c0-b397-4a77-991f-cb6f474bb884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:54.020921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:54.022064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:54.022945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:54.022945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:54.022945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:54.022945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:54.022945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:54.022945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:54.022945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:54.022945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:54.023374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9508e-72b1-467b-a82e-1f76cfc1461b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:54.023579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9508e-72b1-467b-a82e-1f76cfc1461b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.023807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9508e-72b1-467b-a82e-1f76cfc1461b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:54.024083 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9508e-72b1-467b-a82e-1f76cfc1461b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.027190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 316/636] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:54.028012 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909d2c0-b397-4a77-991f-cb6f474bb884 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:54.035136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9508e-72b1-467b-a82e-1f76cfc1461b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-f1c9508e-72b1-467b-a82e-1f76cfc1461b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:54.042914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:54.043850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 321/637] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:54.044988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9508e-72b1-467b-a82e-1f76cfc1461b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:54.125718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909d2c0-b397-4a77-991f-cb6f474bb884 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:54.145054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9508e-72b1-467b-a82e-1f76cfc1461b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:54.160551 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7bf73-6d60-4584-917a-936f51c900ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:54.160911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:54.161368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7bf73-6d60-4584-917a-936f51c900ce None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.161662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7bf73-6d60-4584-917a-936f51c900ce None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:54.161938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7bf73-6d60-4584-917a-936f51c900ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.171859 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7bf73-6d60-4584-917a-936f51c900ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:54.173651 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7bf73-6d60-4584-917a-936f51c900ce None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:54.177864 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c381c-b646-4181-b08f-97037a31f741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:54.178526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c381c-b646-4181-b08f-97037a31f741 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.178814 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c381c-b646-4181-b08f-97037a31f741 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:54.179096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c381c-b646-4181-b08f-97037a31f741 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.179884 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c381c-b646-4181-b08f-97037a31f741 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:54.180284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c381c-b646-4181-b08f-97037a31f741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:54.181750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c381c-b646-4181-b08f-97037a31f741 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-58d7bf73-6d60-4584-917a-936f51c900ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:54.190627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:54.191741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:54.192778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:54.192778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:54.192778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:54.192778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:54.192778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 317/638] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:54.194534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c88580-7482-4741-a260-b65553c79133 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.194905 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c88580-7482-4741-a260-b65553c79133 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:54.195193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c88580-7482-4741-a260-b65553c79133 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.196491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 318/639] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:54.197218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c88580-7482-4741-a260-b65553c79133 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:54.203260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 322/640] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:54.203260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c381c-b646-4181-b08f-97037a31f741 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:54.248122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:54.301058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c88580-7482-4741-a260-b65553c79133 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:54.305369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c381c-b646-4181-b08f-97037a31f741 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:54.335491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99f690-0f78-40f2-83d5-9314b37bf302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:54.336223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99f690-0f78-40f2-83d5-9314b37bf302 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.336532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99f690-0f78-40f2-83d5-9314b37bf302 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:54.336865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99f690-0f78-40f2-83d5-9314b37bf302 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.337718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99f690-0f78-40f2-83d5-9314b37bf302 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:54.338072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99f690-0f78-40f2-83d5-9314b37bf302 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:54.339365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f9ac5-b2ea-4a5d-8585-022004d25595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:54.339604 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99f690-0f78-40f2-83d5-9314b37bf302 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:54.340075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f9ac5-b2ea-4a5d-8585-022004d25595 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.340367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f9ac5-b2ea-4a5d-8585-022004d25595 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:54.340651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f9ac5-b2ea-4a5d-8585-022004d25595 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.341470 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f9ac5-b2ea-4a5d-8585-022004d25595 None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:54.341781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f9ac5-b2ea-4a5d-8585-022004d25595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:54.343128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f9ac5-b2ea-4a5d-8585-022004d25595 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:54.356138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 319/642] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:54.356315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 323/642] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:54.356416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99f690-0f78-40f2-83d5-9314b37bf302 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:54.356520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273f214-5269-4e36-b064-642d6b183b71 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.356520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273f214-5269-4e36-b064-642d6b183b71 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:54.356520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273f214-5269-4e36-b064-642d6b183b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.370825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e273f214-5269-4e36-b064-642d6b183b71 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:54.372004 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e273f214-5269-4e36-b064-642d6b183b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:54.403314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:54.438775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 324/643] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:54.439609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273f214-5269-4e36-b064-642d6b183b71 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:54.457329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99f690-0f78-40f2-83d5-9314b37bf302 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:54.466465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:54.491067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbbd37-5849-452c-be38-68af89cd0e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:54.491730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbbd37-5849-452c-be38-68af89cd0e30 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.492016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbbd37-5849-452c-be38-68af89cd0e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:54.492294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbbd37-5849-452c-be38-68af89cd0e30 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.493048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbbd37-5849-452c-be38-68af89cd0e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:54.493357 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbbd37-5849-452c-be38-68af89cd0e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:54.494780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbbd37-5849-452c-be38-68af89cd0e30 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:54.506804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 320/644] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:54.507528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbbd37-5849-452c-be38-68af89cd0e30 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:54.535624 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273f214-5269-4e36-b064-642d6b183b71 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:54.568176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d755bd1-aa3f-4496-b553-7053b76c9a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:54.569112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d755bd1-aa3f-4496-b553-7053b76c9a56 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.569398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d755bd1-aa3f-4496-b553-7053b76c9a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:54.569685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d755bd1-aa3f-4496-b553-7053b76c9a56 None admin] PATH_INFO: `/v3/projects/311787f32b54485682be669bca9998f8/users/79d23f1644b94d51a4d0efe47f7aab3f/roles/af902c13373445999fcf70be57ba260f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.584027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d755bd1-aa3f-4496-b553-7053b76c9a56 None admin] RBAC: Authorizing `identity:create_grant(project_id=311787f32b54485682be669bca9998f8, user_id=79d23f1644b94d51a4d0efe47f7aab3f, role_id=af902c13373445999fcf70be57ba260f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:54.585483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d755bd1-aa3f-4496-b553-7053b76c9a56 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:54.600995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbbd37-5849-452c-be38-68af89cd0e30 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:54.632857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab750e0-860d-4949-b9b0-c35fe993a9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:54.633630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab750e0-860d-4949-b9b0-c35fe993a9cd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.633912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab750e0-860d-4949-b9b0-c35fe993a9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:54.634185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab750e0-860d-4949-b9b0-c35fe993a9cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.644410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab750e0-860d-4949-b9b0-c35fe993a9cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:54.645848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab750e0-860d-4949-b9b0-c35fe993a9cd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-cab750e0-860d-4949-b9b0-c35fe993a9cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:54.663151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:54.664247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:54.665591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:54.665591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:54.665591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:54.665591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:54.665591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 321/645] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:54.665591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab750e0-860d-4949-b9b0-c35fe993a9cd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:54.741449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 325/646] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:54 2022] PUT /identity/v3/projects/311787f32b54485682be669bca9998f8/users/79d23f1644b94d51a4d0efe47f7aab3f/roles/af902c13373445999fcf70be57ba260f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:54.742289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d755bd1-aa3f-4496-b553-7053b76c9a56 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:54.769423 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab750e0-860d-4949-b9b0-c35fe993a9cd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:54.770020 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:54.777055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:54.803885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5526063-66fe-4db5-9b92-c384779df0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:54.804645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5526063-66fe-4db5-9b92-c384779df0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.805096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5526063-66fe-4db5-9b92-c384779df0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:54.805474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5526063-66fe-4db5-9b92-c384779df0b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.806352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5526063-66fe-4db5-9b92-c384779df0b6 None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=5874e98df57242028c0f9983dee3b5e8) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:54.806667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5526063-66fe-4db5-9b92-c384779df0b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:54.808222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5526063-66fe-4db5-9b92-c384779df0b6 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:54.814857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 322/647] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:54 2022] GET /identity/v3/role_assignments?user.id=5874e98df57242028c0f9983dee3b5e8&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:54.815708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5526063-66fe-4db5-9b92-c384779df0b6 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:54.879278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d755bd1-aa3f-4496-b553-7053b76c9a56 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:54.922458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:54.933994 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91e129-65dd-4f0f-ac0b-f8132db08025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:54.940017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91e129-65dd-4f0f-ac0b-f8132db08025 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.940017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91e129-65dd-4f0f-ac0b-f8132db08025 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:54.940017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91e129-65dd-4f0f-ac0b-f8132db08025 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:54.941569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5526063-66fe-4db5-9b92-c384779df0b6 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:54.957704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91e129-65dd-4f0f-ac0b-f8132db08025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-6e91e129-65dd-4f0f-ac0b-f8132db08025 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:54.965574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:54.966604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:54.967456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 326/648] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:54.968172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91e129-65dd-4f0f-ac0b-f8132db08025 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:54.997509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a7fc0-523f-490c-89e7-b4a219739d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:54.998867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a7fc0-523f-490c-89e7-b4a219739d1b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:54.999682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a7fc0-523f-490c-89e7-b4a219739d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:55.000030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a7fc0-523f-490c-89e7-b4a219739d1b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:55.010305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a7fc0-523f-490c-89e7-b4a219739d1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:55.012652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a7fc0-523f-490c-89e7-b4a219739d1b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-5a4a7fc0-523f-490c-89e7-b4a219739d1b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:55.031380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:55.033005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:55.034150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:55.034150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:55.034150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:55.034150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:55.034150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:55.034150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:55.034150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:55.034150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:55.034150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 12:53:55.034150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:55.034802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 323/649] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:55.036207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a7fc0-523f-490c-89e7-b4a219739d1b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:55.061529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:55.097804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91e129-65dd-4f0f-ac0b-f8132db08025 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:55.137893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b17f6-52ae-4578-b0bd-04dfc03e4487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:55.139210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b17f6-52ae-4578-b0bd-04dfc03e4487 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:55.139663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b17f6-52ae-4578-b0bd-04dfc03e4487 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:55.140365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b17f6-52ae-4578-b0bd-04dfc03e4487 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:55.141883 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b17f6-52ae-4578-b0bd-04dfc03e4487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:55.142335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b17f6-52ae-4578-b0bd-04dfc03e4487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:55.143870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b17f6-52ae-4578-b0bd-04dfc03e4487 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:55.157987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 327/650] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:55.159026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b17f6-52ae-4578-b0bd-04dfc03e4487 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:55.168123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a7fc0-523f-490c-89e7-b4a219739d1b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:55.208489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc745e0b-06c5-4517-baaa-89c3ee9c15ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:55.209857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc745e0b-06c5-4517-baaa-89c3ee9c15ca None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:55.210318 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc745e0b-06c5-4517-baaa-89c3ee9c15ca None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:55.211148 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc745e0b-06c5-4517-baaa-89c3ee9c15ca None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:55.212319 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc745e0b-06c5-4517-baaa-89c3ee9c15ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:55.212805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc745e0b-06c5-4517-baaa-89c3ee9c15ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:55.215085 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc745e0b-06c5-4517-baaa-89c3ee9c15ca None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:55.227297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 324/651] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:55.228542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc745e0b-06c5-4517-baaa-89c3ee9c15ca None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:55.239765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:55.283803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b17f6-52ae-4578-b0bd-04dfc03e4487 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:55.331537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613719c-3505-48e4-b7e3-28c84d979d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:55.333146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613719c-3505-48e4-b7e3-28c84d979d20 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:55.333598 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613719c-3505-48e4-b7e3-28c84d979d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:55.334261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613719c-3505-48e4-b7e3-28c84d979d20 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:55.335791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613719c-3505-48e4-b7e3-28c84d979d20 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:55.336344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613719c-3505-48e4-b7e3-28c84d979d20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:55.337946 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613719c-3505-48e4-b7e3-28c84d979d20 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:55.338082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc745e0b-06c5-4517-baaa-89c3ee9c15ca None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:55.349131 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:55.368879 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 328/652] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jun 23 12:53:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:55.370343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613719c-3505-48e4-b7e3-28c84d979d20 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:55.383027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0006209-9c3d-4b61-9055-9c3c9feb65d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:55.384439 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0006209-9c3d-4b61-9055-9c3c9feb65d7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:55.384975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0006209-9c3d-4b61-9055-9c3c9feb65d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:55.385609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0006209-9c3d-4b61-9055-9c3c9feb65d7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:55.398334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0006209-9c3d-4b61-9055-9c3c9feb65d7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:55.400785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0006209-9c3d-4b61-9055-9c3c9feb65d7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-d0006209-9c3d-4b61-9055-9c3c9feb65d7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:55.420211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:55.421404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:55.422609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:55.422609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:55.422609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:55.422609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:55.422609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:55.422609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:55.422609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:55.422609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:55.422609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:53:55.422609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:55.425472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 325/653] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:55.426511 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0006209-9c3d-4b61-9055-9c3c9feb65d7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:55.484072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613719c-3505-48e4-b7e3-28c84d979d20 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:55.515849 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:55.520199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e5047-ad04-42ed-8b17-918dc101aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:55.525986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e5047-ad04-42ed-8b17-918dc101aa1c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:55.525986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e5047-ad04-42ed-8b17-918dc101aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:55.525986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e5047-ad04-42ed-8b17-918dc101aa1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:55.535856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e5047-ad04-42ed-8b17-918dc101aa1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:55.538262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e5047-ad04-42ed-8b17-918dc101aa1c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-8d5e5047-ad04-42ed-8b17-918dc101aa1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:55.559966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:55.560924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:55.561831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:55.561831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:55.561831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:55.561831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:55.562062 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0006209-9c3d-4b61-9055-9c3c9feb65d7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:55.568998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 329/654] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:55.570059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e5047-ad04-42ed-8b17-918dc101aa1c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:55.602557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b461d9-6797-432e-8288-8c9edf394364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:55.603489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b461d9-6797-432e-8288-8c9edf394364 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:55.603762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b461d9-6797-432e-8288-8c9edf394364 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:55.604041 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b461d9-6797-432e-8288-8c9edf394364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:55.621993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:55.676152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e5047-ad04-42ed-8b17-918dc101aa1c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:55.697764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b461d9-6797-432e-8288-8c9edf394364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:55.699521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b461d9-6797-432e-8288-8c9edf394364 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:55.712477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a012b8a-f21a-410d-b2d2-c01a8a5e41e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:55.713566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a012b8a-f21a-410d-b2d2-c01a8a5e41e2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:55.714075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a012b8a-f21a-410d-b2d2-c01a8a5e41e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:55.714577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a012b8a-f21a-410d-b2d2-c01a8a5e41e2 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:55.715663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a012b8a-f21a-410d-b2d2-c01a8a5e41e2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:55.716291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a012b8a-f21a-410d-b2d2-c01a8a5e41e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:55.718039 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a012b8a-f21a-410d-b2d2-c01a8a5e41e2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:55.742348 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 330/655] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jun 23 12:53:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:55.743682 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a012b8a-f21a-410d-b2d2-c01a8a5e41e2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:55.782516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:55.837452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 326/656] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:55.838440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b461d9-6797-432e-8288-8c9edf394364 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:55.861842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a012b8a-f21a-410d-b2d2-c01a8a5e41e2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:55.869886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:55.899585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d8e00-4501-46f0-bafb-ffe1a506ddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:55.900919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d8e00-4501-46f0-bafb-ffe1a506ddc8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:55.901282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d8e00-4501-46f0-bafb-ffe1a506ddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:55.901638 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d8e00-4501-46f0-bafb-ffe1a506ddc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:55.902566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d8e00-4501-46f0-bafb-ffe1a506ddc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:55.902959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d8e00-4501-46f0-bafb-ffe1a506ddc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:55.904624 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d8e00-4501-46f0-bafb-ffe1a506ddc8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:55.918570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 331/657] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:55.920104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d8e00-4501-46f0-bafb-ffe1a506ddc8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:55.952499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b461d9-6797-432e-8288-8c9edf394364 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:55.989751 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da3ae1-3c21-475b-8b97-5cfc601c5363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:55.990759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da3ae1-3c21-475b-8b97-5cfc601c5363 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:55.991195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da3ae1-3c21-475b-8b97-5cfc601c5363 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:55.991615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da3ae1-3c21-475b-8b97-5cfc601c5363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:56.027643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:56.028554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d8e00-4501-46f0-bafb-ffe1a506ddc8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:56.072683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d5b17-8cca-492f-9652-5a76bd92fdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:56.072683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d5b17-8cca-492f-9652-5a76bd92fdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:56.072683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d5b17-8cca-492f-9652-5a76bd92fdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:56.072683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d5b17-8cca-492f-9652-5a76bd92fdd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:56.073138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da3ae1-3c21-475b-8b97-5cfc601c5363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:56.073138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da3ae1-3c21-475b-8b97-5cfc601c5363 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:56.080148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d5b17-8cca-492f-9652-5a76bd92fdd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:56.081881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d5b17-8cca-492f-9652-5a76bd92fdd9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-bb6d5b17-8cca-492f-9652-5a76bd92fdd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:56.099959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:56.101141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:56.102223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:56.102223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:56.102223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:56.102223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:56.103791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 332/658] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:56.104726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d5b17-8cca-492f-9652-5a76bd92fdd9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:56.133151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:56.184042 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 327/659] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:56.184913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da3ae1-3c21-475b-8b97-5cfc601c5363 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:56.211865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d5b17-8cca-492f-9652-5a76bd92fdd9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:56.250234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f9b31-3de9-4d58-af47-d0b06aa77a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:56.251172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9b31-3de9-4d58-af47-d0b06aa77a0d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:56.251579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9b31-3de9-4d58-af47-d0b06aa77a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:56.251964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9b31-3de9-4d58-af47-d0b06aa77a0d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:56.252837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:56.260372 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9b31-3de9-4d58-af47-d0b06aa77a0d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:56.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9b31-3de9-4d58-af47-d0b06aa77a0d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-368f9b31-3de9-4d58-af47-d0b06aa77a0d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:56.278612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:56.279732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:56.280906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:56.280906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:56.280906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:56.280906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:56.280906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:56.280906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:56.280906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:56.280906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:56.280906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 12:53:56.280906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:56.284310 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 333/660] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:56.284310 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f9b31-3de9-4d58-af47-d0b06aa77a0d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:56.289120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da3ae1-3c21-475b-8b97-5cfc601c5363 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:56.324827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5914a-9997-4c1c-be00-e483254be23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:56.325491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5914a-9997-4c1c-be00-e483254be23a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:56.325782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5914a-9997-4c1c-be00-e483254be23a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:56.326058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5914a-9997-4c1c-be00-e483254be23a None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:56.326775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5914a-9997-4c1c-be00-e483254be23a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:56.327195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5914a-9997-4c1c-be00-e483254be23a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:56.329125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5914a-9997-4c1c-be00-e483254be23a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:56.341446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 328/661] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:56.342314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5914a-9997-4c1c-be00-e483254be23a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:56.368312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:56.395938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f9b31-3de9-4d58-af47-d0b06aa77a0d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:56.432046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075c466-c567-47a8-9bcf-6de03f87c242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:56.433085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075c466-c567-47a8-9bcf-6de03f87c242 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:56.433420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075c466-c567-47a8-9bcf-6de03f87c242 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:56.433802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075c466-c567-47a8-9bcf-6de03f87c242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:56.445215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075c466-c567-47a8-9bcf-6de03f87c242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:56.446878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075c466-c567-47a8-9bcf-6de03f87c242 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a075c466-c567-47a8-9bcf-6de03f87c242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:56.465612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:56.466807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:56.467927 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:56.467927 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:56.467927 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:56.467927 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:56.469733 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 334/662] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:56.470508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075c466-c567-47a8-9bcf-6de03f87c242 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:56.472851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5914a-9997-4c1c-be00-e483254be23a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:56.501982 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:56.510969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15927d7a-2546-4095-9b4b-a4acb7f9c071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:56.527891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15927d7a-2546-4095-9b4b-a4acb7f9c071 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:56.527891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15927d7a-2546-4095-9b4b-a4acb7f9c071 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:56.527891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15927d7a-2546-4095-9b4b-a4acb7f9c071 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:56.527891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15927d7a-2546-4095-9b4b-a4acb7f9c071 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:56.527891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15927d7a-2546-4095-9b4b-a4acb7f9c071 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:56.527891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15927d7a-2546-4095-9b4b-a4acb7f9c071 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:56.533795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 329/663] 10.222.0.33 () {56 vars in 1139 bytes} [Thu Jun 23 12:53:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:56.534634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15927d7a-2546-4095-9b4b-a4acb7f9c071 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:56.596892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075c466-c567-47a8-9bcf-6de03f87c242 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:56.635014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:56.641896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15927d7a-2546-4095-9b4b-a4acb7f9c071 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:56.653414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66750cf0-dbe9-4d64-bc96-eb29783773d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:56.653414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66750cf0-dbe9-4d64-bc96-eb29783773d5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:56.653414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66750cf0-dbe9-4d64-bc96-eb29783773d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:56.653414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66750cf0-dbe9-4d64-bc96-eb29783773d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:56.655330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66750cf0-dbe9-4d64-bc96-eb29783773d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:56.657296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66750cf0-dbe9-4d64-bc96-eb29783773d5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-66750cf0-dbe9-4d64-bc96-eb29783773d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:56.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:56.678659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:56.679561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:56.679561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:56.679561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:56.679561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:56.679561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:56.679561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:56.679561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:56.679561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:56.681614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 335/664] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:56.682174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2c801-f866-4199-888e-69e18abfc323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:56.682794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66750cf0-dbe9-4d64-bc96-eb29783773d5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:56.683049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2c801-f866-4199-888e-69e18abfc323 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:56.683440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2c801-f866-4199-888e-69e18abfc323 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:56.683926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2c801-f866-4199-888e-69e18abfc323 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:56.684803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2c801-f866-4199-888e-69e18abfc323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:56.685233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2c801-f866-4199-888e-69e18abfc323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:56.688202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2c801-f866-4199-888e-69e18abfc323 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:56.702134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 330/665] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:56.703061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2c801-f866-4199-888e-69e18abfc323 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:56.754462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:56.817777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2c801-f866-4199-888e-69e18abfc323 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:56.829007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66750cf0-dbe9-4d64-bc96-eb29783773d5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:56.854425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc72a65-e73e-4c2c-99f7-905100fbdd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:56.855094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc72a65-e73e-4c2c-99f7-905100fbdd50 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:56.855436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc72a65-e73e-4c2c-99f7-905100fbdd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:56.855717 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc72a65-e73e-4c2c-99f7-905100fbdd50 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:56.856556 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc72a65-e73e-4c2c-99f7-905100fbdd50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:56.856898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc72a65-e73e-4c2c-99f7-905100fbdd50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:56.858325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc72a65-e73e-4c2c-99f7-905100fbdd50 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:56.871469 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 331/666] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:56.872294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc72a65-e73e-4c2c-99f7-905100fbdd50 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:56.882156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf977f-5c1a-4ca4-b479-36387d35e3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:56.882822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf977f-5c1a-4ca4-b479-36387d35e3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:56.883106 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf977f-5c1a-4ca4-b479-36387d35e3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:56.883750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf977f-5c1a-4ca4-b479-36387d35e3d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:56.954476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:56.964610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf977f-5c1a-4ca4-b479-36387d35e3d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:56.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf977f-5c1a-4ca4-b479-36387d35e3d5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:56.979185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc72a65-e73e-4c2c-99f7-905100fbdd50 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:56.981508 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:57.013083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dafde0-0c84-427a-8ad9-addcc1ebcc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:57.014184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dafde0-0c84-427a-8ad9-addcc1ebcc8a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.014822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dafde0-0c84-427a-8ad9-addcc1ebcc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.015385 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dafde0-0c84-427a-8ad9-addcc1ebcc8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.023581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dafde0-0c84-427a-8ad9-addcc1ebcc8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:57.025051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dafde0-0c84-427a-8ad9-addcc1ebcc8a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c7dafde0-0c84-427a-8ad9-addcc1ebcc8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:57.038432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:57.039517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:57.040427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:57.040427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:57.040427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:57.040427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:57.040427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:57.040427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:57.040427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:57.040427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:57.040427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 332/667] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:57.040427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dafde0-0c84-427a-8ad9-addcc1ebcc8a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:57.086176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 336/668] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:57.090525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1378bb-058c-469c-b4f2-25199d980525 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.090818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1378bb-058c-469c-b4f2-25199d980525 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.091098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1378bb-058c-469c-b4f2-25199d980525 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.092793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 337/669] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:57.093808 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1378bb-058c-469c-b4f2-25199d980525 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:57.150317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dafde0-0c84-427a-8ad9-addcc1ebcc8a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:57.182585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:57.184453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c06d5-10bb-4997-a906-e28cdbba2148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:57.185126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c06d5-10bb-4997-a906-e28cdbba2148 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.185407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c06d5-10bb-4997-a906-e28cdbba2148 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.185680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c06d5-10bb-4997-a906-e28cdbba2148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.186500 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c06d5-10bb-4997-a906-e28cdbba2148 None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=711d53a7deb94849b577c08dc9165ec8) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:57.186806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c06d5-10bb-4997-a906-e28cdbba2148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:57.188807 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c06d5-10bb-4997-a906-e28cdbba2148 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:57.193322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1378bb-058c-469c-b4f2-25199d980525 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:57.194479 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 333/670] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:57 2022] GET /identity/v3/role_assignments?user.id=711d53a7deb94849b577c08dc9165ec8&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:57.196166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9310195-3f88-45ee-8505-383bb37e4d40 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.196166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9310195-3f88-45ee-8505-383bb37e4d40 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.196166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9310195-3f88-45ee-8505-383bb37e4d40 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.197499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 334/671] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:57.198092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9310195-3f88-45ee-8505-383bb37e4d40 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:57.237076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34587c82-3aa2-429a-8991-ac251536ce73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:57.237761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:57.238885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34587c82-3aa2-429a-8991-ac251536ce73 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.239175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34587c82-3aa2-429a-8991-ac251536ce73 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.239454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34587c82-3aa2-429a-8991-ac251536ce73 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.240292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34587c82-3aa2-429a-8991-ac251536ce73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:57.240604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34587c82-3aa2-429a-8991-ac251536ce73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:57.242094 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34587c82-3aa2-429a-8991-ac251536ce73 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:57.255977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 338/672] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:57.257373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fba601-835c-476c-89df-6b9d1adb0d13 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.257669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fba601-835c-476c-89df-6b9d1adb0d13 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.257954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fba601-835c-476c-89df-6b9d1adb0d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.277422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-62fba601-835c-476c-89df-6b9d1adb0d13 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:57.278657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-62fba601-835c-476c-89df-6b9d1adb0d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:57.326761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9310195-3f88-45ee-8505-383bb37e4d40 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:57.356758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 339/673] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:57.356758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e08f05-7be9-4405-9809-70dcec664f77 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.356758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e08f05-7be9-4405-9809-70dcec664f77 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.356758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e08f05-7be9-4405-9809-70dcec664f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.363602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df544438-0a56-40e3-9aea-1cfa88f7d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:57.364700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df544438-0a56-40e3-9aea-1cfa88f7d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.364700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df544438-0a56-40e3-9aea-1cfa88f7d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.365016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df544438-0a56-40e3-9aea-1cfa88f7d3c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.377139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df544438-0a56-40e3-9aea-1cfa88f7d3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:57.377437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-43e08f05-7be9-4405-9809-70dcec664f77 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:57.378109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df544438-0a56-40e3-9aea-1cfa88f7d3c1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:57.378706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-43e08f05-7be9-4405-9809-70dcec664f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-df544438-0a56-40e3-9aea-1cfa88f7d3c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:57.397443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:57.398410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:57.399303 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:57.399303 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:57.399303 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:57.399303 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:57.399303 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 335/674] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:57.399576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df544438-0a56-40e3-9aea-1cfa88f7d3c1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:57.457772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 340/675] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:57.459009 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e08f05-7be9-4405-9809-70dcec664f77 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:57.473960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:57.495635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:57.516112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df544438-0a56-40e3-9aea-1cfa88f7d3c1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:57.551419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84e320-2eb5-472d-bd78-9b1f6ee14cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:57.552081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84e320-2eb5-472d-bd78-9b1f6ee14cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.552368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84e320-2eb5-472d-bd78-9b1f6ee14cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.552651 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84e320-2eb5-472d-bd78-9b1f6ee14cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.553517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84e320-2eb5-472d-bd78-9b1f6ee14cb2 None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=c1c0a73d629a47e4bdbd67da236240af) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:57.553832 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84e320-2eb5-472d-bd78-9b1f6ee14cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:57.555272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84e320-2eb5-472d-bd78-9b1f6ee14cb2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:57.568707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 336/676] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:57 2022] GET /identity/v3/role_assignments?user.id=c1c0a73d629a47e4bdbd67da236240af&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:57.568707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84e320-2eb5-472d-bd78-9b1f6ee14cb2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:57.589628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e08f05-7be9-4405-9809-70dcec664f77 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:57.643833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b83eb-9470-4c82-bf4c-525eb98ef36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:57.644805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b83eb-9470-4c82-bf4c-525eb98ef36d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.645161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b83eb-9470-4c82-bf4c-525eb98ef36d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.645509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b83eb-9470-4c82-bf4c-525eb98ef36d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.658306 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b83eb-9470-4c82-bf4c-525eb98ef36d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-5e4b83eb-9470-4c82-bf4c-525eb98ef36d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:57.666476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:57.667495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:57.668356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:57.668356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:57.668356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:57.668356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:57.668356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:57.668356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:57.668356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:57.668356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:57.668356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:57.668356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:57.668356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:53:57.668356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:57.672802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 341/677] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:53:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:57.673727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b83eb-9470-4c82-bf4c-525eb98ef36d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:57.692784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84e320-2eb5-472d-bd78-9b1f6ee14cb2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:57.737940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0a40b-765a-41eb-bfaf-cd6aa3baf118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:57.738641 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0a40b-765a-41eb-bfaf-cd6aa3baf118 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.738926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0a40b-765a-41eb-bfaf-cd6aa3baf118 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.739207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0a40b-765a-41eb-bfaf-cd6aa3baf118 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.739980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0a40b-765a-41eb-bfaf-cd6aa3baf118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:57.740282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0a40b-765a-41eb-bfaf-cd6aa3baf118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:57.741696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0a40b-765a-41eb-bfaf-cd6aa3baf118 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:57.756145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 337/678] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:57.757048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0a40b-765a-41eb-bfaf-cd6aa3baf118 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:57.760802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:57.762964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:57.796772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b83eb-9470-4c82-bf4c-525eb98ef36d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:57.839513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573354a6-721e-456c-91c3-764ce14c3189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:57.840551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573354a6-721e-456c-91c3-764ce14c3189 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.840855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573354a6-721e-456c-91c3-764ce14c3189 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.841135 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573354a6-721e-456c-91c3-764ce14c3189 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.857201 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573354a6-721e-456c-91c3-764ce14c3189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-573354a6-721e-456c-91c3-764ce14c3189 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:57.867366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:57.868491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:57.869552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:57.869552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:57.869552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:57.869552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:57.869552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:57.869552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:57.869552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:57.869552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:57.869552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:57.869552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:57.869552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:57.869552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:57.872593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 342/679] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:57.873735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573354a6-721e-456c-91c3-764ce14c3189 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:57.880704 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0a40b-765a-41eb-bfaf-cd6aa3baf118 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:57.916509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871ee69-e50f-46f6-ae58-980096d81c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:57.917470 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871ee69-e50f-46f6-ae58-980096d81c60 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:57.917903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871ee69-e50f-46f6-ae58-980096d81c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:57.918324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871ee69-e50f-46f6-ae58-980096d81c60 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:57.919244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871ee69-e50f-46f6-ae58-980096d81c60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:57.919741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871ee69-e50f-46f6-ae58-980096d81c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:57.921323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871ee69-e50f-46f6-ae58-980096d81c60 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:57.930281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 338/680] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:53:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:57.931434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871ee69-e50f-46f6-ae58-980096d81c60 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:57.991524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573354a6-721e-456c-91c3-764ce14c3189 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:57.999573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:58.025256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:58.031968 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d3ed5-da56-44c3-94b3-fd2a17ff85d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:58.032731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d3ed5-da56-44c3-94b3-fd2a17ff85d4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:58.033032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d3ed5-da56-44c3-94b3-fd2a17ff85d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:58.033298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d3ed5-da56-44c3-94b3-fd2a17ff85d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:58.038160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871ee69-e50f-46f6-ae58-980096d81c60 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:58.040452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d3ed5-da56-44c3-94b3-fd2a17ff85d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:58.042477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d3ed5-da56-44c3-94b3-fd2a17ff85d4 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-6c5d3ed5-da56-44c3-94b3-fd2a17ff85d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:58.059838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:58.060824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:58.061710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:58.061710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:58.061710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:58.061710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:58.061710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:58.061710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:58.061710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:58.061710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:58.065887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 343/681] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:58.067211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d3ed5-da56-44c3-94b3-fd2a17ff85d4 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:58.084598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78a3e4-0034-478e-b7f3-364cccd35440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:58.085619 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78a3e4-0034-478e-b7f3-364cccd35440 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:58.086105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78a3e4-0034-478e-b7f3-364cccd35440 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:58.086580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78a3e4-0034-478e-b7f3-364cccd35440 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:58.087522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78a3e4-0034-478e-b7f3-364cccd35440 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:58.088033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78a3e4-0034-478e-b7f3-364cccd35440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:58.089734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78a3e4-0034-478e-b7f3-364cccd35440 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:58.103706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 339/682] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:58.104875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78a3e4-0034-478e-b7f3-364cccd35440 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:58.176854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d3ed5-da56-44c3-94b3-fd2a17ff85d4 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:58.211526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571ebd-e82c-48cb-9b26-b1b2babf52dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:58.212256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571ebd-e82c-48cb-9b26-b1b2babf52dd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:58.212536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571ebd-e82c-48cb-9b26-b1b2babf52dd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:58.212861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571ebd-e82c-48cb-9b26-b1b2babf52dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:58.224018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01571ebd-e82c-48cb-9b26-b1b2babf52dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:58.225589 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01571ebd-e82c-48cb-9b26-b1b2babf52dd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:58.232260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78a3e4-0034-478e-b7f3-364cccd35440 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-01571ebd-e82c-48cb-9b26-b1b2babf52dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:58.245365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:58.246268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:58.247168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:58.247168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:58.247168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:58.247168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:58.252212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 344/683] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:58.253055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571ebd-e82c-48cb-9b26-b1b2babf52dd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:58.268469 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:58.284761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4954c-9971-4616-a11a-9207958b851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:58.284761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4954c-9971-4616-a11a-9207958b851a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:58.285014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4954c-9971-4616-a11a-9207958b851a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:58.285372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4954c-9971-4616-a11a-9207958b851a None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:58.286298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4954c-9971-4616-a11a-9207958b851a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:58.286783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4954c-9971-4616-a11a-9207958b851a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:58.288898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4954c-9971-4616-a11a-9207958b851a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:58.302903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 340/684] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:58.303966 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4954c-9971-4616-a11a-9207958b851a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:58.306700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:58.376702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571ebd-e82c-48cb-9b26-b1b2babf52dd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:58.412936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7cc3-bf70-4a63-a756-4f226446c73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:58.413933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7cc3-bf70-4a63-a756-4f226446c73e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:58.414390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7cc3-bf70-4a63-a756-4f226446c73e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:58.414779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7cc3-bf70-4a63-a756-4f226446c73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:58.426629 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7cc3-bf70-4a63-a756-4f226446c73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:58.428238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7cc3-bf70-4a63-a756-4f226446c73e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:58.432646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4954c-9971-4616-a11a-9207958b851a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-246f7cc3-bf70-4a63-a756-4f226446c73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:58.446191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:58.447211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:58.448108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:58.448108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:58.448108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:58.448108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:58.448108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 345/685] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:58.448872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7cc3-bf70-4a63-a756-4f226446c73e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:58.473128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c754e06-e452-4113-8ca2-b617f6d56763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:58.474190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c754e06-e452-4113-8ca2-b617f6d56763 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:58.474682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c754e06-e452-4113-8ca2-b617f6d56763 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:58.475166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c754e06-e452-4113-8ca2-b617f6d56763 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:58.476111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c754e06-e452-4113-8ca2-b617f6d56763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:58.476625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c754e06-e452-4113-8ca2-b617f6d56763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:58.478293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c754e06-e452-4113-8ca2-b617f6d56763 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:58.491149 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 341/686] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:58.492199 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c754e06-e452-4113-8ca2-b617f6d56763 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:58.542153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:58.556830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:58.563994 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7cc3-bf70-4a63-a756-4f226446c73e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:58.595998 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c754e06-e452-4113-8ca2-b617f6d56763 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:58.608360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bd289-2d65-4a8e-a93c-7b4b66c24b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:58.609527 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bd289-2d65-4a8e-a93c-7b4b66c24b6a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:58.610020 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bd289-2d65-4a8e-a93c-7b4b66c24b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:58.610498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bd289-2d65-4a8e-a93c-7b4b66c24b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:58.611621 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bd289-2d65-4a8e-a93c-7b4b66c24b6a None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=b1eb257517674c63840d6a2090eb2200) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:58.612188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bd289-2d65-4a8e-a93c-7b4b66c24b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:58.613953 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bd289-2d65-4a8e-a93c-7b4b66c24b6a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:58.620680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 346/687] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:58 2022] GET /identity/v3/role_assignments?user.id=b1eb257517674c63840d6a2090eb2200&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:58.621851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bd289-2d65-4a8e-a93c-7b4b66c24b6a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:58.634128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f7c5-af1d-4f9c-834b-df9819bcc28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:58.634564 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f7c5-af1d-4f9c-834b-df9819bcc28b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:58.634860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f7c5-af1d-4f9c-834b-df9819bcc28b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:58.635145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f7c5-af1d-4f9c-834b-df9819bcc28b None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:58.635900 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943f7c5-af1d-4f9c-834b-df9819bcc28b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:58.636220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943f7c5-af1d-4f9c-834b-df9819bcc28b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:58.637763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943f7c5-af1d-4f9c-834b-df9819bcc28b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:58.651739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 342/688] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:58.657598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f7c5-af1d-4f9c-834b-df9819bcc28b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:58.747864 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bd289-2d65-4a8e-a93c-7b4b66c24b6a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:58.764151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f7c5-af1d-4f9c-834b-df9819bcc28b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:58.781576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:58.802941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1262c3-becf-413b-a82c-3d846780d46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:58.803668 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1262c3-becf-413b-a82c-3d846780d46f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:58.803957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1262c3-becf-413b-a82c-3d846780d46f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:58.804237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1262c3-becf-413b-a82c-3d846780d46f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:58.813049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1262c3-becf-413b-a82c-3d846780d46f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:58.815176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1262c3-becf-413b-a82c-3d846780d46f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:58.826800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f7e6e-28d6-40a5-b84c-14c2a517e885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:58.827970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f7e6e-28d6-40a5-b84c-14c2a517e885 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:58.829024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f7e6e-28d6-40a5-b84c-14c2a517e885 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:58.829519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f7e6e-28d6-40a5-b84c-14c2a517e885 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-be1262c3-becf-413b-a82c-3d846780d46f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:58.833676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:58.834729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:58.835667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:58.835667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:58.835667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:58.835667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:58.835667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:58.835667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:58.835667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:58.835667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:58.835667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:53:58.835667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:58.835667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 343/689] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 23 12:53:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:58.841877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1262c3-becf-413b-a82c-3d846780d46f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:58.849978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f7e6e-28d6-40a5-b84c-14c2a517e885 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:58.851930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f7e6e-28d6-40a5-b84c-14c2a517e885 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-171f7e6e-28d6-40a5-b84c-14c2a517e885 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:58.884686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:58.885707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:58.886646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:58.886646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:58.886646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:58.886646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:58.886646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:58.886646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:58.886646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:58.886646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:58.886646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:53:58.886646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:53:58.886646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 347/690] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:58.889529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f7e6e-28d6-40a5-b84c-14c2a517e885 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:58.925777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:58.984102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1262c3-becf-413b-a82c-3d846780d46f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:59.030877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6559ca4-81db-48c5-8b84-8bf68ebedf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:59.032044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6559ca4-81db-48c5-8b84-8bf68ebedf89 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:59.032328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6559ca4-81db-48c5-8b84-8bf68ebedf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:59.032600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6559ca4-81db-48c5-8b84-8bf68ebedf89 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:59.034795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6559ca4-81db-48c5-8b84-8bf68ebedf89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:59.035074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6559ca4-81db-48c5-8b84-8bf68ebedf89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:59.036507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6559ca4-81db-48c5-8b84-8bf68ebedf89 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:59.038423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f7e6e-28d6-40a5-b84c-14c2a517e885 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:59.061288 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 344/691] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 23 12:53:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:59.067128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6559ca4-81db-48c5-8b84-8bf68ebedf89 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:59.085113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38634fd1-5626-404e-a03c-ba56c9a4dc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:59.086363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38634fd1-5626-404e-a03c-ba56c9a4dc1a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:59.087341 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38634fd1-5626-404e-a03c-ba56c9a4dc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:59.087869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38634fd1-5626-404e-a03c-ba56c9a4dc1a None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:59.089258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38634fd1-5626-404e-a03c-ba56c9a4dc1a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:59.089830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38634fd1-5626-404e-a03c-ba56c9a4dc1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:59.091805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38634fd1-5626-404e-a03c-ba56c9a4dc1a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:59.103964 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:59.117555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 348/692] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jun 23 12:53:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:59.126251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38634fd1-5626-404e-a03c-ba56c9a4dc1a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:59.205717 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6559ca4-81db-48c5-8b84-8bf68ebedf89 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:59.267893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:59.280293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1df612-618b-4b16-abf6-199cc772b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:59.281231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1df612-618b-4b16-abf6-199cc772b12a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:59.281688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1df612-618b-4b16-abf6-199cc772b12a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:59.282261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1df612-618b-4b16-abf6-199cc772b12a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:59.315070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38634fd1-5626-404e-a03c-ba56c9a4dc1a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:59.362578 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1df612-618b-4b16-abf6-199cc772b12a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:59.364698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1df612-618b-4b16-abf6-199cc772b12a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:59.393644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73214da-146e-4242-8f06-fd102a639d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:59.393644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73214da-146e-4242-8f06-fd102a639d7f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:59.393644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73214da-146e-4242-8f06-fd102a639d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:59.393644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73214da-146e-4242-8f06-fd102a639d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:59.415430 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:59.525053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73214da-146e-4242-8f06-fd102a639d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:59.527324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73214da-146e-4242-8f06-fd102a639d7f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:59.533617 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 345/693] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:59.535057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0e18f-d7b9-4f5b-9d45-553cf8b3d437 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:59.535351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0e18f-d7b9-4f5b-9d45-553cf8b3d437 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:59.535636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0e18f-d7b9-4f5b-9d45-553cf8b3d437 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:59.537273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 346/694] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:59.538022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0e18f-d7b9-4f5b-9d45-553cf8b3d437 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:59.623749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:59.653125 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 349/695] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:53:59.654927 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173709c-8349-4f0d-94e4-6f854504ccd4 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:59.655223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173709c-8349-4f0d-94e4-6f854504ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:59.655831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173709c-8349-4f0d-94e4-6f854504ccd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:59.666955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0e18f-d7b9-4f5b-9d45-553cf8b3d437 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:59.678139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0173709c-8349-4f0d-94e4-6f854504ccd4 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:59.679835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0173709c-8349-4f0d-94e4-6f854504ccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:59.697123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:59.707194 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf163-1720-4362-be71-82acc3896ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:59.708211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf163-1720-4362-be71-82acc3896ddd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:59.708562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf163-1720-4362-be71-82acc3896ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:59.708933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf163-1720-4362-be71-82acc3896ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:59.720381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf163-1720-4362-be71-82acc3896ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:59.722147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf163-1720-4362-be71-82acc3896ddd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-969bf163-1720-4362-be71-82acc3896ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:59.743195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:59.748152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:59.749116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:59.749116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:59.749116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:59.749116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:59.749116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 347/696] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:59.749116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf163-1720-4362-be71-82acc3896ddd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:59.761971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 350/697] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:53:59.763202 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173709c-8349-4f0d-94e4-6f854504ccd4 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:59.867777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf163-1720-4362-be71-82acc3896ddd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:59.890309 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173709c-8349-4f0d-94e4-6f854504ccd4 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:59.899926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:59.903382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5091d-1f29-4d96-ae37-6df4584358ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:59.904160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5091d-1f29-4d96-ae37-6df4584358ca None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:59.904440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5091d-1f29-4d96-ae37-6df4584358ca None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:59.904739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5091d-1f29-4d96-ae37-6df4584358ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:59.914841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5091d-1f29-4d96-ae37-6df4584358ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:59.916270 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5091d-1f29-4d96-ae37-6df4584358ca None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:59.926914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb9a38-01b2-4c3f-b042-e256bbabba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:59.927578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb9a38-01b2-4c3f-b042-e256bbabba3f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:59.927865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb9a38-01b2-4c3f-b042-e256bbabba3f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:59.928145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb9a38-01b2-4c3f-b042-e256bbabba3f None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:59.928924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb9a38-01b2-4c3f-b042-e256bbabba3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:59.929238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb9a38-01b2-4c3f-b042-e256bbabba3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:59.930598 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb9a38-01b2-4c3f-b042-e256bbabba3f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-d9d5091d-1f29-4d96-ae37-6df4584358ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:59.933972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:59.935049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:59.935972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:59.935972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:59.935972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:59.935972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:53:59.940298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 348/698] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:59.941145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5091d-1f29-4d96-ae37-6df4584358ca None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:59.946963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 351/699] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:59.946963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b271b-e56a-4c8a-9ad4-098f492c32d9 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:59.946963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b271b-e56a-4c8a-9ad4-098f492c32d9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:59.946963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b271b-e56a-4c8a-9ad4-098f492c32d9 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:59.951015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 352/700] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:53:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:59.951782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b271b-e56a-4c8a-9ad4-098f492c32d9 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:59.974164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:00.048009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5091d-1f29-4d96-ae37-6df4584358ca None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:00.063814 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b271b-e56a-4c8a-9ad4-098f492c32d9 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:00.083962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aec7c5-5060-4fca-affd-f7a3c685dee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:00.084788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aec7c5-5060-4fca-affd-f7a3c685dee3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:00.085076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aec7c5-5060-4fca-affd-f7a3c685dee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:00.085355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aec7c5-5060-4fca-affd-f7a3c685dee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:00.096647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aec7c5-5060-4fca-affd-f7a3c685dee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:00.098124 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aec7c5-5060-4fca-affd-f7a3c685dee3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:00.103181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc3eda-4f81-4164-8426-4274e730441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:00.103844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc3eda-4f81-4164-8426-4274e730441f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:00.104127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc3eda-4f81-4164-8426-4274e730441f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:00.104402 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc3eda-4f81-4164-8426-4274e730441f None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:00.105555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc3eda-4f81-4164-8426-4274e730441f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:00.105868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc3eda-4f81-4164-8426-4274e730441f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:00.107605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc3eda-4f81-4164-8426-4274e730441f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-b2aec7c5-5060-4fca-affd-f7a3c685dee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:00.115844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:00.116756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:00.118224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:00.118224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:00.118224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:00.118224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:00.118224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 349/701] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:00.118224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aec7c5-5060-4fca-affd-f7a3c685dee3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:00.130211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 353/702] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:00.130211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af87e6d-77d9-42ff-8f25-56e31c3f7627 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:00.130211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af87e6d-77d9-42ff-8f25-56e31c3f7627 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:00.130211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af87e6d-77d9-42ff-8f25-56e31c3f7627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:00.150053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2af87e6d-77d9-42ff-8f25-56e31c3f7627 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:00.151164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2af87e6d-77d9-42ff-8f25-56e31c3f7627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:00.173918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:00.209231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:00.224036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 354/703] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:54:00.225179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af87e6d-77d9-42ff-8f25-56e31c3f7627 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:00.238120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aec7c5-5060-4fca-affd-f7a3c685dee3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:00.275432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be073d37-83df-4f4d-a1c2-40963740e0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:00.276264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be073d37-83df-4f4d-a1c2-40963740e0ea None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:00.276549 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be073d37-83df-4f4d-a1c2-40963740e0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:00.276874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be073d37-83df-4f4d-a1c2-40963740e0ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:00.283610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be073d37-83df-4f4d-a1c2-40963740e0ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:00.285096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be073d37-83df-4f4d-a1c2-40963740e0ea None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-be073d37-83df-4f4d-a1c2-40963740e0ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:00.298978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:00.299837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:00.300748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:00.300748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:00.300748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:00.300748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:00.300748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:00.300748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:00.300748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:00.300748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:00.300748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 350/704] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:00.301235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be073d37-83df-4f4d-a1c2-40963740e0ea None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:00.338470 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af87e6d-77d9-42ff-8f25-56e31c3f7627 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:00.373697 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57adce4-e939-4f37-a51e-5ece549859fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:00.374352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57adce4-e939-4f37-a51e-5ece549859fe None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:00.374639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57adce4-e939-4f37-a51e-5ece549859fe None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:00.374916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57adce4-e939-4f37-a51e-5ece549859fe None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:00.376187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57adce4-e939-4f37-a51e-5ece549859fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:00.376496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57adce4-e939-4f37-a51e-5ece549859fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:00.377896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57adce4-e939-4f37-a51e-5ece549859fe None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:00.390229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 355/705] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:00.391256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57adce4-e939-4f37-a51e-5ece549859fe None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:00.410419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:00.414611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be073d37-83df-4f4d-a1c2-40963740e0ea None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:00.449216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f31885-17e1-4e4f-ad3e-e4c0cbc722bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:00.450008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f31885-17e1-4e4f-ad3e-e4c0cbc722bd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:00.450294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f31885-17e1-4e4f-ad3e-e4c0cbc722bd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:00.450577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f31885-17e1-4e4f-ad3e-e4c0cbc722bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:00.457245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f31885-17e1-4e4f-ad3e-e4c0cbc722bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:00.458668 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f31885-17e1-4e4f-ad3e-e4c0cbc722bd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-d7f31885-17e1-4e4f-ad3e-e4c0cbc722bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:00.474101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:00.474987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:00.475897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:00.475897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:00.475897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:00.475897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:00.475897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:00.475897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:00.475897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:00.475897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:00.475897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 351/706] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:00.476388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f31885-17e1-4e4f-ad3e-e4c0cbc722bd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:00.482311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:00.501619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57adce4-e939-4f37-a51e-5ece549859fe None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:00.536333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b4ef5-6af5-406d-b789-b062eea10ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:00.537221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b4ef5-6af5-406d-b789-b062eea10ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:00.537527 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b4ef5-6af5-406d-b789-b062eea10ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:00.537729 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b4ef5-6af5-406d-b789-b062eea10ee7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:00.538374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b4ef5-6af5-406d-b789-b062eea10ee7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:00.539733 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b4ef5-6af5-406d-b789-b062eea10ee7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-6f8b4ef5-6af5-406d-b789-b062eea10ee7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:00.554392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:00.555419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:00.561495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 356/707] 10.222.0.33 () {56 vars in 1129 bytes} [Thu Jun 23 12:54:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:00.563061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b4ef5-6af5-406d-b789-b062eea10ee7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:00.589089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f31885-17e1-4e4f-ad3e-e4c0cbc722bd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:00.623996 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d21a5-9ca0-4a37-a94e-c7a1d2c287bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:00.624671 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d21a5-9ca0-4a37-a94e-c7a1d2c287bb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:00.625486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d21a5-9ca0-4a37-a94e-c7a1d2c287bb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:00.625774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d21a5-9ca0-4a37-a94e-c7a1d2c287bb None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:00.626563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d21a5-9ca0-4a37-a94e-c7a1d2c287bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:00.626872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d21a5-9ca0-4a37-a94e-c7a1d2c287bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:00.628310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d21a5-9ca0-4a37-a94e-c7a1d2c287bb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:00.644824 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 352/708] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:00.644824 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d21a5-9ca0-4a37-a94e-c7a1d2c287bb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:00.652320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:00.673738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b4ef5-6af5-406d-b789-b062eea10ee7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:00.707143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:00.708019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df8b5c-0dd7-4bbd-a7e2-f59faaacd88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:00.708706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df8b5c-0dd7-4bbd-a7e2-f59faaacd88b None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:00.708989 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df8b5c-0dd7-4bbd-a7e2-f59faaacd88b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:00.709276 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df8b5c-0dd7-4bbd-a7e2-f59faaacd88b None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:00.709967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df8b5c-0dd7-4bbd-a7e2-f59faaacd88b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:00.711411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df8b5c-0dd7-4bbd-a7e2-f59faaacd88b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:00.747236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d21a5-9ca0-4a37-a94e-c7a1d2c287bb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:00.780776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c4779-53de-40e1-99b9-c446247b0468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:00.782053 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c4779-53de-40e1-99b9-c446247b0468 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:00.782344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c4779-53de-40e1-99b9-c446247b0468 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:00.782605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c4779-53de-40e1-99b9-c446247b0468 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:00.783498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c4779-53de-40e1-99b9-c446247b0468 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:00.783821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c4779-53de-40e1-99b9-c446247b0468 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:00.785263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c4779-53de-40e1-99b9-c446247b0468 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:00.797430 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 353/709] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:00.798222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c4779-53de-40e1-99b9-c446247b0468 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:00.893575 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c4779-53de-40e1-99b9-c446247b0468 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:00.916684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:00.918061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 357/710] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:54:00 2022] POST /identity/v3/users => generated 254 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:54:00.918881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df8b5c-0dd7-4bbd-a7e2-f59faaacd88b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:00.942416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bcd00-7218-4082-9ae4-1dd91c409287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:00.943367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bcd00-7218-4082-9ae4-1dd91c409287 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:00.943882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bcd00-7218-4082-9ae4-1dd91c409287 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:00.944320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bcd00-7218-4082-9ae4-1dd91c409287 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:00.945326 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bcd00-7218-4082-9ae4-1dd91c409287 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:00.945852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bcd00-7218-4082-9ae4-1dd91c409287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:00.947416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bcd00-7218-4082-9ae4-1dd91c409287 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:00.953747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 354/711] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jun 23 12:54:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:00.954917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bcd00-7218-4082-9ae4-1dd91c409287 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:01.071720 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bcd00-7218-4082-9ae4-1dd91c409287 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:01.073100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df8b5c-0dd7-4bbd-a7e2-f59faaacd88b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:01.116311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af587798-6e5a-47e0-8435-928bf73da9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:01.117013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af587798-6e5a-47e0-8435-928bf73da9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:01.117299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af587798-6e5a-47e0-8435-928bf73da9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:01.117576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af587798-6e5a-47e0-8435-928bf73da9c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:01.118410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af587798-6e5a-47e0-8435-928bf73da9c1 None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=79d23f1644b94d51a4d0efe47f7aab3f) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:01.118724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af587798-6e5a-47e0-8435-928bf73da9c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:01.120146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af587798-6e5a-47e0-8435-928bf73da9c1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:01.127517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1825ee4-1697-432c-a539-f3ce45f39d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:01.128274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 355/712] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:00 2022] GET /identity/v3/role_assignments?user.id=79d23f1644b94d51a4d0efe47f7aab3f&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:01.128721 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825ee4-1697-432c-a539-f3ce45f39d37 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:01.129097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af587798-6e5a-47e0-8435-928bf73da9c1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:01.129483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825ee4-1697-432c-a539-f3ce45f39d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:01.130067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825ee4-1697-432c-a539-f3ce45f39d37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:01.131124 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1825ee4-1697-432c-a539-f3ce45f39d37 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=311787f32b54485682be669bca9998f8, user.id=5874e98df57242028c0f9983dee3b5e8) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:01.131827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1825ee4-1697-432c-a539-f3ce45f39d37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:01.133642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1825ee4-1697-432c-a539-f3ce45f39d37 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:01.137568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:01.142174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 358/713] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:00 2022] GET /identity/v3/role_assignments?user.id=5874e98df57242028c0f9983dee3b5e8&scope.project.id=311787f32b54485682be669bca9998f8&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:01.145890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968988d-fb0d-4308-8562-683583eb79e4 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:01.146889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968988d-fb0d-4308-8562-683583eb79e4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:01.147533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968988d-fb0d-4308-8562-683583eb79e4 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:01.153813 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 359/714] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:54:01.156357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d44243-9258-467b-ac8a-54f8e1dda63d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:01.157063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d44243-9258-467b-ac8a-54f8e1dda63d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:01.157532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d44243-9258-467b-ac8a-54f8e1dda63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:01.178818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d3d44243-9258-467b-ac8a-54f8e1dda63d None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:01.180433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d3d44243-9258-467b-ac8a-54f8e1dda63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:01.206300 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:01.272243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 360/715] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:54:01.283146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af587798-6e5a-47e0-8435-928bf73da9c1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:01.298070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d44243-9258-467b-ac8a-54f8e1dda63d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:01.329078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a9b34-a127-4cc0-b556-458c03275318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:01.329763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a9b34-a127-4cc0-b556-458c03275318 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:01.330048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a9b34-a127-4cc0-b556-458c03275318 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:01.330324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a9b34-a127-4cc0-b556-458c03275318 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:01.331060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a9b34-a127-4cc0-b556-458c03275318 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:01.331358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a9b34-a127-4cc0-b556-458c03275318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:01.332782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a9b34-a127-4cc0-b556-458c03275318 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:01.340958 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 356/716] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jun 23 12:54:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:01.422819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d44243-9258-467b-ac8a-54f8e1dda63d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:01.459316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:01.465879 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb87eb-cbdc-4e97-a610-23f2447bb073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:01.466871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb87eb-cbdc-4e97-a610-23f2447bb073 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:01.467313 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb87eb-cbdc-4e97-a610-23f2447bb073 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:01.467695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb87eb-cbdc-4e97-a610-23f2447bb073 None admin] PATH_INFO: `/v3/services/network` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:01.468528 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb87eb-cbdc-4e97-a610-23f2447bb073 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:01.470115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb87eb-cbdc-4e97-a610-23f2447bb073 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-1bfb87eb-cbdc-4e97-a610-23f2447bb073 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:01.483013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:01.484365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:01.493373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 361/717] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:01 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:01.494328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a9b34-a127-4cc0-b556-458c03275318 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:01.602410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a9b34-a127-4cc0-b556-458c03275318 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:01.617248 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:01.638680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9e2a9-1e74-45bf-9455-79fb9d2b4666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:01.639632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9e2a9-1e74-45bf-9455-79fb9d2b4666 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:01.640079 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9e2a9-1e74-45bf-9455-79fb9d2b4666 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:01.640570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9e2a9-1e74-45bf-9455-79fb9d2b4666 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:01.641578 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9e2a9-1e74-45bf-9455-79fb9d2b4666 None admin] RBAC: Adding query filter params (name=network) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:01.642028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9e2a9-1e74-45bf-9455-79fb9d2b4666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:01.643555 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9e2a9-1e74-45bf-9455-79fb9d2b4666 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:01.649939 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 357/718] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:01.655180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb87eb-cbdc-4e97-a610-23f2447bb073 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:01.780751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb87eb-cbdc-4e97-a610-23f2447bb073 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:01.825145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9058f3-fa54-4134-a250-058ef48b90d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:01.825855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9058f3-fa54-4134-a250-058ef48b90d1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:01.826146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9058f3-fa54-4134-a250-058ef48b90d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:01.826427 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9058f3-fa54-4134-a250-058ef48b90d1 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:01.827208 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9058f3-fa54-4134-a250-058ef48b90d1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:01.827522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9058f3-fa54-4134-a250-058ef48b90d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:01.828936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9058f3-fa54-4134-a250-058ef48b90d1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:01.839070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 362/719] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:03.581625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78bd8-b347-48af-b5b4-1ce7350df247 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:03.582149 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78bd8-b347-48af-b5b4-1ce7350df247 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:03.582149 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78bd8-b347-48af-b5b4-1ce7350df247 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:03.583753 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 358/720] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:03.589052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a6177-1e6e-48ad-b50b-057fd282b293 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:03.589483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a6177-1e6e-48ad-b50b-057fd282b293 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:03.589655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a6177-1e6e-48ad-b50b-057fd282b293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:03.612694 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-970a6177-1e6e-48ad-b50b-057fd282b293 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:03.613880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-970a6177-1e6e-48ad-b50b-057fd282b293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:03.651162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c058cf7-9025-4dac-af42-1262d5cd1e1c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:03.651495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c058cf7-9025-4dac-af42-1262d5cd1e1c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:03.651723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c058cf7-9025-4dac-af42-1262d5cd1e1c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:03.653378 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 359/721] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:03.658574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efbfbe-5411-44e5-8964-4f52098fecae None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:03.658865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efbfbe-5411-44e5-8964-4f52098fecae None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:03.659151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efbfbe-5411-44e5-8964-4f52098fecae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:03.685406 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-54efbfbe-5411-44e5-8964-4f52098fecae None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:03.686598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-54efbfbe-5411-44e5-8964-4f52098fecae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:03.692003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:03.714476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 363/722] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:54:03.753966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a6177-1e6e-48ad-b50b-057fd282b293 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:03.798258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 360/723] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:54:03.846269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efbfbe-5411-44e5-8964-4f52098fecae None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:03.902706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a6177-1e6e-48ad-b50b-057fd282b293 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:03.937035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac67064-0330-4d6c-b617-68f1a9302ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:03.938424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac67064-0330-4d6c-b617-68f1a9302ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:03.938709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac67064-0330-4d6c-b617-68f1a9302ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:03.938985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac67064-0330-4d6c-b617-68f1a9302ac4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:03.949693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac67064-0330-4d6c-b617-68f1a9302ac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-eac67064-0330-4d6c-b617-68f1a9302ac4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:03.963936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:03.964972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:03.965811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:03.965811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:03.965811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:03.965811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:03.965811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:03.965811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:03.965811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:03.965811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:03.965811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:03.965811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:03.965811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:54:03.965811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:03.970637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 364/724] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:54:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:03.982918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac67064-0330-4d6c-b617-68f1a9302ac4 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:04.040525 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efbfbe-5411-44e5-8964-4f52098fecae None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:04.051829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:04.055680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:04.082817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f858c-e7f2-4cfa-8175-ef36a488752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:04.083912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f858c-e7f2-4cfa-8175-ef36a488752c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.084206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f858c-e7f2-4cfa-8175-ef36a488752c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.084488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f858c-e7f2-4cfa-8175-ef36a488752c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.098063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f858c-e7f2-4cfa-8175-ef36a488752c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-405f858c-e7f2-4cfa-8175-ef36a488752c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:04.107995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:04.109742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:04.110722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 361/725] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:54:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:04.111473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cbfe6-3ed9-402a-ae78-bae3790e6477 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.116878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cbfe6-3ed9-402a-ae78-bae3790e6477 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.117174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cbfe6-3ed9-402a-ae78-bae3790e6477 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.122625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 362/726] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:04.122625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cbfe6-3ed9-402a-ae78-bae3790e6477 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:04.129844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac67064-0330-4d6c-b617-68f1a9302ac4 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:04.168237 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aede139-ef85-4355-a782-54eb905d4723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:04.169273 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede139-ef85-4355-a782-54eb905d4723 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.169740 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede139-ef85-4355-a782-54eb905d4723 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.170213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede139-ef85-4355-a782-54eb905d4723 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.171137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aede139-ef85-4355-a782-54eb905d4723 None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:04.171804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aede139-ef85-4355-a782-54eb905d4723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:04.173889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aede139-ef85-4355-a782-54eb905d4723 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:04.182949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 365/727] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:54:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:04.184568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664e8f6-ecb5-46c4-a8e4-3c167fc7fc0a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.185213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664e8f6-ecb5-46c4-a8e4-3c167fc7fc0a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.185671 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664e8f6-ecb5-46c4-a8e4-3c167fc7fc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.202053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c664e8f6-ecb5-46c4-a8e4-3c167fc7fc0a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:04.203260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c664e8f6-ecb5-46c4-a8e4-3c167fc7fc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:04.243407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cbfe6-3ed9-402a-ae78-bae3790e6477 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:04.269156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 366/728] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:54:04.270487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e62235-0167-4ea4-b8bb-12ddab0a33cb None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.270853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e62235-0167-4ea4-b8bb-12ddab0a33cb None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.271160 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e62235-0167-4ea4-b8bb-12ddab0a33cb None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.272644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 367/729] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:04.273334 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e62235-0167-4ea4-b8bb-12ddab0a33cb None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:04.288603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406607f-dd8b-4b46-b3ce-25dd1e523bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:04.289742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406607f-dd8b-4b46-b3ce-25dd1e523bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.290247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406607f-dd8b-4b46-b3ce-25dd1e523bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.290633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406607f-dd8b-4b46-b3ce-25dd1e523bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.291397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406607f-dd8b-4b46-b3ce-25dd1e523bd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:04.291865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406607f-dd8b-4b46-b3ce-25dd1e523bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:04.295251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406607f-dd8b-4b46-b3ce-25dd1e523bd7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:04.304646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 363/730] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:54:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:04.305762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00802ec3-9207-4932-beb4-27c70ef83654 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.306053 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00802ec3-9207-4932-beb4-27c70ef83654 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.306334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00802ec3-9207-4932-beb4-27c70ef83654 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.307565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 364/731] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:04.308598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec8698-32e5-4003-b411-110608344d58 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.308911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec8698-32e5-4003-b411-110608344d58 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.309285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec8698-32e5-4003-b411-110608344d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.323739 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:04.327177 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c2ec8698-32e5-4003-b411-110608344d58 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:04.329084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c2ec8698-32e5-4003-b411-110608344d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:04.352034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:04.381262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e62235-0167-4ea4-b8bb-12ddab0a33cb None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:04.393682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 365/732] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:54:04.394479 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec8698-32e5-4003-b411-110608344d58 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:04.419723 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09155b-a6db-49cd-af4e-416064b37d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:04.420528 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09155b-a6db-49cd-af4e-416064b37d64 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.420837 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09155b-a6db-49cd-af4e-416064b37d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.421121 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09155b-a6db-49cd-af4e-416064b37d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.431196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09155b-a6db-49cd-af4e-416064b37d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:04.432641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09155b-a6db-49cd-af4e-416064b37d64 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-bf09155b-a6db-49cd-af4e-416064b37d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:04.450277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:04.451360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:04.452553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:04.452553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:04.452553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:04.452553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:04.452553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 368/733] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:04.452553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09155b-a6db-49cd-af4e-416064b37d64 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:04.494264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec8698-32e5-4003-b411-110608344d58 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:04.529514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71647cf-40c9-41d2-ac93-b739f1b816af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:04.530242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71647cf-40c9-41d2-ac93-b739f1b816af None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.530524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71647cf-40c9-41d2-ac93-b739f1b816af None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.530802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71647cf-40c9-41d2-ac93-b739f1b816af None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.531563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71647cf-40c9-41d2-ac93-b739f1b816af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:04.533014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71647cf-40c9-41d2-ac93-b739f1b816af None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:04.542399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:04.551240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09155b-a6db-49cd-af4e-416064b37d64 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:04.583827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bf8a2-007a-4007-b013-e58f75f464e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:04.587785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bf8a2-007a-4007-b013-e58f75f464e3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.587785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bf8a2-007a-4007-b013-e58f75f464e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.587785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bf8a2-007a-4007-b013-e58f75f464e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.595229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bf8a2-007a-4007-b013-e58f75f464e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:04.596649 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bf8a2-007a-4007-b013-e58f75f464e3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-f29bf8a2-007a-4007-b013-e58f75f464e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:04.614041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:04.614909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:04.616245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:04.616245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:04.616245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:04.616245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:04.616245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 369/734] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:04.616603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296243c-c171-469e-9e7b-3f6ba1d026c9 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.616603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296243c-c171-469e-9e7b-3f6ba1d026c9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.616860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296243c-c171-469e-9e7b-3f6ba1d026c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.632778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0296243c-c171-469e-9e7b-3f6ba1d026c9 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:04.633969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0296243c-c171-469e-9e7b-3f6ba1d026c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:04.674063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 366/735] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:54:04 2022] POST /identity/v3/services => generated 251 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:54:04.674063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71647cf-40c9-41d2-ac93-b739f1b816af None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:04.696538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:04.716394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 370/736] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:54:04.717581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296243c-c171-469e-9e7b-3f6ba1d026c9 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:04.794439 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71647cf-40c9-41d2-ac93-b739f1b816af None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:04.801333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:04.831765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c4d39-7b8b-4b32-a42a-5a0d4b34ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:04.832569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c4d39-7b8b-4b32-a42a-5a0d4b34ef85 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.832905 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c4d39-7b8b-4b32-a42a-5a0d4b34ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.833181 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c4d39-7b8b-4b32-a42a-5a0d4b34ef85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.835157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296243c-c171-469e-9e7b-3f6ba1d026c9 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:04.847571 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c4d39-7b8b-4b32-a42a-5a0d4b34ef85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-206c4d39-7b8b-4b32-a42a-5a0d4b34ef85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:04.855305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:04.856294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:04.857362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 367/737] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:54:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:04.858219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c4d39-7b8b-4b32-a42a-5a0d4b34ef85 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:04.877473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bf4a2-f6fa-4195-9a57-9d0086544532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:04.878374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bf4a2-f6fa-4195-9a57-9d0086544532 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:04.878810 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bf4a2-f6fa-4195-9a57-9d0086544532 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:04.879255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bf4a2-f6fa-4195-9a57-9d0086544532 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:04.880162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bf4a2-f6fa-4195-9a57-9d0086544532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:04.880477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bf4a2-f6fa-4195-9a57-9d0086544532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:04.881890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bf4a2-f6fa-4195-9a57-9d0086544532 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:04.895850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 371/738] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:04.897225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bf4a2-f6fa-4195-9a57-9d0086544532 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:04.947476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:04.967174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c4d39-7b8b-4b32-a42a-5a0d4b34ef85 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:05.002088 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bf4a2-f6fa-4195-9a57-9d0086544532 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:05.003013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e8a0b-2397-4804-bf14-724a0f0d3aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:05.003683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e8a0b-2397-4804-bf14-724a0f0d3aeb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:05.003970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e8a0b-2397-4804-bf14-724a0f0d3aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:05.004246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e8a0b-2397-4804-bf14-724a0f0d3aeb None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:05.005011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e8a0b-2397-4804-bf14-724a0f0d3aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:05.005320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e8a0b-2397-4804-bf14-724a0f0d3aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:05.006690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e8a0b-2397-4804-bf14-724a0f0d3aeb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:05.019711 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 368/739] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:05.020574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e8a0b-2397-4804-bf14-724a0f0d3aeb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:05.143446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e8a0b-2397-4804-bf14-724a0f0d3aeb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:05.146424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:05.152401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c9cf6-f2d6-40d6-9951-12e70dc4fb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:05.153099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c9cf6-f2d6-40d6-9951-12e70dc4fb1e None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:05.153436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c9cf6-f2d6-40d6-9951-12e70dc4fb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:05.153758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c9cf6-f2d6-40d6-9951-12e70dc4fb1e None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:05.154433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c9cf6-f2d6-40d6-9951-12e70dc4fb1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:05.156511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c9cf6-f2d6-40d6-9951-12e70dc4fb1e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:05.179831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b23230-1ae0-4c29-ab94-7c10fc299e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:05.180614 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b23230-1ae0-4c29-ab94-7c10fc299e7b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:05.186292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b23230-1ae0-4c29-ab94-7c10fc299e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:05.186292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b23230-1ae0-4c29-ab94-7c10fc299e7b None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:05.186292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b23230-1ae0-4c29-ab94-7c10fc299e7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:05.186292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b23230-1ae0-4c29-ab94-7c10fc299e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:05.186292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b23230-1ae0-4c29-ab94-7c10fc299e7b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:05.192395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 369/740] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:54:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:05.193225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b23230-1ae0-4c29-ab94-7c10fc299e7b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:05.195883 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:05.248698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 372/741] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:54:04 2022] POST /identity/v3/services => generated 240 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:54:05.248698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c9cf6-f2d6-40d6-9951-12e70dc4fb1e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:05.331119 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b23230-1ae0-4c29-ab94-7c10fc299e7b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:05.377180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dffad-e832-45b5-a1cd-7527ea105b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:05.378010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dffad-e832-45b5-a1cd-7527ea105b65 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:05.378297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dffad-e832-45b5-a1cd-7527ea105b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:05.378633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dffad-e832-45b5-a1cd-7527ea105b65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:05.379606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c9cf6-f2d6-40d6-9951-12e70dc4fb1e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:05.387551 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8dffad-e832-45b5-a1cd-7527ea105b65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:05.389140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8dffad-e832-45b5-a1cd-7527ea105b65 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-bb8dffad-e832-45b5-a1cd-7527ea105b65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:05.406344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:05.407335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:05.408298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:05.408298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:05.408298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:05.408298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:05.408298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:05.408298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:05.408298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:05.408298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:05.408298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:54:05.408298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:05.412232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 370/742] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 23 12:54:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:05.413144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dffad-e832-45b5-a1cd-7527ea105b65 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:05.421005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56a347-01d5-4e1e-ae8e-4d830cf7efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:05.422335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56a347-01d5-4e1e-ae8e-4d830cf7efaf None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:05.422616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56a347-01d5-4e1e-ae8e-4d830cf7efaf None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:05.422892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56a347-01d5-4e1e-ae8e-4d830cf7efaf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:05.431519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56a347-01d5-4e1e-ae8e-4d830cf7efaf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:05.433337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56a347-01d5-4e1e-ae8e-4d830cf7efaf None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-be56a347-01d5-4e1e-ae8e-4d830cf7efaf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:05.449036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:05.450233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:05.451231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:05.451231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:05.451231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:05.451231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:05.451231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:05.451231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:05.451231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:05.451231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:05.451231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:54:05.451231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:05.453626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 373/743] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 23 12:54:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:05.454605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56a347-01d5-4e1e-ae8e-4d830cf7efaf None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:05.495336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:05.516530 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:05.552483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dffad-e832-45b5-a1cd-7527ea105b65 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:05.588109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56a347-01d5-4e1e-ae8e-4d830cf7efaf None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:05.598497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3acb9-36cc-48d6-93ff-22a5f605b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:05.599433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3acb9-36cc-48d6-93ff-22a5f605b0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:05.599724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3acb9-36cc-48d6-93ff-22a5f605b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:05.599998 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3acb9-36cc-48d6-93ff-22a5f605b0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:05.612024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3acb9-36cc-48d6-93ff-22a5f605b0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:05.613650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3acb9-36cc-48d6-93ff-22a5f605b0e1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:05.627381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52219d-1d19-42ce-9fd0-1279826feea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:05.628054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52219d-1d19-42ce-9fd0-1279826feea6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:05.628401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52219d-1d19-42ce-9fd0-1279826feea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:05.628776 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52219d-1d19-42ce-9fd0-1279826feea6 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:05.629651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52219d-1d19-42ce-9fd0-1279826feea6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:05.630010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52219d-1d19-42ce-9fd0-1279826feea6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:05.631439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52219d-1d19-42ce-9fd0-1279826feea6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-1dd3acb9-36cc-48d6-93ff-22a5f605b0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:05.633695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:05.634568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:05.635882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:05.635882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:05.635882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:05.635882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:05.635882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 371/744] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:05.636157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3acb9-36cc-48d6-93ff-22a5f605b0e1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:05.650548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 374/745] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jun 23 12:54:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:05.656553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52219d-1d19-42ce-9fd0-1279826feea6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:05.748724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3acb9-36cc-48d6-93ff-22a5f605b0e1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:05.759780 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52219d-1d19-42ce-9fd0-1279826feea6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:05.760523 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:05.762453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:05.787481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09042f85-2eb2-499b-9aa7-107f3f1296a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:05.789699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09042f85-2eb2-499b-9aa7-107f3f1296a3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:05.789699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09042f85-2eb2-499b-9aa7-107f3f1296a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:05.789699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09042f85-2eb2-499b-9aa7-107f3f1296a3 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:05.790352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09042f85-2eb2-499b-9aa7-107f3f1296a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:05.790801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09042f85-2eb2-499b-9aa7-107f3f1296a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:05.792452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09042f85-2eb2-499b-9aa7-107f3f1296a3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:05.796086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a338863-84aa-45ab-ab0f-f806de3f4512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:05.797413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a338863-84aa-45ab-ab0f-f806de3f4512 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:05.797717 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a338863-84aa-45ab-ab0f-f806de3f4512 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:05.797997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a338863-84aa-45ab-ab0f-f806de3f4512 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:05.798733 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a338863-84aa-45ab-ab0f-f806de3f4512 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:05.799045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a338863-84aa-45ab-ab0f-f806de3f4512 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:05.800416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a338863-84aa-45ab-ab0f-f806de3f4512 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:05.817524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 375/746] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:05.817524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a338863-84aa-45ab-ab0f-f806de3f4512 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:05.824398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 372/747] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 23 12:54:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:05.825092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09042f85-2eb2-499b-9aa7-107f3f1296a3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:05.923957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a338863-84aa-45ab-ab0f-f806de3f4512 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:05.941021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09042f85-2eb2-499b-9aa7-107f3f1296a3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:05.957960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd94090-662c-4afa-92f5-aebda3cc803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:05.958622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd94090-662c-4afa-92f5-aebda3cc803a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:05.958908 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd94090-662c-4afa-92f5-aebda3cc803a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:05.959204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd94090-662c-4afa-92f5-aebda3cc803a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:05.978293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373e96e-e4ac-4e18-bcfc-a4eff69adac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:05.979409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373e96e-e4ac-4e18-bcfc-a4eff69adac6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:05.979833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373e96e-e4ac-4e18-bcfc-a4eff69adac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:05.980250 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373e96e-e4ac-4e18-bcfc-a4eff69adac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:05.991918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:05.993457 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373e96e-e4ac-4e18-bcfc-a4eff69adac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:05.995124 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373e96e-e4ac-4e18-bcfc-a4eff69adac6 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-9373e96e-e4ac-4e18-bcfc-a4eff69adac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:06.014275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:06.015908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:06.016908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:06.016908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:06.016908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:06.016908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:06.023227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 373/748] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:06.024245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373e96e-e4ac-4e18-bcfc-a4eff69adac6 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:06.030560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd94090-662c-4afa-92f5-aebda3cc803a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:06.032560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd94090-662c-4afa-92f5-aebda3cc803a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:06.049014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:06.137245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373e96e-e4ac-4e18-bcfc-a4eff69adac6 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:06.138175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 376/749] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:54:06.138934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd94090-662c-4afa-92f5-aebda3cc803a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:06.176227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff101-e816-4eaf-b710-64d8b47a590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:06.177286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff101-e816-4eaf-b710-64d8b47a590d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:06.177715 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff101-e816-4eaf-b710-64d8b47a590d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:06.178132 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff101-e816-4eaf-b710-64d8b47a590d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:06.186167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dff101-e816-4eaf-b710-64d8b47a590d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:06.188557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dff101-e816-4eaf-b710-64d8b47a590d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:06.202761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-74dff101-e816-4eaf-b710-64d8b47a590d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:06.205289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:06.206394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:06.207486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:06.207486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:06.207486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:06.207486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:06.207486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:06.207486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:06.207486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:06.207486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:06.207486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:54:06.207486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:06.212890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 374/750] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:54:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:06.213865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff101-e816-4eaf-b710-64d8b47a590d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:06.241112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd94090-662c-4afa-92f5-aebda3cc803a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:06.276155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e81661-db35-494b-afce-9b395020e72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:06.276878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e81661-db35-494b-afce-9b395020e72e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:06.277170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e81661-db35-494b-afce-9b395020e72e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:06.277450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e81661-db35-494b-afce-9b395020e72e None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:06.278202 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e81661-db35-494b-afce-9b395020e72e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:06.278495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e81661-db35-494b-afce-9b395020e72e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:06.279855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e81661-db35-494b-afce-9b395020e72e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:06.296124 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 377/751] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:06.296124 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e81661-db35-494b-afce-9b395020e72e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:06.308790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:06.331476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff101-e816-4eaf-b710-64d8b47a590d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:06.370463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc7709-e3f8-469c-bd47-4fe42fa696f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:06.371643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc7709-e3f8-469c-bd47-4fe42fa696f6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:06.372068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc7709-e3f8-469c-bd47-4fe42fa696f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:06.372538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc7709-e3f8-469c-bd47-4fe42fa696f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:06.385767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc7709-e3f8-469c-bd47-4fe42fa696f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:06.387483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc7709-e3f8-469c-bd47-4fe42fa696f6 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:06.398559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e81661-db35-494b-afce-9b395020e72e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-28dc7709-e3f8-469c-bd47-4fe42fa696f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:06.407530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:06.408630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:06.409689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:06.409689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:06.409689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:06.409689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:06.411717 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 375/752] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:06.412776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc7709-e3f8-469c-bd47-4fe42fa696f6 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:06.430138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:06.440799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab051d-cac1-4164-9c47-77ef8a57ceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:06.441487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab051d-cac1-4164-9c47-77ef8a57ceb5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:06.441781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab051d-cac1-4164-9c47-77ef8a57ceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:06.442067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab051d-cac1-4164-9c47-77ef8a57ceb5 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:06.442956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab051d-cac1-4164-9c47-77ef8a57ceb5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:06.443222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab051d-cac1-4164-9c47-77ef8a57ceb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:06.444652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab051d-cac1-4164-9c47-77ef8a57ceb5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:06.468322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 378/753] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jun 23 12:54:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:06.468322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab051d-cac1-4164-9c47-77ef8a57ceb5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:06.536143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc7709-e3f8-469c-bd47-4fe42fa696f6 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:06.567084 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab051d-cac1-4164-9c47-77ef8a57ceb5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:06.568618 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:06.574427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207446b-b240-475f-9c29-e28b12cec280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:06.575384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207446b-b240-475f-9c29-e28b12cec280 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:06.575921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207446b-b240-475f-9c29-e28b12cec280 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:06.576451 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207446b-b240-475f-9c29-e28b12cec280 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:06.583983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207446b-b240-475f-9c29-e28b12cec280 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:06.585929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207446b-b240-475f-9c29-e28b12cec280 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-3207446b-b240-475f-9c29-e28b12cec280 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:06.603282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:06.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:06.605389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:06.605389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:06.605389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:06.605389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:06.605389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:06.605389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:06.605389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:06.605389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:06.605802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312ad0-2f39-4575-be02-9346f4b2b7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:06.605802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312ad0-2f39-4575-be02-9346f4b2b7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:06.605802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312ad0-2f39-4575-be02-9346f4b2b7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:06.605802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312ad0-2f39-4575-be02-9346f4b2b7b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:06.606070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f312ad0-2f39-4575-be02-9346f4b2b7b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:06.606070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f312ad0-2f39-4575-be02-9346f4b2b7b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:06.606980 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f312ad0-2f39-4575-be02-9346f4b2b7b7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:06.612920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 376/754] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:06.614020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207446b-b240-475f-9c29-e28b12cec280 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:06.619664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 379/755] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:06.620518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312ad0-2f39-4575-be02-9346f4b2b7b7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:06.668247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:06.726008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207446b-b240-475f-9c29-e28b12cec280 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:06.726210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312ad0-2f39-4575-be02-9346f4b2b7b7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:06.761119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6d2f7-97aa-40e0-b7ff-f2ed7d1a3308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:06.761881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6d2f7-97aa-40e0-b7ff-f2ed7d1a3308 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:06.762172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6d2f7-97aa-40e0-b7ff-f2ed7d1a3308 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:06.762452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6d2f7-97aa-40e0-b7ff-f2ed7d1a3308 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:06.763460 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6d2f7-97aa-40e0-b7ff-f2ed7d1a3308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:06.763862 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6d2f7-97aa-40e0-b7ff-f2ed7d1a3308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:06.764533 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528abea-a956-41d9-9a70-099b8814fc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:06.765386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6d2f7-97aa-40e0-b7ff-f2ed7d1a3308 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:06.765978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528abea-a956-41d9-9a70-099b8814fc2c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:06.766456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528abea-a956-41d9-9a70-099b8814fc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:06.767068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528abea-a956-41d9-9a70-099b8814fc2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:06.783843 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 380/756] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:06.784793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6d2f7-97aa-40e0-b7ff-f2ed7d1a3308 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:06.835522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:06.845403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528abea-a956-41d9-9a70-099b8814fc2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:06.846843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528abea-a956-41d9-9a70-099b8814fc2c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:06.889218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6d2f7-97aa-40e0-b7ff-f2ed7d1a3308 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:06.890756 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:06.925295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b7a2c-341a-4117-b3b8-d416af604647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:06.926088 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b7a2c-341a-4117-b3b8-d416af604647 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:06.926371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b7a2c-341a-4117-b3b8-d416af604647 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:06.926645 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b7a2c-341a-4117-b3b8-d416af604647 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:06.934467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b7a2c-341a-4117-b3b8-d416af604647 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:06.935892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b7a2c-341a-4117-b3b8-d416af604647 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-441b7a2c-341a-4117-b3b8-d416af604647 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:06.951441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:06.952384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:06.953369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:06.953369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:06.953369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:06.953369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:06.953369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:06.953369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:06.953369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:06.953369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:06.953369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 381/757] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:06.954387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9bd03-243c-4740-833b-dd22067a6577 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:06.954790 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9bd03-243c-4740-833b-dd22067a6577 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:06.955165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9bd03-243c-4740-833b-dd22067a6577 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:06.960706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 382/758] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:06.960706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9bd03-243c-4740-833b-dd22067a6577 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:06.963932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 377/759] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:54:06.964970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528abea-a956-41d9-9a70-099b8814fc2c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:07.060869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:07.070232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9bd03-243c-4740-833b-dd22067a6577 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:07.070783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528abea-a956-41d9-9a70-099b8814fc2c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:07.106486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c5fda-0b41-4af8-8ede-fcef96fa5011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:07.106694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156979dd-9268-4523-84d9-c2f80b432f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:07.107315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156979dd-9268-4523-84d9-c2f80b432f1e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:07.107455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c5fda-0b41-4af8-8ede-fcef96fa5011 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:07.107659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c5fda-0b41-4af8-8ede-fcef96fa5011 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:07.107943 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c5fda-0b41-4af8-8ede-fcef96fa5011 None admin] PATH_INFO: `/v3/projects/311787f32b54485682be669bca9998f8/users/5874e98df57242028c0f9983dee3b5e8/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:07.108255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156979dd-9268-4523-84d9-c2f80b432f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:07.108785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156979dd-9268-4523-84d9-c2f80b432f1e None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:07.110653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156979dd-9268-4523-84d9-c2f80b432f1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:07.110973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156979dd-9268-4523-84d9-c2f80b432f1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:07.112444 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156979dd-9268-4523-84d9-c2f80b432f1e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:07.113450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c5fda-0b41-4af8-8ede-fcef96fa5011 None admin] RBAC: Authorizing `identity:create_grant(project_id=311787f32b54485682be669bca9998f8, user_id=5874e98df57242028c0f9983dee3b5e8, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:07.114905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c5fda-0b41-4af8-8ede-fcef96fa5011 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:07.124227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 378/760] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:07.126243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a8fa6-7a85-4cf9-b9db-3e4799c4f72e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:07.126540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a8fa6-7a85-4cf9-b9db-3e4799c4f72e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:07.126824 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a8fa6-7a85-4cf9-b9db-3e4799c4f72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:07.142850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8e5a8fa6-7a85-4cf9-b9db-3e4799c4f72e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:07.144030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8e5a8fa6-7a85-4cf9-b9db-3e4799c4f72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:07.186893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 383/761] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:54:06 2022] PUT /identity/v3/projects/311787f32b54485682be669bca9998f8/users/5874e98df57242028c0f9983dee3b5e8/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:54:07.187883 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c5fda-0b41-4af8-8ede-fcef96fa5011 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:07.223882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:07.238784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 379/762] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:07.239679 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a8fa6-7a85-4cf9-b9db-3e4799c4f72e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:07.325923 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c5fda-0b41-4af8-8ede-fcef96fa5011 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:07.354690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:07.373917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a8fa6-7a85-4cf9-b9db-3e4799c4f72e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:07.376298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046353fc-f135-4c79-a93d-bd605e8cb0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:07.377377 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046353fc-f135-4c79-a93d-bd605e8cb0ed None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:07.378675 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046353fc-f135-4c79-a93d-bd605e8cb0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:07.379134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046353fc-f135-4c79-a93d-bd605e8cb0ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:07.390822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046353fc-f135-4c79-a93d-bd605e8cb0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:07.392336 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046353fc-f135-4c79-a93d-bd605e8cb0ed None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-046353fc-f135-4c79-a93d-bd605e8cb0ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:07.413432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:07.414389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:07.415296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:07.415296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:07.415296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:07.415296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:07.415296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 384/763] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:07.415566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046353fc-f135-4c79-a93d-bd605e8cb0ed None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:07.419941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5214881-0f3b-44a1-9c2f-3599b25596e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:07.420600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5214881-0f3b-44a1-9c2f-3599b25596e8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:07.420993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5214881-0f3b-44a1-9c2f-3599b25596e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:07.421271 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5214881-0f3b-44a1-9c2f-3599b25596e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:07.422836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5214881-0f3b-44a1-9c2f-3599b25596e8 None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=09e74199a07b481e837185c93b7c6455) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:07.423993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5214881-0f3b-44a1-9c2f-3599b25596e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:07.425448 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5214881-0f3b-44a1-9c2f-3599b25596e8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:07.432624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 380/764] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:07 2022] GET /identity/v3/role_assignments?user.id=09e74199a07b481e837185c93b7c6455&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:07.433941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d819e-240e-4f4a-8c3e-d4cc7a50ae8a None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:07.434225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d819e-240e-4f4a-8c3e-d4cc7a50ae8a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:07.434501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d819e-240e-4f4a-8c3e-d4cc7a50ae8a None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:07.440151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 381/765] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:07.440151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d819e-240e-4f4a-8c3e-d4cc7a50ae8a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:07.512832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:07.550227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046353fc-f135-4c79-a93d-bd605e8cb0ed None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:07.577688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d819e-240e-4f4a-8c3e-d4cc7a50ae8a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:07.598027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506aa5b7-7df5-4868-9dae-0c5eea201596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:07.599166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aa5b7-7df5-4868-9dae-0c5eea201596 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:07.599166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aa5b7-7df5-4868-9dae-0c5eea201596 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:07.599417 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aa5b7-7df5-4868-9dae-0c5eea201596 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:07.600631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aa5b7-7df5-4868-9dae-0c5eea201596 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:07.601899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aa5b7-7df5-4868-9dae-0c5eea201596 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-506aa5b7-7df5-4868-9dae-0c5eea201596 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:07.617179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:07.618170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:54:07.619014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:07.623422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 385/766] 10.222.0.33 () {56 vars in 1129 bytes} [Thu Jun 23 12:54:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:07.623985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253d7a4-98ad-423c-9a19-47789b90fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:07.625272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402d24-441f-4631-94b4-280ba195ebf8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:07.625562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402d24-441f-4631-94b4-280ba195ebf8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:07.625841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402d24-441f-4631-94b4-280ba195ebf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:07.626145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253d7a4-98ad-423c-9a19-47789b90fba7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:07.626631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253d7a4-98ad-423c-9a19-47789b90fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:07.627102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253d7a4-98ad-423c-9a19-47789b90fba7 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:07.628069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253d7a4-98ad-423c-9a19-47789b90fba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:07.628562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253d7a4-98ad-423c-9a19-47789b90fba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:07.630141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253d7a4-98ad-423c-9a19-47789b90fba7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:07.647050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-20402d24-441f-4631-94b4-280ba195ebf8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:07.647050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-20402d24-441f-4631-94b4-280ba195ebf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:07.647383 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 382/767] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:07.648436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253d7a4-98ad-423c-9a19-47789b90fba7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:07.660064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:07.715783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 386/768] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:07.716676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20402d24-441f-4631-94b4-280ba195ebf8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:07.762544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253d7a4-98ad-423c-9a19-47789b90fba7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:07.786818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:07.801931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756dfd7-bbdf-45c2-8257-3b290ec4e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:07.802602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756dfd7-bbdf-45c2-8257-3b290ec4e757 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:07.802895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756dfd7-bbdf-45c2-8257-3b290ec4e757 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:07.803174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756dfd7-bbdf-45c2-8257-3b290ec4e757 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:07.803883 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756dfd7-bbdf-45c2-8257-3b290ec4e757 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:07.804190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756dfd7-bbdf-45c2-8257-3b290ec4e757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:07.805660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756dfd7-bbdf-45c2-8257-3b290ec4e757 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:07.820082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20402d24-441f-4631-94b4-280ba195ebf8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:07.847818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 383/769] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jun 23 12:54:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:07.848408 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756dfd7-bbdf-45c2-8257-3b290ec4e757 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:07.862945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9491dc5-fce2-42c4-a28a-8621cfb30e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:07.864067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9491dc5-fce2-42c4-a28a-8621cfb30e77 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:07.864353 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9491dc5-fce2-42c4-a28a-8621cfb30e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:07.865119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9491dc5-fce2-42c4-a28a-8621cfb30e77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:07.874345 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9491dc5-fce2-42c4-a28a-8621cfb30e77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:07.877016 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9491dc5-fce2-42c4-a28a-8621cfb30e77 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-e9491dc5-fce2-42c4-a28a-8621cfb30e77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:07.897127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:07.898074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:07.898977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:07.898977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:07.898977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:07.898977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:07.898977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:07.898977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:07.898977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:07.898977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:07.899408 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 387/770] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:07.900723 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9491dc5-fce2-42c4-a28a-8621cfb30e77 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:07.926959 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:07.966936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756dfd7-bbdf-45c2-8257-3b290ec4e757 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:08.008867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f18078-2944-4e22-bf65-0c07ac67df65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:08.009777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f18078-2944-4e22-bf65-0c07ac67df65 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:08.010123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f18078-2944-4e22-bf65-0c07ac67df65 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:08.010469 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f18078-2944-4e22-bf65-0c07ac67df65 None admin] PATH_INFO: `/v3/services/network` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:08.011604 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f18078-2944-4e22-bf65-0c07ac67df65 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:08.013499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f18078-2944-4e22-bf65-0c07ac67df65 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:08.023468 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9491dc5-fce2-42c4-a28a-8621cfb30e77 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-75f18078-2944-4e22-bf65-0c07ac67df65 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:08.031414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:08.032594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:54:08.033697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:08.035018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 384/771] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:07 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:08.035894 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f18078-2944-4e22-bf65-0c07ac67df65 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:08.065179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:08.069456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1e21d-f6f3-48f2-94b2-fccf63439e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:08.070229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1e21d-f6f3-48f2-94b2-fccf63439e95 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:08.070647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1e21d-f6f3-48f2-94b2-fccf63439e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:08.071156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1e21d-f6f3-48f2-94b2-fccf63439e95 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:08.072135 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1e21d-f6f3-48f2-94b2-fccf63439e95 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:08.072603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1e21d-f6f3-48f2-94b2-fccf63439e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:08.074081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1e21d-f6f3-48f2-94b2-fccf63439e95 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:08.091388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 388/772] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jun 23 12:54:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:08.091388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1e21d-f6f3-48f2-94b2-fccf63439e95 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:08.152719 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f18078-2944-4e22-bf65-0c07ac67df65 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:08.195806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785d57c-0e69-4d01-8a40-a85a442c8566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:08.197183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785d57c-0e69-4d01-8a40-a85a442c8566 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:08.197722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785d57c-0e69-4d01-8a40-a85a442c8566 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:08.198444 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785d57c-0e69-4d01-8a40-a85a442c8566 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:08.200013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785d57c-0e69-4d01-8a40-a85a442c8566 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:08.200627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785d57c-0e69-4d01-8a40-a85a442c8566 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:08.203544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785d57c-0e69-4d01-8a40-a85a442c8566 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:08.205435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:08.218859 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1e21d-f6f3-48f2-94b2-fccf63439e95 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:08.221134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 385/773] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:08.222161 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785d57c-0e69-4d01-8a40-a85a442c8566 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:08.262372 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e340e71-fe4f-4bd3-93f9-ccbfbb01f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:08.263104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e340e71-fe4f-4bd3-93f9-ccbfbb01f850 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:08.263389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e340e71-fe4f-4bd3-93f9-ccbfbb01f850 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:08.263666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e340e71-fe4f-4bd3-93f9-ccbfbb01f850 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:08.264420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e340e71-fe4f-4bd3-93f9-ccbfbb01f850 None admin] RBAC: Adding query filter params (name=network) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:08.264759 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e340e71-fe4f-4bd3-93f9-ccbfbb01f850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:08.266291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e340e71-fe4f-4bd3-93f9-ccbfbb01f850 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:08.276393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 389/774] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:08.277283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e340e71-fe4f-4bd3-93f9-ccbfbb01f850 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:08.353149 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:08.353353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785d57c-0e69-4d01-8a40-a85a442c8566 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:08.403241 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a27a8-5bd2-4e7a-8b02-c8fd0737d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:08.403832 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a27a8-5bd2-4e7a-8b02-c8fd0737d491 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:08.404120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a27a8-5bd2-4e7a-8b02-c8fd0737d491 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:08.404401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a27a8-5bd2-4e7a-8b02-c8fd0737d491 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:08.405168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e340e71-fe4f-4bd3-93f9-ccbfbb01f850 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:08.405279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a27a8-5bd2-4e7a-8b02-c8fd0737d491 None admin] RBAC: Adding query filter params (interface=public, service_id=861fc902d2f2416782119b311ec701de, region_id=RegionOne) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:08.405531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a27a8-5bd2-4e7a-8b02-c8fd0737d491 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:08.406954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a27a8-5bd2-4e7a-8b02-c8fd0737d491 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:08.424583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 386/775] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 23 12:54:08 2022] GET /identity/v3/endpoints?service_id=861fc902d2f2416782119b311ec701de&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:08.424583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a27a8-5bd2-4e7a-8b02-c8fd0737d491 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:08.454373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc59b-e3a3-470c-a854-a9423b06b12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:08.455429 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc59b-e3a3-470c-a854-a9423b06b12c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:08.455997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc59b-e3a3-470c-a854-a9423b06b12c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:08.456417 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc59b-e3a3-470c-a854-a9423b06b12c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:08.457462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cc59b-e3a3-470c-a854-a9423b06b12c None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=311787f32b54485682be669bca9998f8, user.id=79d23f1644b94d51a4d0efe47f7aab3f) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:08.457916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cc59b-e3a3-470c-a854-a9423b06b12c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:08.459902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cc59b-e3a3-470c-a854-a9423b06b12c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:08.466445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 390/776] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:08 2022] GET /identity/v3/role_assignments?user.id=79d23f1644b94d51a4d0efe47f7aab3f&scope.project.id=311787f32b54485682be669bca9998f8&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:08.467471 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc59b-e3a3-470c-a854-a9423b06b12c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:08.502453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:08.591024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a27a8-5bd2-4e7a-8b02-c8fd0737d491 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:08.607246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc59b-e3a3-470c-a854-a9423b06b12c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:08.632676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:08.666173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449b759-538a-478d-9052-d84187ca5c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:08.667020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012d6a0-8d70-4236-8383-83e049cbc21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:08.668153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012d6a0-8d70-4236-8383-83e049cbc21d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:08.668804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449b759-538a-478d-9052-d84187ca5c8e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:08.669322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449b759-538a-478d-9052-d84187ca5c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:08.669749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449b759-538a-478d-9052-d84187ca5c8e None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:08.669994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012d6a0-8d70-4236-8383-83e049cbc21d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:08.670299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012d6a0-8d70-4236-8383-83e049cbc21d None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:08.670964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449b759-538a-478d-9052-d84187ca5c8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:08.671089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012d6a0-8d70-4236-8383-83e049cbc21d None admin] RBAC: Adding query filter params (type=network) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:08.671333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012d6a0-8d70-4236-8383-83e049cbc21d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:08.673359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012d6a0-8d70-4236-8383-83e049cbc21d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:08.673474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449b759-538a-478d-9052-d84187ca5c8e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:08.680387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 391/777] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 23 12:54:08 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:08.684677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 387/778] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:08.687212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449b759-538a-478d-9052-d84187ca5c8e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:08.809085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449b759-538a-478d-9052-d84187ca5c8e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:08.861784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c75047-a141-4ba9-a476-a74a8ccc0e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:08.862514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c75047-a141-4ba9-a476-a74a8ccc0e59 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:08.862800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c75047-a141-4ba9-a476-a74a8ccc0e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:08.863075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c75047-a141-4ba9-a476-a74a8ccc0e59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:08.863920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c75047-a141-4ba9-a476-a74a8ccc0e59 None admin] RBAC: Adding query filter params (interface=public, service_id=4e8598fc59b34f43b0abe907ca24afa5, region_id=RegionOne) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:08.864233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c75047-a141-4ba9-a476-a74a8ccc0e59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:08.865613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c75047-a141-4ba9-a476-a74a8ccc0e59 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:08.878593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 392/779] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 23 12:54:08 2022] GET /identity/v3/endpoints?service_id=4e8598fc59b34f43b0abe907ca24afa5&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:08.884070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012d6a0-8d70-4236-8383-83e049cbc21d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:09.017305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012d6a0-8d70-4236-8383-83e049cbc21d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:09.046903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:09.065130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b56be-2a53-4071-988e-3582c2f7b333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:09.066808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b56be-2a53-4071-988e-3582c2f7b333 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:09.066808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b56be-2a53-4071-988e-3582c2f7b333 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:09.066808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b56be-2a53-4071-988e-3582c2f7b333 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:09.067032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b56be-2a53-4071-988e-3582c2f7b333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:09.068384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b56be-2a53-4071-988e-3582c2f7b333 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:09.074164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 388/780] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 23 12:54:08 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:09.369080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a86d25-7ec0-41dc-8d84-9f704cf1f061 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:09.369502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a86d25-7ec0-41dc-8d84-9f704cf1f061 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:09.369917 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a86d25-7ec0-41dc-8d84-9f704cf1f061 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:09.371746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 393/781] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:09.377598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d44f12-75b6-4831-93a9-739ca1d6e68f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:09.377932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d44f12-75b6-4831-93a9-739ca1d6e68f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:09.378170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d44f12-75b6-4831-93a9-739ca1d6e68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:09.398538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-41d44f12-75b6-4831-93a9-739ca1d6e68f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:09.399755 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-41d44f12-75b6-4831-93a9-739ca1d6e68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:09.472972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 389/782] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:09.497899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a86d25-7ec0-41dc-8d84-9f704cf1f061 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:09.554190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:09.615720 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de1c42-7fbf-44c3-a4d9-69dfd48a9f2b None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:09.616158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de1c42-7fbf-44c3-a4d9-69dfd48a9f2b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:09.616551 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de1c42-7fbf-44c3-a4d9-69dfd48a9f2b None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:09.617528 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a86d25-7ec0-41dc-8d84-9f704cf1f061 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:09.619347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 390/783] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:09.623342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe75add-6212-4ea5-94fb-e46659eec025 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:09.623636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe75add-6212-4ea5-94fb-e46659eec025 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:09.623917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe75add-6212-4ea5-94fb-e46659eec025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:09.657038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5fe75add-6212-4ea5-94fb-e46659eec025 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:09.658237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5fe75add-6212-4ea5-94fb-e46659eec025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:09.662764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c60e2-9822-47dc-9619-bae44da24146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:09.663565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c60e2-9822-47dc-9619-bae44da24146 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:09.663901 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c60e2-9822-47dc-9619-bae44da24146 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:09.664181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c60e2-9822-47dc-9619-bae44da24146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:09.683032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c60e2-9822-47dc-9619-bae44da24146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-344c60e2-9822-47dc-9619-bae44da24146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:09.698269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:09.699211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:09.700063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 394/784] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:54:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:09.709023 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c60e2-9822-47dc-9619-bae44da24146 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:09.830839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c60e2-9822-47dc-9619-bae44da24146 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:09.845010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:09.846460 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 391/785] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:09.871365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa56c9d-e2b1-4fae-aeb7-53b5b1f4a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:09.871960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa56c9d-e2b1-4fae-aeb7-53b5b1f4a0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:09.872325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa56c9d-e2b1-4fae-aeb7-53b5b1f4a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:09.872610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa56c9d-e2b1-4fae-aeb7-53b5b1f4a0e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:09.873476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa56c9d-e2b1-4fae-aeb7-53b5b1f4a0e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:09.873789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa56c9d-e2b1-4fae-aeb7-53b5b1f4a0e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:09.875254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa56c9d-e2b1-4fae-aeb7-53b5b1f4a0e5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:09.881723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe75add-6212-4ea5-94fb-e46659eec025 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:09.902298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 395/786] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:54:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:09.909044 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa56c9d-e2b1-4fae-aeb7-53b5b1f4a0e5 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:09.969202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:10.037539 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe75add-6212-4ea5-94fb-e46659eec025 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:10.092018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d5910-1659-4e42-b0da-5ca070325e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:10.092860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5910-1659-4e42-b0da-5ca070325e18 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:10.093146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5910-1659-4e42-b0da-5ca070325e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:10.093508 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5910-1659-4e42-b0da-5ca070325e18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:10.114028 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa56c9d-e2b1-4fae-aeb7-53b5b1f4a0e5 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:10.115826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d5910-1659-4e42-b0da-5ca070325e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-d78d5910-1659-4e42-b0da-5ca070325e18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:10.129833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:10.130743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:10.131558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:10.131558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:10.131558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:10.131558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:10.131558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:10.131558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:10.131558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:10.131558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:10.131558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:10.131558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:10.131558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:54:10.131558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:10.133091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 392/787] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:54:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:10.139071 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d5910-1659-4e42-b0da-5ca070325e18 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:10.166255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1d2aa-5d7e-4437-8868-cbc12f5fea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:10.167114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1d2aa-5d7e-4437-8868-cbc12f5fea83 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:10.167396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1d2aa-5d7e-4437-8868-cbc12f5fea83 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:10.167674 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1d2aa-5d7e-4437-8868-cbc12f5fea83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:10.185344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1d2aa-5d7e-4437-8868-cbc12f5fea83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:10.186800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1d2aa-5d7e-4437-8868-cbc12f5fea83 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d6d1d2aa-5d7e-4437-8868-cbc12f5fea83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:10.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:10.224331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:10.225253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:10.225253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:10.225253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:10.225253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:10.225253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 396/788] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:10.231933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1d2aa-5d7e-4437-8868-cbc12f5fea83 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:10.283808 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:10.312685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d5910-1659-4e42-b0da-5ca070325e18 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:10.318329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:10.368512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e2e7d-d7b2-4d8f-ad80-7f5edb7df02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:10.369217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e2e7d-d7b2-4d8f-ad80-7f5edb7df02a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:10.369500 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e2e7d-d7b2-4d8f-ad80-7f5edb7df02a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:10.369776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e2e7d-d7b2-4d8f-ad80-7f5edb7df02a None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:10.370524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e2e7d-d7b2-4d8f-ad80-7f5edb7df02a None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:10.370829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e2e7d-d7b2-4d8f-ad80-7f5edb7df02a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:10.372201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e2e7d-d7b2-4d8f-ad80-7f5edb7df02a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:10.396978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 393/789] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:54:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:10.398107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e2e7d-d7b2-4d8f-ad80-7f5edb7df02a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:10.422355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1d2aa-5d7e-4437-8868-cbc12f5fea83 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:10.494381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12379f8-e091-49c8-803e-6dff2c9340c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:10.495061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12379f8-e091-49c8-803e-6dff2c9340c7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:10.495350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12379f8-e091-49c8-803e-6dff2c9340c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:10.495633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12379f8-e091-49c8-803e-6dff2c9340c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:10.496363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12379f8-e091-49c8-803e-6dff2c9340c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:10.496690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12379f8-e091-49c8-803e-6dff2c9340c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:10.498073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12379f8-e091-49c8-803e-6dff2c9340c7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:10.501752 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e2e7d-d7b2-4d8f-ad80-7f5edb7df02a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:10.518730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 397/790] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:10.524576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12379f8-e091-49c8-803e-6dff2c9340c7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:10.539819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adbbcd-1ebc-4ae6-917a-58f5f7c70a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:10.540625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adbbcd-1ebc-4ae6-917a-58f5f7c70a2b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:10.540974 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adbbcd-1ebc-4ae6-917a-58f5f7c70a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:10.541255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adbbcd-1ebc-4ae6-917a-58f5f7c70a2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:10.553057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adbbcd-1ebc-4ae6-917a-58f5f7c70a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:10.554622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adbbcd-1ebc-4ae6-917a-58f5f7c70a2b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-e5adbbcd-1ebc-4ae6-917a-58f5f7c70a2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:10.577404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:10.578347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:10.579224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:10.579224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:10.579224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:10.579224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:10.579224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 394/791] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:10.590521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adbbcd-1ebc-4ae6-917a-58f5f7c70a2b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:10.634636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:10.660613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:10.693524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12379f8-e091-49c8-803e-6dff2c9340c7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:10.738791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1749c2-92f7-4ff1-b723-43d8615bf756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:10.739703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1749c2-92f7-4ff1-b723-43d8615bf756 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:10.739996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1749c2-92f7-4ff1-b723-43d8615bf756 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:10.740276 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1749c2-92f7-4ff1-b723-43d8615bf756 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:10.752165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1749c2-92f7-4ff1-b723-43d8615bf756 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:10.763593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1749c2-92f7-4ff1-b723-43d8615bf756 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:10.765858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adbbcd-1ebc-4ae6-917a-58f5f7c70a2b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-0f1749c2-92f7-4ff1-b723-43d8615bf756 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:10.791919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:10.793168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:10.794116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:10.794116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:10.794116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:10.794116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:10.794116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:10.794116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:10.794116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:10.794116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:10.794116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:54:10.794116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:10.794116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 398/792] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 23 12:54:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:10.800630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1749c2-92f7-4ff1-b723-43d8615bf756 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:10.801822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3990df-6b30-41e4-ad9b-b74693d0c7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:10.802493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3990df-6b30-41e4-ad9b-b74693d0c7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:10.802793 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3990df-6b30-41e4-ad9b-b74693d0c7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:10.803048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3990df-6b30-41e4-ad9b-b74693d0c7b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:10.803775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3990df-6b30-41e4-ad9b-b74693d0c7b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:10.804084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3990df-6b30-41e4-ad9b-b74693d0c7b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:10.805501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3990df-6b30-41e4-ad9b-b74693d0c7b1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:10.822494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 395/793] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:10.823708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3990df-6b30-41e4-ad9b-b74693d0c7b1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:10.906957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:10.926815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3990df-6b30-41e4-ad9b-b74693d0c7b1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:10.961875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1adb-9be2-4760-9b2b-b8cfdc9fe9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:10.962783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1adb-9be2-4760-9b2b-b8cfdc9fe9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:10.963024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1749c2-92f7-4ff1-b723-43d8615bf756 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:10.963467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1adb-9be2-4760-9b2b-b8cfdc9fe9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:10.963467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1adb-9be2-4760-9b2b-b8cfdc9fe9a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:10.971499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc1adb-9be2-4760-9b2b-b8cfdc9fe9a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:10.973061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc1adb-9be2-4760-9b2b-b8cfdc9fe9a2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-22bc1adb-9be2-4760-9b2b-b8cfdc9fe9a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:10.988127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:10.989135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:10.990060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:10.990060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:10.990060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:10.990060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:10.990060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:10.990060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:10.990060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:10.990060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:10.990060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:54:10.990060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:10.993987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 396/794] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 23 12:54:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:10.995381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979825-9674-4e73-82d1-20b1e63dd04e None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:10.995775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979825-9674-4e73-82d1-20b1e63dd04e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:10.996063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979825-9674-4e73-82d1-20b1e63dd04e None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:10.998151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 397/795] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:10.998739 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f3017-9753-4925-bba7-94e8227bbdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:10.998971 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979825-9674-4e73-82d1-20b1e63dd04e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:11.000067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f3017-9753-4925-bba7-94e8227bbdeb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.000351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f3017-9753-4925-bba7-94e8227bbdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.000626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f3017-9753-4925-bba7-94e8227bbdeb None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.001501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f3017-9753-4925-bba7-94e8227bbdeb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:11.001805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f3017-9753-4925-bba7-94e8227bbdeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:11.003713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f3017-9753-4925-bba7-94e8227bbdeb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:11.018715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:11.023618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 399/796] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 23 12:54:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:11.024895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9704b2-4239-4602-a00f-478dd0e4780c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.025284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9704b2-4239-4602-a00f-478dd0e4780c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.032512 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9704b2-4239-4602-a00f-478dd0e4780c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.043017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8c9704b2-4239-4602-a00f-478dd0e4780c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:11.044316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8c9704b2-4239-4602-a00f-478dd0e4780c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:11.117894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 400/797] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:11.118854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9704b2-4239-4602-a00f-478dd0e4780c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:11.119836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979825-9674-4e73-82d1-20b1e63dd04e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:11.156812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa239d8f-0325-4ae3-b1e2-cb63c69d5140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:11.157760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa239d8f-0325-4ae3-b1e2-cb63c69d5140 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.158216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa239d8f-0325-4ae3-b1e2-cb63c69d5140 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.158690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa239d8f-0325-4ae3-b1e2-cb63c69d5140 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.159687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa239d8f-0325-4ae3-b1e2-cb63c69d5140 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:11.160175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa239d8f-0325-4ae3-b1e2-cb63c69d5140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:11.161825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa239d8f-0325-4ae3-b1e2-cb63c69d5140 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:11.173114 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:11.186677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 398/798] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jun 23 12:54:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:11.186677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa239d8f-0325-4ae3-b1e2-cb63c69d5140 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:11.227900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9704b2-4239-4602-a00f-478dd0e4780c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:11.259390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:11.266647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fffaa7-a6c8-4083-a933-2db6530068ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:11.267480 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fffaa7-a6c8-4083-a933-2db6530068ff None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.267939 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fffaa7-a6c8-4083-a933-2db6530068ff None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.268459 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fffaa7-a6c8-4083-a933-2db6530068ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.292693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa239d8f-0325-4ae3-b1e2-cb63c69d5140 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:11.328364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e11b0-4bdc-45d1-a41d-51da237f57d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:11.329354 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e11b0-4bdc-45d1-a41d-51da237f57d6 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.329576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e11b0-4bdc-45d1-a41d-51da237f57d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.329855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e11b0-4bdc-45d1-a41d-51da237f57d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.340693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e11b0-4bdc-45d1-a41d-51da237f57d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:11.342928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fffaa7-a6c8-4083-a933-2db6530068ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:11.345177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fffaa7-a6c8-4083-a933-2db6530068ff None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-6c9e11b0-4bdc-45d1-a41d-51da237f57d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:11.349031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:11.350137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:11.351260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 399/799] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:54:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:11.351968 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e11b0-4bdc-45d1-a41d-51da237f57d6 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:11.411883 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:11.454755 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e11b0-4bdc-45d1-a41d-51da237f57d6 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:11.456834 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 401/800] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:54:11.457768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fffaa7-a6c8-4083-a933-2db6530068ff None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:11.487249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:11.491943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad96ec1-916d-4c53-93ff-71931076e05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:11.492844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad96ec1-916d-4c53-93ff-71931076e05c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.495776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad96ec1-916d-4c53-93ff-71931076e05c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.495776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad96ec1-916d-4c53-93ff-71931076e05c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.504503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad96ec1-916d-4c53-93ff-71931076e05c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:11.506100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad96ec1-916d-4c53-93ff-71931076e05c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-dad96ec1-916d-4c53-93ff-71931076e05c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:11.523875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:11.524843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:11.525746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:11.525746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:11.525746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:11.525746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:11.525746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 400/801] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:11.526452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e52b5-7a19-4c62-b0eb-62f9bc185d4e None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.526734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e52b5-7a19-4c62-b0eb-62f9bc185d4e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.526943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e52b5-7a19-4c62-b0eb-62f9bc185d4e None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.528351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 401/802] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:11.529019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e52b5-7a19-4c62-b0eb-62f9bc185d4e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:11.567237 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fffaa7-a6c8-4083-a933-2db6530068ff None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:11.601712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1418f1-532e-4377-9f6d-5257da7b6f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:11.602377 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1418f1-532e-4377-9f6d-5257da7b6f38 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.602658 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1418f1-532e-4377-9f6d-5257da7b6f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.602964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1418f1-532e-4377-9f6d-5257da7b6f38 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.603713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1418f1-532e-4377-9f6d-5257da7b6f38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:11.604021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1418f1-532e-4377-9f6d-5257da7b6f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:11.605414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1418f1-532e-4377-9f6d-5257da7b6f38 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:11.618814 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 402/803] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:54:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:11.620141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e7f73-6839-467a-9e82-2cb9472b149f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.620445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e7f73-6839-467a-9e82-2cb9472b149f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.620745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e7f73-6839-467a-9e82-2cb9472b149f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.637311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1e6e7f73-6839-467a-9e82-2cb9472b149f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:11.638488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1e6e7f73-6839-467a-9e82-2cb9472b149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:11.638939 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e52b5-7a19-4c62-b0eb-62f9bc185d4e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:11.651428 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:11.676355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edf97b-714c-4d63-a4fe-d3145c674656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:11.677258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edf97b-714c-4d63-a4fe-d3145c674656 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.677736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edf97b-714c-4d63-a4fe-d3145c674656 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.678179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edf97b-714c-4d63-a4fe-d3145c674656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.689059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edf97b-714c-4d63-a4fe-d3145c674656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:11.690517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edf97b-714c-4d63-a4fe-d3145c674656 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:11.707232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 403/804] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-f9edf97b-714c-4d63-a4fe-d3145c674656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:11.707368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:11.708184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:11.709125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:11.709125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:11.709125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:11.709125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:11.709344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e7f73-6839-467a-9e82-2cb9472b149f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:11.709422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 402/805] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:11.709913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edf97b-714c-4d63-a4fe-d3145c674656 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:11.741808 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:11.811635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edf97b-714c-4d63-a4fe-d3145c674656 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:11.816388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e7f73-6839-467a-9e82-2cb9472b149f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:11.846859 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb334fb-7143-4ef3-b4fa-9f33b89b3539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:11.847680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb334fb-7143-4ef3-b4fa-9f33b89b3539 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.847959 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb334fb-7143-4ef3-b4fa-9f33b89b3539 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.848229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb334fb-7143-4ef3-b4fa-9f33b89b3539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.853335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518a748-120a-4fff-a25a-cef70dc6fbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:11.853993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518a748-120a-4fff-a25a-cef70dc6fbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.854278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518a748-120a-4fff-a25a-cef70dc6fbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.854555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518a748-120a-4fff-a25a-cef70dc6fbe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.855281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518a748-120a-4fff-a25a-cef70dc6fbe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:11.855588 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518a748-120a-4fff-a25a-cef70dc6fbe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:11.856972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518a748-120a-4fff-a25a-cef70dc6fbe8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:11.858438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb334fb-7143-4ef3-b4fa-9f33b89b3539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:11.859847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb334fb-7143-4ef3-b4fa-9f33b89b3539 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:11.867847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 404/806] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:11.869076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749e6e-89ea-4828-b26a-ed4b52c70cc0 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:11.869365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749e6e-89ea-4828-b26a-ed4b52c70cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:11.869643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749e6e-89ea-4828-b26a-ed4b52c70cc0 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:11.872709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 405/807] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:11.872709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8749e6e-89ea-4828-b26a-ed4b52c70cc0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-4fb334fb-7143-4ef3-b4fa-9f33b89b3539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:11.876899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:11.877948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:11.878875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:11.878875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:11.878875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:11.878875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:11.878875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 403/808] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:11.879158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb334fb-7143-4ef3-b4fa-9f33b89b3539 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:11.895855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:11.953809 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:11.972232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8749e6e-89ea-4828-b26a-ed4b52c70cc0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:11.978458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb334fb-7143-4ef3-b4fa-9f33b89b3539 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.006338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71931d8-a3a6-4575-85d6-d998a1b631a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.006997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71931d8-a3a6-4575-85d6-d998a1b631a3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.007284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71931d8-a3a6-4575-85d6-d998a1b631a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.007563 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71931d8-a3a6-4575-85d6-d998a1b631a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.008281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71931d8-a3a6-4575-85d6-d998a1b631a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:12.008587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71931d8-a3a6-4575-85d6-d998a1b631a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.009970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71931d8-a3a6-4575-85d6-d998a1b631a3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.011587 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09760269-5c99-488a-94f0-252cda117efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.012389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09760269-5c99-488a-94f0-252cda117efe None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.012689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09760269-5c99-488a-94f0-252cda117efe None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.012977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09760269-5c99-488a-94f0-252cda117efe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.013615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09760269-5c99-488a-94f0-252cda117efe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.014951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09760269-5c99-488a-94f0-252cda117efe None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.021752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 406/809] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:12.022714 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71931d8-a3a6-4575-85d6-d998a1b631a3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-09760269-5c99-488a-94f0-252cda117efe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:12.027583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:12.028567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:12.029544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 404/810] 10.222.0.33 () {56 vars in 1129 bytes} [Thu Jun 23 12:54:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:12.030435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417046-6f78-443d-b508-7548c0d81173 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.030435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417046-6f78-443d-b508-7548c0d81173 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.030435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417046-6f78-443d-b508-7548c0d81173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.046889 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e4417046-6f78-443d-b508-7548c0d81173 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:12.048075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e4417046-6f78-443d-b508-7548c0d81173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:12.114163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 405/811] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:12.114978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4417046-6f78-443d-b508-7548c0d81173 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:12.128344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71931d8-a3a6-4575-85d6-d998a1b631a3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.134341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:12.161107 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a4e05-d5e2-47a2-bae8-c272ca50045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.161902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a4e05-d5e2-47a2-bae8-c272ca50045f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.162188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a4e05-d5e2-47a2-bae8-c272ca50045f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.162467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a4e05-d5e2-47a2-bae8-c272ca50045f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.169164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a4e05-d5e2-47a2-bae8-c272ca50045f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.170586 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a4e05-d5e2-47a2-bae8-c272ca50045f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-c17a4e05-d5e2-47a2-bae8-c272ca50045f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:12.185190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:12.186148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:12.187618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:12.187618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:12.187618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:12.187618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:12.187618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:12.187618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:12.187618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:12.187618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:12.187618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 407/812] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:12.188106 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a4e05-d5e2-47a2-bae8-c272ca50045f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:12.190581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:12.226195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4417046-6f78-443d-b508-7548c0d81173 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.260764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307abb-4b80-40d7-a72a-d85dd49ad66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.261423 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307abb-4b80-40d7-a72a-d85dd49ad66e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.261708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307abb-4b80-40d7-a72a-d85dd49ad66e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.262005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307abb-4b80-40d7-a72a-d85dd49ad66e None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.262704 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99307abb-4b80-40d7-a72a-d85dd49ad66e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:12.263016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99307abb-4b80-40d7-a72a-d85dd49ad66e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.264368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99307abb-4b80-40d7-a72a-d85dd49ad66e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.275825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 406/813] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:12.276599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307abb-4b80-40d7-a72a-d85dd49ad66e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:12.285836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a4e05-d5e2-47a2-bae8-c272ca50045f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.319053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd83449-0c55-44e3-aa94-637ac7785a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.319841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd83449-0c55-44e3-aa94-637ac7785a3c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.320128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd83449-0c55-44e3-aa94-637ac7785a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.320408 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd83449-0c55-44e3-aa94-637ac7785a3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.326831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd83449-0c55-44e3-aa94-637ac7785a3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.328275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd83449-0c55-44e3-aa94-637ac7785a3c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.341961 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-5dd83449-0c55-44e3-aa94-637ac7785a3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:12.342080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:12.342906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:12.343796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:12.343796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:12.343796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:12.343796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:12.343796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:12.343796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:12.343796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:12.343796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:12.343796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 408/814] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:12.344277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd83449-0c55-44e3-aa94-637ac7785a3c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:12.377008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307abb-4b80-40d7-a72a-d85dd49ad66e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.409164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:12.410369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590b9b6-e2aa-444b-a734-bcbbfce52245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.411025 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590b9b6-e2aa-444b-a734-bcbbfce52245 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.411307 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590b9b6-e2aa-444b-a734-bcbbfce52245 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.411581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590b9b6-e2aa-444b-a734-bcbbfce52245 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.412277 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590b9b6-e2aa-444b-a734-bcbbfce52245 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:12.412580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590b9b6-e2aa-444b-a734-bcbbfce52245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.413965 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590b9b6-e2aa-444b-a734-bcbbfce52245 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.418333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 407/815] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jun 23 12:54:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:12.419089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590b9b6-e2aa-444b-a734-bcbbfce52245 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:12.446240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd83449-0c55-44e3-aa94-637ac7785a3c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.479068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042525-1a12-47bf-9662-59d4b21b7e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.479779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042525-1a12-47bf-9662-59d4b21b7e51 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.480059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042525-1a12-47bf-9662-59d4b21b7e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.480338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042525-1a12-47bf-9662-59d4b21b7e51 None admin] PATH_INFO: `/v3/services/network` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.481018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe042525-1a12-47bf-9662-59d4b21b7e51 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.482365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe042525-1a12-47bf-9662-59d4b21b7e51 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-fe042525-1a12-47bf-9662-59d4b21b7e51 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:12.493876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:12.494891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:54:12.495735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:12.496846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 409/816] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:12 2022] GET /identity/v3/services/network => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:12.497770 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042525-1a12-47bf-9662-59d4b21b7e51 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:12.519246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590b9b6-e2aa-444b-a734-bcbbfce52245 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.547669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:12.552255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c1e06-83eb-49bc-9cca-d0b83a96092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.552957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c1e06-83eb-49bc-9cca-d0b83a96092f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.553240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c1e06-83eb-49bc-9cca-d0b83a96092f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.553522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c1e06-83eb-49bc-9cca-d0b83a96092f None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.554295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c1e06-83eb-49bc-9cca-d0b83a96092f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:12.554645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c1e06-83eb-49bc-9cca-d0b83a96092f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.560320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c1e06-83eb-49bc-9cca-d0b83a96092f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.568278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 408/817] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:12.569099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c1e06-83eb-49bc-9cca-d0b83a96092f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:12.599524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042525-1a12-47bf-9662-59d4b21b7e51 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.624126 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:12.633316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3921c-b15a-45d7-8861-93ba44cf1115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.634646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3921c-b15a-45d7-8861-93ba44cf1115 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.634646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3921c-b15a-45d7-8861-93ba44cf1115 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.634824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3921c-b15a-45d7-8861-93ba44cf1115 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.642697 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3921c-b15a-45d7-8861-93ba44cf1115 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.644125 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3921c-b15a-45d7-8861-93ba44cf1115 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-85a3921c-b15a-45d7-8861-93ba44cf1115 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:12.659401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:12.660401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:12.662076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:12.662076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:12.662076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:12.662076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:12.662076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:12.662076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:12.662076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:12.662076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:12.662076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:54:12.662076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:12.662076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 410/818] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:54:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:12.662076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3921c-b15a-45d7-8861-93ba44cf1115 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:12.671149 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c1e06-83eb-49bc-9cca-d0b83a96092f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.705987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0379b-d7a0-4e35-ab91-25720db295cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.706641 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0379b-d7a0-4e35-ab91-25720db295cd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.706927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0379b-d7a0-4e35-ab91-25720db295cd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.707203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0379b-d7a0-4e35-ab91-25720db295cd None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.707985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0379b-d7a0-4e35-ab91-25720db295cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:12.708296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0379b-d7a0-4e35-ab91-25720db295cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.709751 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0379b-d7a0-4e35-ab91-25720db295cd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.720919 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 409/819] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:12.721683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0379b-d7a0-4e35-ab91-25720db295cd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:12.763759 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3921c-b15a-45d7-8861-93ba44cf1115 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.772856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:12.797320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247baf-9631-451f-9337-c9247ac8a9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.797978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247baf-9631-451f-9337-c9247ac8a9ff None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.798262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247baf-9631-451f-9337-c9247ac8a9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.798542 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247baf-9631-451f-9337-c9247ac8a9ff None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.799245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2247baf-9631-451f-9337-c9247ac8a9ff None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:12.799556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2247baf-9631-451f-9337-c9247ac8a9ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.800935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2247baf-9631-451f-9337-c9247ac8a9ff None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.805718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 411/820] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jun 23 12:54:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:12.806456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247baf-9631-451f-9337-c9247ac8a9ff None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:12.822776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0379b-d7a0-4e35-ab91-25720db295cd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.854099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:12.857146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45289934-7739-48f2-b6a4-c82682c86a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.857805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289934-7739-48f2-b6a4-c82682c86a9c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.858090 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289934-7739-48f2-b6a4-c82682c86a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.858369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289934-7739-48f2-b6a4-c82682c86a9c None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.859110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45289934-7739-48f2-b6a4-c82682c86a9c None admin] RBAC: Adding query filter params (name=network) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:12.859416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45289934-7739-48f2-b6a4-c82682c86a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.860800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45289934-7739-48f2-b6a4-c82682c86a9c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.865227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 410/821] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:12.865990 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45289934-7739-48f2-b6a4-c82682c86a9c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:12.904078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247baf-9631-451f-9337-c9247ac8a9ff None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.937121 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809baf1-4cf1-4b77-bf32-146bf25cf687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.938006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809baf1-4cf1-4b77-bf32-146bf25cf687 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.938292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809baf1-4cf1-4b77-bf32-146bf25cf687 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.938571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809baf1-4cf1-4b77-bf32-146bf25cf687 None admin] PATH_INFO: `/v3/projects/311787f32b54485682be669bca9998f8/users/09e74199a07b481e837185c93b7c6455/roles/af902c13373445999fcf70be57ba260f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.952996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809baf1-4cf1-4b77-bf32-146bf25cf687 None admin] RBAC: Authorizing `identity:create_grant(project_id=311787f32b54485682be669bca9998f8, user_id=09e74199a07b481e837185c93b7c6455, role_id=af902c13373445999fcf70be57ba260f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:12.954597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809baf1-4cf1-4b77-bf32-146bf25cf687 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:12.964491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45289934-7739-48f2-b6a4-c82682c86a9c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:12.980534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:12.997699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a7aa3-78cc-4d16-a7ac-c5982948322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:12.998360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a7aa3-78cc-4d16-a7ac-c5982948322a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:12.998640 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a7aa3-78cc-4d16-a7ac-c5982948322a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:12.998909 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a7aa3-78cc-4d16-a7ac-c5982948322a None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:12.999725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a7aa3-78cc-4d16-a7ac-c5982948322a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:13.000029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a7aa3-78cc-4d16-a7ac-c5982948322a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:13.001547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a7aa3-78cc-4d16-a7ac-c5982948322a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:13.018408 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 411/822] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jun 23 12:54:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:13.019118 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a7aa3-78cc-4d16-a7ac-c5982948322a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:13.063275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 412/823] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:54:12 2022] PUT /identity/v3/projects/311787f32b54485682be669bca9998f8/users/09e74199a07b481e837185c93b7c6455/roles/af902c13373445999fcf70be57ba260f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:54:13.064170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809baf1-4cf1-4b77-bf32-146bf25cf687 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:13.130783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a7aa3-78cc-4d16-a7ac-c5982948322a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:13.167940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1625db-2cbb-4f71-9702-4a71db4214c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:13.168621 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1625db-2cbb-4f71-9702-4a71db4214c0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:13.168931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1625db-2cbb-4f71-9702-4a71db4214c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:13.169213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1625db-2cbb-4f71-9702-4a71db4214c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:13.170116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1625db-2cbb-4f71-9702-4a71db4214c0 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=311787f32b54485682be669bca9998f8, user.id=5874e98df57242028c0f9983dee3b5e8) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:13.170439 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1625db-2cbb-4f71-9702-4a71db4214c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:13.171979 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1625db-2cbb-4f71-9702-4a71db4214c0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:13.178626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:13.188814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 412/824] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:13 2022] GET /identity/v3/role_assignments?user.id=5874e98df57242028c0f9983dee3b5e8&scope.project.id=311787f32b54485682be669bca9998f8&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:13.188814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1625db-2cbb-4f71-9702-4a71db4214c0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:13.190747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809baf1-4cf1-4b77-bf32-146bf25cf687 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:13.244362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:13.255049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9abe1-0d6b-4644-b8c4-0b19efcbb5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:13.255413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9abe1-0d6b-4644-b8c4-0b19efcbb5b9 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:13.255665 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9abe1-0d6b-4644-b8c4-0b19efcbb5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:13.255944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9abe1-0d6b-4644-b8c4-0b19efcbb5b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:13.256758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9abe1-0d6b-4644-b8c4-0b19efcbb5b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:13.258149 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9abe1-0d6b-4644-b8c4-0b19efcbb5b9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:13.324012 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1625db-2cbb-4f71-9702-4a71db4214c0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:13.365446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 413/825] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 23 12:54:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:54:13.366190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9abe1-0d6b-4644-b8c4-0b19efcbb5b9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:13.372616 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee97db-b3bc-4eec-b58c-e304f4ca4410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:13.373342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee97db-b3bc-4eec-b58c-e304f4ca4410 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:13.373628 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee97db-b3bc-4eec-b58c-e304f4ca4410 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:13.373962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee97db-b3bc-4eec-b58c-e304f4ca4410 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:13.375448 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee97db-b3bc-4eec-b58c-e304f4ca4410 None admin] RBAC: Adding query filter params (type=network) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:13.375758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee97db-b3bc-4eec-b58c-e304f4ca4410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:13.377315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee97db-b3bc-4eec-b58c-e304f4ca4410 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:13.392697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 413/826] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:13.393540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee97db-b3bc-4eec-b58c-e304f4ca4410 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:13.518718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:13.524070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee97db-b3bc-4eec-b58c-e304f4ca4410 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:13.524636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9abe1-0d6b-4644-b8c4-0b19efcbb5b9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:13.566132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2ca94-240a-4bb9-a850-acadd1158e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:13.566484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83184248-84c3-4a52-a188-41ce377423f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:13.567068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83184248-84c3-4a52-a188-41ce377423f5 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:13.567350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83184248-84c3-4a52-a188-41ce377423f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:13.567629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83184248-84c3-4a52-a188-41ce377423f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:13.568134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2ca94-240a-4bb9-a850-acadd1158e17 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:13.568364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83184248-84c3-4a52-a188-41ce377423f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:13.568845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2ca94-240a-4bb9-a850-acadd1158e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:13.569324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2ca94-240a-4bb9-a850-acadd1158e17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:13.569817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83184248-84c3-4a52-a188-41ce377423f5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:13.583111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2ca94-240a-4bb9-a850-acadd1158e17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:13.584894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2ca94-240a-4bb9-a850-acadd1158e17 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-f4c2ca94-240a-4bb9-a850-acadd1158e17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:13.603488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:13.604531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:13.605481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:13.605481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:13.605481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:13.605481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:13.605745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 414/827] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:13.611374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2ca94-240a-4bb9-a850-acadd1158e17 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:13.623376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:13.684721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 414/828] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 23 12:54:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:54:13.755376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2ca94-240a-4bb9-a850-acadd1158e17 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:13.821827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ef16d-b5c3-4200-96ec-5c9b96d73ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:13.822950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ef16d-b5c3-4200-96ec-5c9b96d73ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:13.823460 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ef16d-b5c3-4200-96ec-5c9b96d73ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:13.823947 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ef16d-b5c3-4200-96ec-5c9b96d73ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:13.824924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ef16d-b5c3-4200-96ec-5c9b96d73ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:13.825467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ef16d-b5c3-4200-96ec-5c9b96d73ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:13.827113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ef16d-b5c3-4200-96ec-5c9b96d73ce6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:13.841395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 415/829] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:13.849797 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83184248-84c3-4a52-a188-41ce377423f5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:14.105716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83184248-84c3-4a52-a188-41ce377423f5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:14.142296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60437609-4a1e-4c05-8364-e5c8009b7037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:14.143126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60437609-4a1e-4c05-8364-e5c8009b7037 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:14.143413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60437609-4a1e-4c05-8364-e5c8009b7037 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:14.143693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60437609-4a1e-4c05-8364-e5c8009b7037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:14.151259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60437609-4a1e-4c05-8364-e5c8009b7037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:14.152728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60437609-4a1e-4c05-8364-e5c8009b7037 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-60437609-4a1e-4c05-8364-e5c8009b7037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:14.167536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:14.168535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:14.169472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:14.169472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:14.169472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:14.169472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:14.169472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:14.169472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:14.169472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:14.169472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:14.169472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 415/830] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:14.176591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ef16d-b5c3-4200-96ec-5c9b96d73ce6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:14.252161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:14.293949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ef16d-b5c3-4200-96ec-5c9b96d73ce6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:14.328928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3702d7-3a27-4dba-b99e-ec6f86f36bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:14.329905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3702d7-3a27-4dba-b99e-ec6f86f36bae None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:14.330416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3702d7-3a27-4dba-b99e-ec6f86f36bae None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:14.330899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3702d7-3a27-4dba-b99e-ec6f86f36bae None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:14.331895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3702d7-3a27-4dba-b99e-ec6f86f36bae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:14.332448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3702d7-3a27-4dba-b99e-ec6f86f36bae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:14.334096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3702d7-3a27-4dba-b99e-ec6f86f36bae None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:14.347143 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 416/831] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:14.353092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60437609-4a1e-4c05-8364-e5c8009b7037 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:14.377301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:14.453269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60437609-4a1e-4c05-8364-e5c8009b7037 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:14.486686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae759a9-6a53-486b-8f8b-86d83d6c289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:14.487579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae759a9-6a53-486b-8f8b-86d83d6c289e None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:14.487861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae759a9-6a53-486b-8f8b-86d83d6c289e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:14.488141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae759a9-6a53-486b-8f8b-86d83d6c289e None admin] PATH_INFO: `/v3/projects/311787f32b54485682be669bca9998f8/users/79d23f1644b94d51a4d0efe47f7aab3f/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:14.490213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae759a9-6a53-486b-8f8b-86d83d6c289e None admin] RBAC: Authorizing `identity:create_grant(project_id=311787f32b54485682be669bca9998f8, user_id=79d23f1644b94d51a4d0efe47f7aab3f, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:14.491638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae759a9-6a53-486b-8f8b-86d83d6c289e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:14.608174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 416/832] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:54:14 2022] PUT /identity/v3/projects/311787f32b54485682be669bca9998f8/users/79d23f1644b94d51a4d0efe47f7aab3f/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:54:15.226679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eb27e-a97c-4213-91a9-5b63f5f37b02 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:15.227194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eb27e-a97c-4213-91a9-5b63f5f37b02 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:15.227304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eb27e-a97c-4213-91a9-5b63f5f37b02 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:15.228885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 417/833] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:15.234649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79662aa-76de-4c5f-a1a6-8f1486fd22de None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:15.235067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79662aa-76de-4c5f-a1a6-8f1486fd22de None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:15.235253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79662aa-76de-4c5f-a1a6-8f1486fd22de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:15.252742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e79662aa-76de-4c5f-a1a6-8f1486fd22de None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:15.253948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e79662aa-76de-4c5f-a1a6-8f1486fd22de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:15.325094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 417/834] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:15.348843 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eb27e-a97c-4213-91a9-5b63f5f37b02 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:15.455995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eb27e-a97c-4213-91a9-5b63f5f37b02 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:15.479863 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:15.490634 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568db6d-29e1-49b3-aa8f-8fb3d0df29e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:15.491434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568db6d-29e1-49b3-aa8f-8fb3d0df29e8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:15.491719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568db6d-29e1-49b3-aa8f-8fb3d0df29e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:15.491999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568db6d-29e1-49b3-aa8f-8fb3d0df29e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:15.502905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568db6d-29e1-49b3-aa8f-8fb3d0df29e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-3568db6d-29e1-49b3-aa8f-8fb3d0df29e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:15.510702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:15.511625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:15.512643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 418/835] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:54:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:15.518467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79662aa-76de-4c5f-a1a6-8f1486fd22de None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:15.521912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:15.615224 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8b79a-0b50-4ccf-8288-37789fa13a99 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:15.615840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8b79a-0b50-4ccf-8288-37789fa13a99 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:15.616337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8b79a-0b50-4ccf-8288-37789fa13a99 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:15.622239 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 419/836] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:15.625351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a3bc-1108-407b-82b6-59f9c94b1bd0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:15.626135 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a3bc-1108-407b-82b6-59f9c94b1bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:15.626617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a3bc-1108-407b-82b6-59f9c94b1bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:15.658962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79662aa-76de-4c5f-a1a6-8f1486fd22de None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:15.662026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e585a3bc-1108-407b-82b6-59f9c94b1bd0 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:15.663279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e585a3bc-1108-407b-82b6-59f9c94b1bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:15.708139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad237f41-b566-4fc9-80d8-d668bfc9f437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:15.708847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad237f41-b566-4fc9-80d8-d668bfc9f437 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:15.709138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad237f41-b566-4fc9-80d8-d668bfc9f437 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:15.709419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad237f41-b566-4fc9-80d8-d668bfc9f437 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:15.710173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad237f41-b566-4fc9-80d8-d668bfc9f437 None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:15.710475 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad237f41-b566-4fc9-80d8-d668bfc9f437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:15.711840 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad237f41-b566-4fc9-80d8-d668bfc9f437 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:15.729485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 418/837] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:54:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:15.732336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6058-3b04-4d2e-b47e-24f027920a26 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:15.732630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6058-3b04-4d2e-b47e-24f027920a26 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:15.732933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6058-3b04-4d2e-b47e-24f027920a26 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:15.734793 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 419/838] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:15.735711 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6058-3b04-4d2e-b47e-24f027920a26 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:15.763809 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 420/839] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:15.766305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda251c-1335-4af1-b5a7-dd20dc2ced72 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:15.766835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda251c-1335-4af1-b5a7-dd20dc2ced72 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:15.767330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda251c-1335-4af1-b5a7-dd20dc2ced72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:15.797571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ccda251c-1335-4af1-b5a7-dd20dc2ced72 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:15.799005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ccda251c-1335-4af1-b5a7-dd20dc2ced72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:15.832399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:15.872231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6058-3b04-4d2e-b47e-24f027920a26 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:15.882847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 421/840] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:15.884432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda251c-1335-4af1-b5a7-dd20dc2ced72 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:15.912282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063dc7e-9e14-4245-869f-448e56b01ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:15.915117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063dc7e-9e14-4245-869f-448e56b01ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:15.915711 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063dc7e-9e14-4245-869f-448e56b01ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:15.916761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063dc7e-9e14-4245-869f-448e56b01ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:15.937270 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063dc7e-9e14-4245-869f-448e56b01ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:15.938710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063dc7e-9e14-4245-869f-448e56b01ea5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:15.953483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-a063dc7e-9e14-4245-869f-448e56b01ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:15.966565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:15.971732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:15.972629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:15.972629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:15.972629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:15.972629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:15.973738 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 420/841] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:15.974612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063dc7e-9e14-4245-869f-448e56b01ea5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:16.021436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda251c-1335-4af1-b5a7-dd20dc2ced72 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:16.060537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413877d-1464-426b-8f48-9035838407f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:16.061428 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413877d-1464-426b-8f48-9035838407f1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.061767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413877d-1464-426b-8f48-9035838407f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.062159 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413877d-1464-426b-8f48-9035838407f1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:16.063086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413877d-1464-426b-8f48-9035838407f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:16.064298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413877d-1464-426b-8f48-9035838407f1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d413877d-1464-426b-8f48-9035838407f1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:16.078251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:16.079219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:54:16.080146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:16.084473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 422/842] 10.222.0.33 () {56 vars in 1132 bytes} [Thu Jun 23 12:54:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:16.085317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413877d-1464-426b-8f48-9035838407f1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:16.087352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063dc7e-9e14-4245-869f-448e56b01ea5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:16.105390 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:16.125722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1fb80-0f6a-4d0d-95b8-1f79673057f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:16.126461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1fb80-0f6a-4d0d-95b8-1f79673057f8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.126768 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1fb80-0f6a-4d0d-95b8-1f79673057f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.127049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1fb80-0f6a-4d0d-95b8-1f79673057f8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:16.127710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1fb80-0f6a-4d0d-95b8-1f79673057f8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:16.129113 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1fb80-0f6a-4d0d-95b8-1f79673057f8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-bea1fb80-0f6a-4d0d-95b8-1f79673057f8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:16.141643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:16.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:16.143485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 421/843] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:54:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:16.145425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1fb80-0f6a-4d0d-95b8-1f79673057f8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:16.196567 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413877d-1464-426b-8f48-9035838407f1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:16.207079 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:16.236389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c275b-35eb-42a3-98bb-994488326a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:16.237352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c275b-35eb-42a3-98bb-994488326a9e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.237645 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c275b-35eb-42a3-98bb-994488326a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.237926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c275b-35eb-42a3-98bb-994488326a9e None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:16.239356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c275b-35eb-42a3-98bb-994488326a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:16.239678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c275b-35eb-42a3-98bb-994488326a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:16.241917 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c275b-35eb-42a3-98bb-994488326a9e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:16.249747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1fb80-0f6a-4d0d-95b8-1f79673057f8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:16.259846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 423/844] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:16.259846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c275b-35eb-42a3-98bb-994488326a9e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:16.289531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13bebe-5701-44ed-b56a-cae9414775bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:16.290196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13bebe-5701-44ed-b56a-cae9414775bb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.290474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13bebe-5701-44ed-b56a-cae9414775bb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.290749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13bebe-5701-44ed-b56a-cae9414775bb None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:16.291445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13bebe-5701-44ed-b56a-cae9414775bb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:16.291746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13bebe-5701-44ed-b56a-cae9414775bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:16.293174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13bebe-5701-44ed-b56a-cae9414775bb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:16.298521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 422/845] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 23 12:54:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:16.299292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13bebe-5701-44ed-b56a-cae9414775bb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:16.349590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:16.368216 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c275b-35eb-42a3-98bb-994488326a9e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:16.405263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13bebe-5701-44ed-b56a-cae9414775bb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:16.406685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709df60-b12b-40ba-b50a-9fcf7d2025c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:16.407347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709df60-b12b-40ba-b50a-9fcf7d2025c6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.407640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709df60-b12b-40ba-b50a-9fcf7d2025c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.407916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709df60-b12b-40ba-b50a-9fcf7d2025c6 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:16.408629 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709df60-b12b-40ba-b50a-9fcf7d2025c6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:16.408979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709df60-b12b-40ba-b50a-9fcf7d2025c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:16.410335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709df60-b12b-40ba-b50a-9fcf7d2025c6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:16.415012 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 424/846] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:54:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:16.415787 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709df60-b12b-40ba-b50a-9fcf7d2025c6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:16.446112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c6a57-f0d0-48f5-b0f8-cfd67a9c8923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:16.447191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c6a57-f0d0-48f5-b0f8-cfd67a9c8923 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.447697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c6a57-f0d0-48f5-b0f8-cfd67a9c8923 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.447977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c6a57-f0d0-48f5-b0f8-cfd67a9c8923 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:16.448254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:16.456593 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c6a57-f0d0-48f5-b0f8-cfd67a9c8923 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:16.462740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c6a57-f0d0-48f5-b0f8-cfd67a9c8923 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-900c6a57-f0d0-48f5-b0f8-cfd67a9c8923 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:16.472821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:16.473792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:16.474845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:16.474845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:16.474845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:16.474845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:16.474845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:16.474845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:16.474845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:16.474845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:16.474845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:54:16.474845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:16.474845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 423/847] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 23 12:54:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:16.474845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c6a57-f0d0-48f5-b0f8-cfd67a9c8923 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:16.525495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709df60-b12b-40ba-b50a-9fcf7d2025c6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:16.561493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623eb7cc-32be-403a-9122-0f20afb165c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:16.562763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623eb7cc-32be-403a-9122-0f20afb165c6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.563047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623eb7cc-32be-403a-9122-0f20afb165c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.563327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623eb7cc-32be-403a-9122-0f20afb165c6 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:16.564072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623eb7cc-32be-403a-9122-0f20afb165c6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:16.564376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623eb7cc-32be-403a-9122-0f20afb165c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:16.565763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623eb7cc-32be-403a-9122-0f20afb165c6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:16.581007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 425/848] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 23 12:54:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:16.581007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623eb7cc-32be-403a-9122-0f20afb165c6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:16.593391 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c6a57-f0d0-48f5-b0f8-cfd67a9c8923 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:16.603122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:16.638362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a617c-cebe-4da0-aefc-9b81316b4f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:16.639408 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a617c-cebe-4da0-aefc-9b81316b4f62 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.639879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a617c-cebe-4da0-aefc-9b81316b4f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.640297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a617c-cebe-4da0-aefc-9b81316b4f62 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:16.641189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a617c-cebe-4da0-aefc-9b81316b4f62 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:16.641709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a617c-cebe-4da0-aefc-9b81316b4f62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:16.643351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a617c-cebe-4da0-aefc-9b81316b4f62 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:16.657284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 424/849] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:54:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:16.701057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:16.708196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623eb7cc-32be-403a-9122-0f20afb165c6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:16.722179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1df70f-b987-40a7-8500-b33bb5edef05 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.722842 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1df70f-b987-40a7-8500-b33bb5edef05 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.723321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1df70f-b987-40a7-8500-b33bb5edef05 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:16.725003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 425/850] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:16.731175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d58ae-077d-4d92-8782-a73dcc7b1498 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.731584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d58ae-077d-4d92-8782-a73dcc7b1498 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.731814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d58ae-077d-4d92-8782-a73dcc7b1498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:16.753004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d24d58ae-077d-4d92-8782-a73dcc7b1498 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:16.754462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d24d58ae-077d-4d92-8782-a73dcc7b1498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:16.755517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbd1e5-ea4e-48a1-a61f-ccc07dbd9036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:16.756207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd1e5-ea4e-48a1-a61f-ccc07dbd9036 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.756479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd1e5-ea4e-48a1-a61f-ccc07dbd9036 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.756806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd1e5-ea4e-48a1-a61f-ccc07dbd9036 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:16.757844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbd1e5-ea4e-48a1-a61f-ccc07dbd9036 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:16.758155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbd1e5-ea4e-48a1-a61f-ccc07dbd9036 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:16.759631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbd1e5-ea4e-48a1-a61f-ccc07dbd9036 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:16.779781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 426/851] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jun 23 12:54:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:16.786327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbd1e5-ea4e-48a1-a61f-ccc07dbd9036 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:16.840790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 426/852] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:16.857903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d58ae-077d-4d92-8782-a73dcc7b1498 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:16.898851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbd1e5-ea4e-48a1-a61f-ccc07dbd9036 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:16.935641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4f1f2-8718-4d47-8495-c7a718a29912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:16.936214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4f1f2-8718-4d47-8495-c7a718a29912 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.936497 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4f1f2-8718-4d47-8495-c7a718a29912 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.936865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4f1f2-8718-4d47-8495-c7a718a29912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:16.958378 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:16.961364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d58ae-077d-4d92-8782-a73dcc7b1498 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:16.985052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:16.997700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77802c31-89dd-4ab2-b629-0ff89433f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:16.998734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802c31-89dd-4ab2-b629-0ff89433f812 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:16.999399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802c31-89dd-4ab2-b629-0ff89433f812 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:16.999911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802c31-89dd-4ab2-b629-0ff89433f812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:17.010748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77802c31-89dd-4ab2-b629-0ff89433f812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:17.014922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4f1f2-8718-4d47-8495-c7a718a29912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:17.016423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4f1f2-8718-4d47-8495-c7a718a29912 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-77802c31-89dd-4ab2-b629-0ff89433f812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:17.019196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:17.020127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:17.021004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:17.021004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:17.021004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:17.021004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:17.021004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:17.021004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:17.021004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:17.021004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:17.021004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:17.021004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:17.021004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:17.021004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:17.028598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 427/853] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:54:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:17.030087 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77802c31-89dd-4ab2-b629-0ff89433f812 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:17.142762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77802c31-89dd-4ab2-b629-0ff89433f812 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:17.143542 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 427/854] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 12:54:17.145155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4f1f2-8718-4d47-8495-c7a718a29912 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:17.180381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0be30-5593-44b6-97a4-4412d012f3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:17.181339 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0be30-5593-44b6-97a4-4412d012f3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:17.181770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0be30-5593-44b6-97a4-4412d012f3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:17.182219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0be30-5593-44b6-97a4-4412d012f3f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:17.183097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0be30-5593-44b6-97a4-4412d012f3f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:17.183567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0be30-5593-44b6-97a4-4412d012f3f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:17.184961 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0be30-5593-44b6-97a4-4412d012f3f2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:17.198304 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 428/855] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:54:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:17.199443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0be30-5593-44b6-97a4-4412d012f3f2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:17.212684 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:17.225644 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:17.270153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4f1f2-8718-4d47-8495-c7a718a29912 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:17.310464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0be30-5593-44b6-97a4-4412d012f3f2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:17.320889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b46ee-a31e-408a-8a5e-a23939e6e9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:17.322372 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b46ee-a31e-408a-8a5e-a23939e6e9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:17.323129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b46ee-a31e-408a-8a5e-a23939e6e9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:17.323594 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b46ee-a31e-408a-8a5e-a23939e6e9f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:17.338829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b46ee-a31e-408a-8a5e-a23939e6e9f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:17.341118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b46ee-a31e-408a-8a5e-a23939e6e9f0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:17.349557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38684ee6-e00f-4ca0-b307-65970fe1f8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:17.350445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38684ee6-e00f-4ca0-b307-65970fe1f8bc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:17.350803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38684ee6-e00f-4ca0-b307-65970fe1f8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:17.351153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38684ee6-e00f-4ca0-b307-65970fe1f8bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:17.362658 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38684ee6-e00f-4ca0-b307-65970fe1f8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:17.364186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38684ee6-e00f-4ca0-b307-65970fe1f8bc None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-267b46ee-a31e-408a-8a5e-a23939e6e9f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:17.365082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:17.365942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:17.366850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:17.366850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:17.366850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:17.366850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:17.369561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 428/856] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:17.375145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b46ee-a31e-408a-8a5e-a23939e6e9f0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-38684ee6-e00f-4ca0-b307-65970fe1f8bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:17.384778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:17.385927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:17.387054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:17.387054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:17.387054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:17.387054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:17.392884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 429/857] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:17.394076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38684ee6-e00f-4ca0-b307-65970fe1f8bc None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:17.472453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:17.498938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38684ee6-e00f-4ca0-b307-65970fe1f8bc None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:17.509526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b46ee-a31e-408a-8a5e-a23939e6e9f0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:17.519530 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:17.535570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b72075-177c-46fa-a427-fc6ac3733f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:17.536367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b72075-177c-46fa-a427-fc6ac3733f58 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:17.536818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b72075-177c-46fa-a427-fc6ac3733f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:17.537173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b72075-177c-46fa-a427-fc6ac3733f58 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:17.537968 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b72075-177c-46fa-a427-fc6ac3733f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:17.538346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b72075-177c-46fa-a427-fc6ac3733f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:17.539782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b72075-177c-46fa-a427-fc6ac3733f58 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:17.557971 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 430/858] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:17.565117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b72075-177c-46fa-a427-fc6ac3733f58 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:17.566077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166c270-94a8-4a17-bf6b-dd3eb38acb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:17.566817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166c270-94a8-4a17-bf6b-dd3eb38acb55 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:17.567195 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166c270-94a8-4a17-bf6b-dd3eb38acb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:17.567550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166c270-94a8-4a17-bf6b-dd3eb38acb55 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:17.568535 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166c270-94a8-4a17-bf6b-dd3eb38acb55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:17.569019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166c270-94a8-4a17-bf6b-dd3eb38acb55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:17.571190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166c270-94a8-4a17-bf6b-dd3eb38acb55 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:17.585730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 429/859] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:17.590728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166c270-94a8-4a17-bf6b-dd3eb38acb55 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:17.674615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b72075-177c-46fa-a427-fc6ac3733f58 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:17.711854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c597c0e-8e8a-43eb-b0b5-9802ca433f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:17.712992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c597c0e-8e8a-43eb-b0b5-9802ca433f08 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:17.713579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c597c0e-8e8a-43eb-b0b5-9802ca433f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:17.714027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c597c0e-8e8a-43eb-b0b5-9802ca433f08 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:17.716332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:17.726462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c597c0e-8e8a-43eb-b0b5-9802ca433f08 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:17.726462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c597c0e-8e8a-43eb-b0b5-9802ca433f08 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:17.727002 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166c270-94a8-4a17-bf6b-dd3eb38acb55 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-3c597c0e-8e8a-43eb-b0b5-9802ca433f08 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:17.740524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:17.741503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:17.742425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:17.742425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:17.742425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:17.742425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:17.742425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:17.742425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:17.742425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:17.742425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:17.742425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:54:17.742425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:17.745295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 431/860] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:54:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:17.752700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c597c0e-8e8a-43eb-b0b5-9802ca433f08 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:17.773472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2aec6-1ac1-4f33-92f2-78566d031d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:17.774670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2aec6-1ac1-4f33-92f2-78566d031d34 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:17.775217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2aec6-1ac1-4f33-92f2-78566d031d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:17.775704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2aec6-1ac1-4f33-92f2-78566d031d34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:17.784038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2aec6-1ac1-4f33-92f2-78566d031d34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:17.785905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2aec6-1ac1-4f33-92f2-78566d031d34 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-ade2aec6-1ac1-4f33-92f2-78566d031d34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:17.801647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:17.802668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:17.803562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:17.803562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:17.803562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:17.803562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:17.803562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:17.803562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:17.803562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:17.803562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:17.810666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 430/861] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:17.811877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2aec6-1ac1-4f33-92f2-78566d031d34 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:17.845889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:17.863780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c597c0e-8e8a-43eb-b0b5-9802ca433f08 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:17.898628 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c92d5-9ded-4633-8c36-3b6999b90e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:17.899423 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c92d5-9ded-4633-8c36-3b6999b90e5e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:17.899778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c92d5-9ded-4633-8c36-3b6999b90e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:17.900130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c92d5-9ded-4633-8c36-3b6999b90e5e None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:17.901072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c92d5-9ded-4633-8c36-3b6999b90e5e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:17.901451 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c92d5-9ded-4633-8c36-3b6999b90e5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:17.903164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c92d5-9ded-4633-8c36-3b6999b90e5e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:17.926138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 432/862] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jun 23 12:54:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:17.927517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c92d5-9ded-4633-8c36-3b6999b90e5e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:17.928187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2aec6-1ac1-4f33-92f2-78566d031d34 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:17.964649 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bf982-df81-45aa-a524-83afb0398392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:17.965745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bf982-df81-45aa-a524-83afb0398392 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:17.966371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bf982-df81-45aa-a524-83afb0398392 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:17.966862 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bf982-df81-45aa-a524-83afb0398392 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:17.968374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bf982-df81-45aa-a524-83afb0398392 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:17.968992 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bf982-df81-45aa-a524-83afb0398392 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:17.970798 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bf982-df81-45aa-a524-83afb0398392 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:17.979618 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:17.990541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 431/863] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:17.991640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bf982-df81-45aa-a524-83afb0398392 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:18.027283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c92d5-9ded-4633-8c36-3b6999b90e5e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:18.062773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84c83e-53fe-45f9-b9e6-b596109002d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:18.063557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84c83e-53fe-45f9-b9e6-b596109002d7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:18.063793 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84c83e-53fe-45f9-b9e6-b596109002d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:18.064076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84c83e-53fe-45f9-b9e6-b596109002d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:18.093848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:18.109868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bf982-df81-45aa-a524-83afb0398392 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:18.136328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84c83e-53fe-45f9-b9e6-b596109002d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:18.137851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84c83e-53fe-45f9-b9e6-b596109002d7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:18.147915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21040142-fe11-4625-9205-8f78697c6105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:18.148888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21040142-fe11-4625-9205-8f78697c6105 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:18.149455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21040142-fe11-4625-9205-8f78697c6105 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:18.149988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21040142-fe11-4625-9205-8f78697c6105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:18.151154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21040142-fe11-4625-9205-8f78697c6105 None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=09e74199a07b481e837185c93b7c6455) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:18.151684 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21040142-fe11-4625-9205-8f78697c6105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:18.153587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21040142-fe11-4625-9205-8f78697c6105 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:18.169121 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 432/864] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:17 2022] GET /identity/v3/role_assignments?user.id=09e74199a07b481e837185c93b7c6455&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:18.195676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:18.254339 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 433/865] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:54:18.255699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21040142-fe11-4625-9205-8f78697c6105 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:18.366252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21040142-fe11-4625-9205-8f78697c6105 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:18.403183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b9d32-f621-4f35-9c2f-88e24f5f577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:18.403983 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b9d32-f621-4f35-9c2f-88e24f5f577b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:18.404264 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b9d32-f621-4f35-9c2f-88e24f5f577b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:18.404538 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b9d32-f621-4f35-9c2f-88e24f5f577b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:18.417522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b9d32-f621-4f35-9c2f-88e24f5f577b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:18.418987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b9d32-f621-4f35-9c2f-88e24f5f577b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-139b9d32-f621-4f35-9c2f-88e24f5f577b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:18.437767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:18.438706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:18.439595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:18.439595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:18.439595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:18.439595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:18.443497 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 433/866] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:18.444941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84c83e-53fe-45f9-b9e6-b596109002d7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:18.547602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84c83e-53fe-45f9-b9e6-b596109002d7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:18.582031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22621c-5d4f-4f33-aba0-af326605e827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:18.582698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22621c-5d4f-4f33-aba0-af326605e827 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:18.582982 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22621c-5d4f-4f33-aba0-af326605e827 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:18.583258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22621c-5d4f-4f33-aba0-af326605e827 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:18.583986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22621c-5d4f-4f33-aba0-af326605e827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:18.584295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22621c-5d4f-4f33-aba0-af326605e827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:18.585699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22621c-5d4f-4f33-aba0-af326605e827 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:18.602236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 434/867] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:18.603693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b9d32-f621-4f35-9c2f-88e24f5f577b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:18.606568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:18.706501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b9d32-f621-4f35-9c2f-88e24f5f577b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:18.741379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9064d-7300-4650-8e38-b5fef6169d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:18.742179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9064d-7300-4650-8e38-b5fef6169d6c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:18.742465 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9064d-7300-4650-8e38-b5fef6169d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:18.742748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9064d-7300-4650-8e38-b5fef6169d6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:18.749815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9064d-7300-4650-8e38-b5fef6169d6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:18.751346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9064d-7300-4650-8e38-b5fef6169d6c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-09b9064d-7300-4650-8e38-b5fef6169d6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:18.766608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:18.767534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:18.768437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:18.768437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:18.768437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:18.768437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:18.768437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:18.768437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:18.768437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:18.768437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:18.772408 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 434/868] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:18.774206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22621c-5d4f-4f33-aba0-af326605e827 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:18.777032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297994bd-4a12-40f8-99f4-fd534907b6dc None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:18.777327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297994bd-4a12-40f8-99f4-fd534907b6dc None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:18.777657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297994bd-4a12-40f8-99f4-fd534907b6dc None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:18.779292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 435/869] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:54:18.784449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4104bb1-0598-470b-9416-d48ea64a19d0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:18.784778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4104bb1-0598-470b-9416-d48ea64a19d0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:18.785070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4104bb1-0598-470b-9416-d48ea64a19d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:18.801259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:18.802447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b4104bb1-0598-470b-9416-d48ea64a19d0 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:18.803656 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b4104bb1-0598-470b-9416-d48ea64a19d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:18.863671 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:18.877767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 436/870] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:18.880091 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2948969-5aa2-4968-b342-22c52ec3d2f0 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:18.880446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2948969-5aa2-4968-b342-22c52ec3d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:18.884695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2948969-5aa2-4968-b342-22c52ec3d2f0 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:18.884695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 437/871] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:18.888162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63931e42-0951-4f33-8928-8a76a98df024 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:18.888613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63931e42-0951-4f33-8928-8a76a98df024 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:18.888742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22621c-5d4f-4f33-aba0-af326605e827 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:18.889179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63931e42-0951-4f33-8928-8a76a98df024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:18.908731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-63931e42-0951-4f33-8928-8a76a98df024 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:18.909901 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-63931e42-0951-4f33-8928-8a76a98df024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:18.926574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb37d1-bddd-45c9-a89d-a612aa1c9fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:18.927244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb37d1-bddd-45c9-a89d-a612aa1c9fad None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:18.927535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb37d1-bddd-45c9-a89d-a612aa1c9fad None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:18.927886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb37d1-bddd-45c9-a89d-a612aa1c9fad None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:18.928734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb37d1-bddd-45c9-a89d-a612aa1c9fad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:18.929054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb37d1-bddd-45c9-a89d-a612aa1c9fad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:18.930486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb37d1-bddd-45c9-a89d-a612aa1c9fad None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:18.948137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 435/872] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:18.948137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb37d1-bddd-45c9-a89d-a612aa1c9fad None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:18.986256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 438/873] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:18.993991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63931e42-0951-4f33-8928-8a76a98df024 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:19.021411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:19.051389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb37d1-bddd-45c9-a89d-a612aa1c9fad None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:19.094120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130688f-7521-4072-95f1-02932fa4dee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:19.094793 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130688f-7521-4072-95f1-02932fa4dee4 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:19.095078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130688f-7521-4072-95f1-02932fa4dee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:19.095354 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130688f-7521-4072-95f1-02932fa4dee4 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:19.096069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130688f-7521-4072-95f1-02932fa4dee4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:19.097486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130688f-7521-4072-95f1-02932fa4dee4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:19.116254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63931e42-0951-4f33-8928-8a76a98df024 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:19.138235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:19.150335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb632d4-8162-4584-8a85-5c5ffddfde45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:19.150985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb632d4-8162-4584-8a85-5c5ffddfde45 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:19.151273 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb632d4-8162-4584-8a85-5c5ffddfde45 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:19.151564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb632d4-8162-4584-8a85-5c5ffddfde45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:19.152375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb632d4-8162-4584-8a85-5c5ffddfde45 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=311787f32b54485682be669bca9998f8, user.id=79d23f1644b94d51a4d0efe47f7aab3f) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:19.152718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb632d4-8162-4584-8a85-5c5ffddfde45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:19.154178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb632d4-8162-4584-8a85-5c5ffddfde45 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:19.159919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 439/874] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:18 2022] GET /identity/v3/role_assignments?user.id=79d23f1644b94d51a4d0efe47f7aab3f&scope.project.id=311787f32b54485682be669bca9998f8&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:19.165750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb632d4-8162-4584-8a85-5c5ffddfde45 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:19.201192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 436/875] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:54:18 2022] POST /identity/v3/services => generated 269 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:54:19.296806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb632d4-8162-4584-8a85-5c5ffddfde45 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:19.345293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f2c13-d37f-4e25-acbd-f74970dace58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:19.345653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f2c13-d37f-4e25-acbd-f74970dace58 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:19.345841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f2c13-d37f-4e25-acbd-f74970dace58 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:19.346115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f2c13-d37f-4e25-acbd-f74970dace58 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:19.346842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f2c13-d37f-4e25-acbd-f74970dace58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:19.348210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f2c13-d37f-4e25-acbd-f74970dace58 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:19.431750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 440/876] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:54:19 2022] POST /identity/v3/services => generated 251 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:54:20.350393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4e307-3ebe-453b-94a0-ac9072a3748a None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:20.350907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4e307-3ebe-453b-94a0-ac9072a3748a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:20.350907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4e307-3ebe-453b-94a0-ac9072a3748a None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:20.352594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 437/877] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:20.358244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8412b-7264-4985-b010-c9367fa47aa6 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:20.358571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8412b-7264-4985-b010-c9367fa47aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:20.358852 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8412b-7264-4985-b010-c9367fa47aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:20.375782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b1e8412b-7264-4985-b010-c9367fa47aa6 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:20.376993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b1e8412b-7264-4985-b010-c9367fa47aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:20.413558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:20.449960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 441/878] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:20.474578 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4e307-3ebe-453b-94a0-ac9072a3748a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:20.585080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4e307-3ebe-453b-94a0-ac9072a3748a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:20.615718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:20.620890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34041451-ead3-40d2-b831-b72ed364af68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:20.621709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34041451-ead3-40d2-b831-b72ed364af68 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:20.621997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34041451-ead3-40d2-b831-b72ed364af68 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:20.622276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34041451-ead3-40d2-b831-b72ed364af68 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:20.632989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34041451-ead3-40d2-b831-b72ed364af68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-34041451-ead3-40d2-b831-b72ed364af68 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:20.641144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:20.642065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:20.643167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 438/879] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jun 23 12:54:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:20.648477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8412b-7264-4985-b010-c9367fa47aa6 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:20.748987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8412b-7264-4985-b010-c9367fa47aa6 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:20.783508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dfd47-623e-4748-b502-9fca0e76e8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:20.784186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dfd47-623e-4748-b502-9fca0e76e8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:20.784466 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dfd47-623e-4748-b502-9fca0e76e8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:20.784773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dfd47-623e-4748-b502-9fca0e76e8c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:20.785518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dfd47-623e-4748-b502-9fca0e76e8c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:20.785823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dfd47-623e-4748-b502-9fca0e76e8c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:20.787240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dfd47-623e-4748-b502-9fca0e76e8c8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:20.796400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 442/880] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 23 12:54:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:20.805837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34041451-ead3-40d2-b831-b72ed364af68 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:20.910818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34041451-ead3-40d2-b831-b72ed364af68 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:20.956487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f46e18-2df1-420c-8bb5-ea472c1b825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:20.957331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f46e18-2df1-420c-8bb5-ea472c1b825f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:20.957614 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f46e18-2df1-420c-8bb5-ea472c1b825f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:20.957888 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f46e18-2df1-420c-8bb5-ea472c1b825f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:20.969749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f46e18-2df1-420c-8bb5-ea472c1b825f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:20.971216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f46e18-2df1-420c-8bb5-ea472c1b825f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-98f46e18-2df1-420c-8bb5-ea472c1b825f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:20.988978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:20.989860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:20.990732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:20.990732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:20.990732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:20.990732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:20.994281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 439/881] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:21.000125 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dfd47-623e-4748-b502-9fca0e76e8c8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:21.036500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:21.104890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dfd47-623e-4748-b502-9fca0e76e8c8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:21.140136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4c8be-3bae-47f7-92d1-dc66ba7aa05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:21.140833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4c8be-3bae-47f7-92d1-dc66ba7aa05f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.141120 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4c8be-3bae-47f7-92d1-dc66ba7aa05f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.141395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4c8be-3bae-47f7-92d1-dc66ba7aa05f None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.142118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4c8be-3bae-47f7-92d1-dc66ba7aa05f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:21.142424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4c8be-3bae-47f7-92d1-dc66ba7aa05f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:21.143781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4c8be-3bae-47f7-92d1-dc66ba7aa05f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:21.156049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 443/882] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:21.161541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f46e18-2df1-420c-8bb5-ea472c1b825f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:21.214720 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:21.268820 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79fd47-ee8e-436a-9141-5c4e9fd990f5 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.269465 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79fd47-ee8e-436a-9141-5c4e9fd990f5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.269948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79fd47-ee8e-436a-9141-5c4e9fd990f5 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.272213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 444/883] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:21.275410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f46e18-2df1-420c-8bb5-ea472c1b825f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:21.277045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14343fb8-f32c-40eb-abf0-76e29b95706e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.277609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14343fb8-f32c-40eb-abf0-76e29b95706e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.278082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14343fb8-f32c-40eb-abf0-76e29b95706e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.295193 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-14343fb8-f32c-40eb-abf0-76e29b95706e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:21.297362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-14343fb8-f32c-40eb-abf0-76e29b95706e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:21.315342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7604db-fb0e-4f4f-912b-f44c81fab1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:21.316488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7604db-fb0e-4f4f-912b-f44c81fab1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.316999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7604db-fb0e-4f4f-912b-f44c81fab1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.317496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7604db-fb0e-4f4f-912b-f44c81fab1a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.326467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7604db-fb0e-4f4f-912b-f44c81fab1a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:21.327927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7604db-fb0e-4f4f-912b-f44c81fab1a8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-bf7604db-fb0e-4f4f-912b-f44c81fab1a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:21.343137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:21.344134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:21.345748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:21.345748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:21.345748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:21.345748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:21.345748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:21.345748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:21.345748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:21.345748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:21.345748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:54:21.345748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:21.345748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 440/884] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 23 12:54:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:21.350049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7604db-fb0e-4f4f-912b-f44c81fab1a8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:21.382627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 445/885] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:21.397547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a9d1e-e325-4529-8b22-eb2c21ffd1d5 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.397833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a9d1e-e325-4529-8b22-eb2c21ffd1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.398116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a9d1e-e325-4529-8b22-eb2c21ffd1d5 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.399849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 446/886] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:54:21.404875 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92e33c-d6dc-4f26-a91b-8b3a94b253ff None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.405682 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92e33c-d6dc-4f26-a91b-8b3a94b253ff None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.405963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92e33c-d6dc-4f26-a91b-8b3a94b253ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.422768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5d92e33c-d6dc-4f26-a91b-8b3a94b253ff None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:21.423860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5d92e33c-d6dc-4f26-a91b-8b3a94b253ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:21.441131 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:21.469385 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7604db-fb0e-4f4f-912b-f44c81fab1a8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:21.472562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:21.494623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 447/887] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:21.496138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92e33c-d6dc-4f26-a91b-8b3a94b253ff None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:21.511971 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415744bd-83d8-4749-8b42-6880dd928c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:21.513052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415744bd-83d8-4749-8b42-6880dd928c41 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.513338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415744bd-83d8-4749-8b42-6880dd928c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.513620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415744bd-83d8-4749-8b42-6880dd928c41 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.514782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415744bd-83d8-4749-8b42-6880dd928c41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:21.515096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415744bd-83d8-4749-8b42-6880dd928c41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:21.516785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415744bd-83d8-4749-8b42-6880dd928c41 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:21.535711 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 441/888] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jun 23 12:54:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:21.536520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415744bd-83d8-4749-8b42-6880dd928c41 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:21.602106 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92e33c-d6dc-4f26-a91b-8b3a94b253ff None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:21.632875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415744bd-83d8-4749-8b42-6880dd928c41 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:21.635548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23008e-f2c1-4a5e-8123-3b12077eb50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:21.636358 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23008e-f2c1-4a5e-8123-3b12077eb50a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.636647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23008e-f2c1-4a5e-8123-3b12077eb50a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.636966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23008e-f2c1-4a5e-8123-3b12077eb50a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.637639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23008e-f2c1-4a5e-8123-3b12077eb50a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:21.639000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23008e-f2c1-4a5e-8123-3b12077eb50a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-2e23008e-f2c1-4a5e-8123-3b12077eb50a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:21.651948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:21.653006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:21.653833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 448/889] 10.222.0.33 () {56 vars in 1132 bytes} [Thu Jun 23 12:54:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:21.654690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23008e-f2c1-4a5e-8123-3b12077eb50a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:21.669211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:21.669448 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1057ec-8f66-4198-9d4a-3c426e0aa232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:21.670235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1057ec-8f66-4198-9d4a-3c426e0aa232 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.670522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1057ec-8f66-4198-9d4a-3c426e0aa232 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.670861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1057ec-8f66-4198-9d4a-3c426e0aa232 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.671498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1057ec-8f66-4198-9d4a-3c426e0aa232 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:21.672962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1057ec-8f66-4198-9d4a-3c426e0aa232 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-5e1057ec-8f66-4198-9d4a-3c426e0aa232 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:21.684972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:21.685999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:21.687347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 442/890] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 23 12:54:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:21.688130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee2e39-6e25-4d9e-aaf3-b347d978c774 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.688130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee2e39-6e25-4d9e-aaf3-b347d978c774 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.688975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee2e39-6e25-4d9e-aaf3-b347d978c774 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.689935 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 443/891] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:21.690369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee2e39-6e25-4d9e-aaf3-b347d978c774 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:21.717452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:21.758005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23008e-f2c1-4a5e-8123-3b12077eb50a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:21.792256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24a1cc-12c1-478f-a22c-1f2d7e71eb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:21.792959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24a1cc-12c1-478f-a22c-1f2d7e71eb69 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.793106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee2e39-6e25-4d9e-aaf3-b347d978c774 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:21.793230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24a1cc-12c1-478f-a22c-1f2d7e71eb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.793505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24a1cc-12c1-478f-a22c-1f2d7e71eb69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.828903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c260731-eb3a-4ff2-822d-9e2fa49c31c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:21.829572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c260731-eb3a-4ff2-822d-9e2fa49c31c3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.829858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c260731-eb3a-4ff2-822d-9e2fa49c31c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.830136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c260731-eb3a-4ff2-822d-9e2fa49c31c3 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.830838 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c260731-eb3a-4ff2-822d-9e2fa49c31c3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:21.831147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c260731-eb3a-4ff2-822d-9e2fa49c31c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:21.832514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c260731-eb3a-4ff2-822d-9e2fa49c31c3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:21.837368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 444/892] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 23 12:54:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:21.837986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c260731-eb3a-4ff2-822d-9e2fa49c31c3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:21.861042 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24a1cc-12c1-478f-a22c-1f2d7e71eb69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:21.862915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24a1cc-12c1-478f-a22c-1f2d7e71eb69 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:21.876785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:21.927768 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:21.936824 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c260731-eb3a-4ff2-822d-9e2fa49c31c3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:21.958039 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 449/893] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:21 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:54:21.959312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2098b4-1c72-441a-94cf-7bd476d91e48 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.959601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2098b4-1c72-441a-94cf-7bd476d91e48 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.959879 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2098b4-1c72-441a-94cf-7bd476d91e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.974409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236ccd4-849b-4a32-9ab9-bc8a4669f253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:21.975065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ccd4-849b-4a32-9ab9-bc8a4669f253 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:21.975347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ccd4-849b-4a32-9ab9-bc8a4669f253 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:21.975619 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ccd4-849b-4a32-9ab9-bc8a4669f253 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:21.975796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5f2098b4-1c72-441a-94cf-7bd476d91e48 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:21.976311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236ccd4-849b-4a32-9ab9-bc8a4669f253 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:21.976613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236ccd4-849b-4a32-9ab9-bc8a4669f253 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:21.976979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5f2098b4-1c72-441a-94cf-7bd476d91e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:21.977991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236ccd4-849b-4a32-9ab9-bc8a4669f253 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:21.982557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 445/894] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 23 12:54:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:21.983346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236ccd4-849b-4a32-9ab9-bc8a4669f253 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:22.046764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 450/895] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:22.047597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2098b4-1c72-441a-94cf-7bd476d91e48 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:22.095251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:22.103904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236ccd4-849b-4a32-9ab9-bc8a4669f253 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:22.136692 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b441c5-def9-4c4d-ba11-cce9089b4ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:22.137363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b441c5-def9-4c4d-ba11-cce9089b4ccb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:22.137645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b441c5-def9-4c4d-ba11-cce9089b4ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:22.137921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b441c5-def9-4c4d-ba11-cce9089b4ccb None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:22.138615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b441c5-def9-4c4d-ba11-cce9089b4ccb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:22.138920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b441c5-def9-4c4d-ba11-cce9089b4ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:22.140901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b441c5-def9-4c4d-ba11-cce9089b4ccb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:22.145925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 446/896] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 23 12:54:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:22.146717 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b441c5-def9-4c4d-ba11-cce9089b4ccb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:22.148865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2098b4-1c72-441a-94cf-7bd476d91e48 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:22.168374 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:22.191316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdbed3-2f7a-41d0-bcfc-27979e5ede60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:22.191316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdbed3-2f7a-41d0-bcfc-27979e5ede60 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:22.191316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdbed3-2f7a-41d0-bcfc-27979e5ede60 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:22.191316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdbed3-2f7a-41d0-bcfc-27979e5ede60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:22.194773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdbed3-2f7a-41d0-bcfc-27979e5ede60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:22.196213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdbed3-2f7a-41d0-bcfc-27979e5ede60 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-2dfdbed3-2f7a-41d0-bcfc-27979e5ede60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:22.213095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:22.213979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:22.214950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:22.214950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:22.214950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:22.214950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:22.214950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 451/897] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:22.215221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdbed3-2f7a-41d0-bcfc-27979e5ede60 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:22.248849 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b441c5-def9-4c4d-ba11-cce9089b4ccb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:22.281838 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8261e8-854a-4378-92a6-1d2f355d014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:22.282495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8261e8-854a-4378-92a6-1d2f355d014a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:22.282780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8261e8-854a-4378-92a6-1d2f355d014a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:22.283057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8261e8-854a-4378-92a6-1d2f355d014a None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:22.283754 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8261e8-854a-4378-92a6-1d2f355d014a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:22.284061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8261e8-854a-4378-92a6-1d2f355d014a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:22.285449 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8261e8-854a-4378-92a6-1d2f355d014a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:22.289821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 447/898] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 23 12:54:22 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:22.290580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8261e8-854a-4378-92a6-1d2f355d014a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:22.321146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:22.327443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdbed3-2f7a-41d0-bcfc-27979e5ede60 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:22.368267 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1547c15-c771-4602-9485-7d1f812befe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:22.369117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1547c15-c771-4602-9485-7d1f812befe6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:22.369404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1547c15-c771-4602-9485-7d1f812befe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:22.369682 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1547c15-c771-4602-9485-7d1f812befe6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:22.370349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1547c15-c771-4602-9485-7d1f812befe6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:22.371752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1547c15-c771-4602-9485-7d1f812befe6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-a1547c15-c771-4602-9485-7d1f812befe6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:22.386371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:22.387449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:22.388277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 452/899] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:54:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:22.389115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1547c15-c771-4602-9485-7d1f812befe6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:22.393806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:22.414204 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8261e8-854a-4378-92a6-1d2f355d014a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:22.461038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efe0c1-7ee5-457a-869d-78bcb77a6200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:22.462155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efe0c1-7ee5-457a-869d-78bcb77a6200 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:22.462596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efe0c1-7ee5-457a-869d-78bcb77a6200 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:22.463055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efe0c1-7ee5-457a-869d-78bcb77a6200 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:22.464301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efe0c1-7ee5-457a-869d-78bcb77a6200 None admin] RBAC: Adding query filter params (interface=public, service_id=970c336472ea43d3b18569536c62c531, region_id=RegionOne) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:22.464852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efe0c1-7ee5-457a-869d-78bcb77a6200 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:22.467170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efe0c1-7ee5-457a-869d-78bcb77a6200 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:22.476172 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 448/900] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 23 12:54:22 2022] GET /identity/v3/endpoints?service_id=970c336472ea43d3b18569536c62c531&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:22.477859 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efe0c1-7ee5-457a-869d-78bcb77a6200 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:22.518130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1547c15-c771-4602-9485-7d1f812befe6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:22.553939 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43acb74-0f38-449b-b7ae-02a5969ea4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:22.555250 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43acb74-0f38-449b-b7ae-02a5969ea4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:22.555768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43acb74-0f38-449b-b7ae-02a5969ea4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:22.556383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43acb74-0f38-449b-b7ae-02a5969ea4a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:22.558134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43acb74-0f38-449b-b7ae-02a5969ea4a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:22.558691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43acb74-0f38-449b-b7ae-02a5969ea4a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:22.560362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43acb74-0f38-449b-b7ae-02a5969ea4a9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:22.573379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 453/901] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:22.574535 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43acb74-0f38-449b-b7ae-02a5969ea4a9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:22.591035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efe0c1-7ee5-457a-869d-78bcb77a6200 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:22.598077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:22.626577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642f860-e19c-42b0-b6bd-63320f9cb4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:22.627246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642f860-e19c-42b0-b6bd-63320f9cb4fd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:22.627520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642f860-e19c-42b0-b6bd-63320f9cb4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:22.627794 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642f860-e19c-42b0-b6bd-63320f9cb4fd None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:22.628489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642f860-e19c-42b0-b6bd-63320f9cb4fd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:22.628825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642f860-e19c-42b0-b6bd-63320f9cb4fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:22.630188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642f860-e19c-42b0-b6bd-63320f9cb4fd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:22.639960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 449/902] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:54:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:22.639960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642f860-e19c-42b0-b6bd-63320f9cb4fd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:22.648946 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:22.686598 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43acb74-0f38-449b-b7ae-02a5969ea4a9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:22.721049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ddad-7c69-4f9b-bf6c-83c24d853a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:22.721636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ddad-7c69-4f9b-bf6c-83c24d853a02 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:22.722031 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ddad-7c69-4f9b-bf6c-83c24d853a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:22.722312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ddad-7c69-4f9b-bf6c-83c24d853a02 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:22.722993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472ddad-7c69-4f9b-bf6c-83c24d853a02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:22.724356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472ddad-7c69-4f9b-bf6c-83c24d853a02 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:22.736719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 454/903] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 23 12:54:22 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:54:22.736719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ddad-7c69-4f9b-bf6c-83c24d853a02 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:22.758225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642f860-e19c-42b0-b6bd-63320f9cb4fd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:22.800312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3054-97fe-47dd-9196-dc42b4cbf6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:22.801262 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3054-97fe-47dd-9196-dc42b4cbf6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:22.801654 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3054-97fe-47dd-9196-dc42b4cbf6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:22.802035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3054-97fe-47dd-9196-dc42b4cbf6a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:22.810822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b3054-97fe-47dd-9196-dc42b4cbf6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:22.812442 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b3054-97fe-47dd-9196-dc42b4cbf6a1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:22.829705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-a96b3054-97fe-47dd-9196-dc42b4cbf6a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:22.830686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:22.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:22.832476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:22.832476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:22.832476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:22.832476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:22.832476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:22.832476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:22.832476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:22.832476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:22.832476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 450/904] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:22.839912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3054-97fe-47dd-9196-dc42b4cbf6a1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:22.849390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ddad-7c69-4f9b-bf6c-83c24d853a02 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:22.888361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d0692-d522-4355-b3ed-0635801e1899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:22.888361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d0692-d522-4355-b3ed-0635801e1899 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:22.888361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d0692-d522-4355-b3ed-0635801e1899 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:22.888912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d0692-d522-4355-b3ed-0635801e1899 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:22.891187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d0692-d522-4355-b3ed-0635801e1899 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:22.891187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d0692-d522-4355-b3ed-0635801e1899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:22.894872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d0692-d522-4355-b3ed-0635801e1899 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:22.898093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 455/905] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:54:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:22.904653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d0692-d522-4355-b3ed-0635801e1899 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:22.933301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:22.969565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3054-97fe-47dd-9196-dc42b4cbf6a1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:23.006284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231734da-61ea-4804-95bd-621bc1f57541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:23.006966 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231734da-61ea-4804-95bd-621bc1f57541 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:23.007319 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231734da-61ea-4804-95bd-621bc1f57541 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:23.007663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231734da-61ea-4804-95bd-621bc1f57541 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:23.008517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231734da-61ea-4804-95bd-621bc1f57541 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:23.008917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231734da-61ea-4804-95bd-621bc1f57541 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:23.010524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231734da-61ea-4804-95bd-621bc1f57541 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:23.023884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 451/906] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:23.030756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231734da-61ea-4804-95bd-621bc1f57541 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:23.041137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d0692-d522-4355-b3ed-0635801e1899 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:23.082921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57a48a-5917-4b6e-b7ce-233704e8e840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:23.083735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57a48a-5917-4b6e-b7ce-233704e8e840 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:23.084116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57a48a-5917-4b6e-b7ce-233704e8e840 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:23.084602 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57a48a-5917-4b6e-b7ce-233704e8e840 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:23.085509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57a48a-5917-4b6e-b7ce-233704e8e840 None admin] RBAC: Adding query filter params (interface=public, service_id=dad486e803494b21a06fe13edc180124, region_id=RegionOne) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:23.085899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57a48a-5917-4b6e-b7ce-233704e8e840 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:23.087299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57a48a-5917-4b6e-b7ce-233704e8e840 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:23.098290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 456/907] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 23 12:54:22 2022] GET /identity/v3/endpoints?service_id=dad486e803494b21a06fe13edc180124&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:23.099292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57a48a-5917-4b6e-b7ce-233704e8e840 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:23.115821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:23.157508 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231734da-61ea-4804-95bd-621bc1f57541 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:23.194857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:23.203682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff3ce9-29c9-4f98-9df7-4fe5d32c7241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:23.204584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3ce9-29c9-4f98-9df7-4fe5d32c7241 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:23.204898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3ce9-29c9-4f98-9df7-4fe5d32c7241 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:23.205177 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3ce9-29c9-4f98-9df7-4fe5d32c7241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:23.206468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff3ce9-29c9-4f98-9df7-4fe5d32c7241 None admin] RBAC: Adding query filter params (role.id=442af245d352472aa06e68c06a06a576, scope.project.id=311787f32b54485682be669bca9998f8, user.id=09e74199a07b481e837185c93b7c6455) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:23.206772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff3ce9-29c9-4f98-9df7-4fe5d32c7241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:23.208743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff3ce9-29c9-4f98-9df7-4fe5d32c7241 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:23.212385 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57a48a-5917-4b6e-b7ce-233704e8e840 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:23.216544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 452/908] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:23 2022] GET /identity/v3/role_assignments?user.id=09e74199a07b481e837185c93b7c6455&scope.project.id=311787f32b54485682be669bca9998f8&role.id=442af245d352472aa06e68c06a06a576 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:23.257062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c027c-42f0-4fc5-a71f-4ccdd876904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:23.258070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c027c-42f0-4fc5-a71f-4ccdd876904a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:23.258579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c027c-42f0-4fc5-a71f-4ccdd876904a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:23.259033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c027c-42f0-4fc5-a71f-4ccdd876904a None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:23.259922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c027c-42f0-4fc5-a71f-4ccdd876904a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:23.261515 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c027c-42f0-4fc5-a71f-4ccdd876904a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:23.269337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 457/909] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 23 12:54:23 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:54:24.345339 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1730af8-55ca-4319-b0d7-a28f3c670141 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:24.345836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1730af8-55ca-4319-b0d7-a28f3c670141 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:24.345836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1730af8-55ca-4319-b0d7-a28f3c670141 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:24.347422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 453/910] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:24.352736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41179902-87f7-4bc5-be0e-853ef7144d77 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:24.353130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41179902-87f7-4bc5-be0e-853ef7144d77 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:24.353290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41179902-87f7-4bc5-be0e-853ef7144d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:24.370816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-41179902-87f7-4bc5-be0e-853ef7144d77 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:24.372007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-41179902-87f7-4bc5-be0e-853ef7144d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:24.443372 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 458/911] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:24.467214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1730af8-55ca-4319-b0d7-a28f3c670141 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:24.569340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1730af8-55ca-4319-b0d7-a28f3c670141 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:24.602891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6cf95-1ab5-4de7-8c05-ad57edb5c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:24.603533 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6cf95-1ab5-4de7-8c05-ad57edb5c80f None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:24.603815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6cf95-1ab5-4de7-8c05-ad57edb5c80f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:24.604092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6cf95-1ab5-4de7-8c05-ad57edb5c80f None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:24.604895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6cf95-1ab5-4de7-8c05-ad57edb5c80f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:24.606255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6cf95-1ab5-4de7-8c05-ad57edb5c80f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:24.714175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 454/912] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:54:24 2022] POST /identity/v3/services => generated 241 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:54:24.895243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307a374-acfc-4b5f-aba6-55d41d9245fd None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:24.895587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307a374-acfc-4b5f-aba6-55d41d9245fd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:24.895782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307a374-acfc-4b5f-aba6-55d41d9245fd None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:24.897732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 459/913] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:24.902653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3870-ebfb-4f32-9ff0-5fd30f3da810 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:24.902945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3870-ebfb-4f32-9ff0-5fd30f3da810 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:24.903221 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3870-ebfb-4f32-9ff0-5fd30f3da810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:24.921054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5e3d3870-ebfb-4f32-9ff0-5fd30f3da810 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:24.922234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5e3d3870-ebfb-4f32-9ff0-5fd30f3da810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:24.973801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:24.997329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 455/914] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:25.022056 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307a374-acfc-4b5f-aba6-55d41d9245fd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:25.031675 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:25.128090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307a374-acfc-4b5f-aba6-55d41d9245fd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:25.173017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4df0d-2d29-496a-9f75-e90fa06392ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:25.173751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4df0d-2d29-496a-9f75-e90fa06392ed None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:25.174038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4df0d-2d29-496a-9f75-e90fa06392ed None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:25.174314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4df0d-2d29-496a-9f75-e90fa06392ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:25.174968 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4df0d-2d29-496a-9f75-e90fa06392ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:25.176327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4df0d-2d29-496a-9f75-e90fa06392ed None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-43e4df0d-2d29-496a-9f75-e90fa06392ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:25.189104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:25.191290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:25.193433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 460/915] 10.222.0.33 () {56 vars in 1132 bytes} [Thu Jun 23 12:54:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:25.201844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d3870-ebfb-4f32-9ff0-5fd30f3da810 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:25.267731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189683b-1cf5-49e1-b171-09e8640fb98d None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:25.268082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189683b-1cf5-49e1-b171-09e8640fb98d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:25.268289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189683b-1cf5-49e1-b171-09e8640fb98d None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:25.269687 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 461/916] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:25.275111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7424f-afa6-4812-9ffc-6114ba746fcd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:25.275407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7424f-afa6-4812-9ffc-6114ba746fcd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:25.275691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7424f-afa6-4812-9ffc-6114ba746fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:25.294331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-01b7424f-afa6-4812-9ffc-6114ba746fcd None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:25.295564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-01b7424f-afa6-4812-9ffc-6114ba746fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:25.301765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d3870-ebfb-4f32-9ff0-5fd30f3da810 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:25.345645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1b875-0b23-4b01-b428-ca3841dc2efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:25.347552 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1b875-0b23-4b01-b428-ca3841dc2efd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:25.348154 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1b875-0b23-4b01-b428-ca3841dc2efd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:25.348630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1b875-0b23-4b01-b428-ca3841dc2efd None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:25.350000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1b875-0b23-4b01-b428-ca3841dc2efd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:25.350513 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1b875-0b23-4b01-b428-ca3841dc2efd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:25.352081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1b875-0b23-4b01-b428-ca3841dc2efd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:25.360070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 456/917] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 23 12:54:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:25.365220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1b875-0b23-4b01-b428-ca3841dc2efd None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:25.370411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:25.377006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 462/918] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:25.396252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7424f-afa6-4812-9ffc-6114ba746fcd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:25.416019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:25.472289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1b875-0b23-4b01-b428-ca3841dc2efd None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:25.501189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7424f-afa6-4812-9ffc-6114ba746fcd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:25.506416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45d455-3765-4ce6-931b-a8c1afff772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:25.507091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45d455-3765-4ce6-931b-a8c1afff772d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:25.507462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45d455-3765-4ce6-931b-a8c1afff772d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:25.507748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45d455-3765-4ce6-931b-a8c1afff772d None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:25.508462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45d455-3765-4ce6-931b-a8c1afff772d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:25.508809 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45d455-3765-4ce6-931b-a8c1afff772d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:25.510187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45d455-3765-4ce6-931b-a8c1afff772d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:25.515764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 457/919] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 23 12:54:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:25.521992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5018321-8326-48de-9502-654dc47f75d8 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:25.522288 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5018321-8326-48de-9502-654dc47f75d8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:25.522572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5018321-8326-48de-9502-654dc47f75d8 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:25.523835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 458/920] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:25.527777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5018321-8326-48de-9502-654dc47f75d8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:25.540719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804afa81-3a0f-46eb-8cf5-43a071edee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:25.541533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804afa81-3a0f-46eb-8cf5-43a071edee23 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:25.541812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804afa81-3a0f-46eb-8cf5-43a071edee23 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:25.542081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804afa81-3a0f-46eb-8cf5-43a071edee23 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:25.552950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804afa81-3a0f-46eb-8cf5-43a071edee23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-804afa81-3a0f-46eb-8cf5-43a071edee23 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:25.561013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:25.562085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:25.563525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 463/921] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jun 23 12:54:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:25.564270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa07ab-eeec-412e-9ca7-1ab9f8c8951c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:25.564270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa07ab-eeec-412e-9ca7-1ab9f8c8951c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:25.564270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa07ab-eeec-412e-9ca7-1ab9f8c8951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:25.581500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-23aa07ab-eeec-412e-9ca7-1ab9f8c8951c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:25.582753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-23aa07ab-eeec-412e-9ca7-1ab9f8c8951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:25.633029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5018321-8326-48de-9502-654dc47f75d8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:25.637454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:25.642621 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:25.651475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 464/922] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:25.652281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa07ab-eeec-412e-9ca7-1ab9f8c8951c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:25.668463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58841-9f09-4d8b-840b-bef40419ec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:25.669465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58841-9f09-4d8b-840b-bef40419ec00 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:25.669954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58841-9f09-4d8b-840b-bef40419ec00 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:25.670432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58841-9f09-4d8b-840b-bef40419ec00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:25.671483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e58841-9f09-4d8b-840b-bef40419ec00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:25.673086 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e58841-9f09-4d8b-840b-bef40419ec00 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:25.756887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa07ab-eeec-412e-9ca7-1ab9f8c8951c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:25.790785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76372a5e-a90b-4c57-9171-db31c39ab102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:25.791454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76372a5e-a90b-4c57-9171-db31c39ab102 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:25.791742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76372a5e-a90b-4c57-9171-db31c39ab102 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:25.792022 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76372a5e-a90b-4c57-9171-db31c39ab102 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:25.792803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76372a5e-a90b-4c57-9171-db31c39ab102 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:25.793166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76372a5e-a90b-4c57-9171-db31c39ab102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:25.794486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76372a5e-a90b-4c57-9171-db31c39ab102 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:25.803240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 465/923] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 23 12:54:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:25.804189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76372a5e-a90b-4c57-9171-db31c39ab102 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:25.813012 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 459/924] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 23 12:54:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:54:25.821739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58841-9f09-4d8b-840b-bef40419ec00 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:25.869893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:25.945246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76372a5e-a90b-4c57-9171-db31c39ab102 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:25.989851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e2f4a-6911-47c6-8fe6-bf7886e5a176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:25.990816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e2f4a-6911-47c6-8fe6-bf7886e5a176 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:25.991193 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e2f4a-6911-47c6-8fe6-bf7886e5a176 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:25.991566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e2f4a-6911-47c6-8fe6-bf7886e5a176 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:25.991987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58841-9f09-4d8b-840b-bef40419ec00 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:25.992416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e2f4a-6911-47c6-8fe6-bf7886e5a176 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:25.994120 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e2f4a-6911-47c6-8fe6-bf7886e5a176 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-d72e2f4a-6911-47c6-8fe6-bf7886e5a176 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:26.007755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:26.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:26.010087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 466/925] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:54:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:26.015304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e2f4a-6911-47c6-8fe6-bf7886e5a176 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:26.036823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8611d07-0784-4366-a076-57a8a4ff5299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:26.037766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8611d07-0784-4366-a076-57a8a4ff5299 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:26.038058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8611d07-0784-4366-a076-57a8a4ff5299 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:26.038338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8611d07-0784-4366-a076-57a8a4ff5299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:26.051514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8611d07-0784-4366-a076-57a8a4ff5299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:26.055529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8611d07-0784-4366-a076-57a8a4ff5299 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c8611d07-0784-4366-a076-57a8a4ff5299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:26.077010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:26.077948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:26.079257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:26.079257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:26.079257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:26.079257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:26.079257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 460/926] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:26.084707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8611d07-0784-4366-a076-57a8a4ff5299 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:26.100762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:26.148368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e2f4a-6911-47c6-8fe6-bf7886e5a176 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:26.164832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:26.187731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724f5c3-4491-43f4-b80d-b34e3081d05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:26.188855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724f5c3-4491-43f4-b80d-b34e3081d05e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:26.189398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724f5c3-4491-43f4-b80d-b34e3081d05e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:26.189880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724f5c3-4491-43f4-b80d-b34e3081d05e None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:26.190803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724f5c3-4491-43f4-b80d-b34e3081d05e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:26.191327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724f5c3-4491-43f4-b80d-b34e3081d05e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:26.192996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724f5c3-4491-43f4-b80d-b34e3081d05e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:26.199439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 467/927] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:54:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:26.202527 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8611d07-0784-4366-a076-57a8a4ff5299 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:26.207008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724f5c3-4491-43f4-b80d-b34e3081d05e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:26.240364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c35b7-fad9-4082-a026-58c74f0e05c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:26.241461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c35b7-fad9-4082-a026-58c74f0e05c1 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:26.241979 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c35b7-fad9-4082-a026-58c74f0e05c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:26.242534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c35b7-fad9-4082-a026-58c74f0e05c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:26.243470 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c35b7-fad9-4082-a026-58c74f0e05c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:26.243980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c35b7-fad9-4082-a026-58c74f0e05c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:26.245644 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c35b7-fad9-4082-a026-58c74f0e05c1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:26.261478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 461/928] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:26.267067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c35b7-fad9-4082-a026-58c74f0e05c1 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:26.334379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724f5c3-4491-43f4-b80d-b34e3081d05e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:26.351418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:26.375416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897def4b-14bb-41d6-a0b9-7cbc5e517cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:26.376085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897def4b-14bb-41d6-a0b9-7cbc5e517cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:26.376364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897def4b-14bb-41d6-a0b9-7cbc5e517cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:26.376784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897def4b-14bb-41d6-a0b9-7cbc5e517cb3 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:26.377646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897def4b-14bb-41d6-a0b9-7cbc5e517cb3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:26.377956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897def4b-14bb-41d6-a0b9-7cbc5e517cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:26.379835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897def4b-14bb-41d6-a0b9-7cbc5e517cb3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:26.387157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 468/929] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 23 12:54:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:26.392393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c35b7-fad9-4082-a026-58c74f0e05c1 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:26.393322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897def4b-14bb-41d6-a0b9-7cbc5e517cb3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:26.428996 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bd99f-3352-4688-bdfb-79627e20322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:26.429821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bd99f-3352-4688-bdfb-79627e20322c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:26.430107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bd99f-3352-4688-bdfb-79627e20322c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:26.430387 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bd99f-3352-4688-bdfb-79627e20322c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:26.438445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bd99f-3352-4688-bdfb-79627e20322c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:26.439901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bd99f-3352-4688-bdfb-79627e20322c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:26.449240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-271bd99f-3352-4688-bdfb-79627e20322c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:26.456191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:26.457220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:26.458153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:26.458153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:26.458153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:26.458153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:26.458153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:26.458153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:26.458153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:26.458153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:26.458153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:54:26.458153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:26.462452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 462/930] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 23 12:54:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:26.463505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bd99f-3352-4688-bdfb-79627e20322c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:26.528915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897def4b-14bb-41d6-a0b9-7cbc5e517cb3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:26.575212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7d442-217b-47f5-878d-5ee5c48c0751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:26.576482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7d442-217b-47f5-878d-5ee5c48c0751 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:26.577523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7d442-217b-47f5-878d-5ee5c48c0751 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:26.577995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7d442-217b-47f5-878d-5ee5c48c0751 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:26.578282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bd99f-3352-4688-bdfb-79627e20322c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:26.579179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7d442-217b-47f5-878d-5ee5c48c0751 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:26.581918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7d442-217b-47f5-878d-5ee5c48c0751 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:26.610952 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:26.615903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b90da-ea3b-4a8e-bf25-1a6e6bdfb139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:26.616591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b90da-ea3b-4a8e-bf25-1a6e6bdfb139 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:26.616882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b90da-ea3b-4a8e-bf25-1a6e6bdfb139 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:26.617215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b90da-ea3b-4a8e-bf25-1a6e6bdfb139 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:26.618101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b90da-ea3b-4a8e-bf25-1a6e6bdfb139 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:26.618419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b90da-ea3b-4a8e-bf25-1a6e6bdfb139 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:26.619841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b90da-ea3b-4a8e-bf25-1a6e6bdfb139 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:26.642323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 463/931] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jun 23 12:54:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:26.643374 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b90da-ea3b-4a8e-bf25-1a6e6bdfb139 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:26.697007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 469/932] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 23 12:54:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:54:26.752202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b90da-ea3b-4a8e-bf25-1a6e6bdfb139 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:26.798831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea0d2a-3a28-424b-bfa9-2af2a8dedaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:26.800065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea0d2a-3a28-424b-bfa9-2af2a8dedaee None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:26.800570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea0d2a-3a28-424b-bfa9-2af2a8dedaee None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:26.801184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea0d2a-3a28-424b-bfa9-2af2a8dedaee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:26.813366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea0d2a-3a28-424b-bfa9-2af2a8dedaee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:26.815268 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea0d2a-3a28-424b-bfa9-2af2a8dedaee None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-86ea0d2a-3a28-424b-bfa9-2af2a8dedaee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:26.834991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:26.836073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:26.837025 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:26.837025 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:26.837025 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:26.837025 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:26.839524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 464/933] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:26.846156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7d442-217b-47f5-878d-5ee5c48c0751 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:26.892884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98307ac2-84b7-419e-b93c-b7cd1ccd92e3 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:26.893712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98307ac2-84b7-419e-b93c-b7cd1ccd92e3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:26.893993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98307ac2-84b7-419e-b93c-b7cd1ccd92e3 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:26.895695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 465/934] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:54:26.900706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4047915-2914-4446-823a-b4a9b494d510 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:26.901106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4047915-2914-4446-823a-b4a9b494d510 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:26.901496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4047915-2914-4446-823a-b4a9b494d510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:26.922841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d4047915-2914-4446-823a-b4a9b494d510 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:26.924019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d4047915-2914-4446-823a-b4a9b494d510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:26.963794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:26.965006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:26.972745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7d442-217b-47f5-878d-5ee5c48c0751 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:27.004969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 466/935] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:27.023271 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bda4c3-8059-440a-a666-4df5632dd7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:27.024325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda4c3-8059-440a-a666-4df5632dd7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:27.024790 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda4c3-8059-440a-a666-4df5632dd7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:27.025242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda4c3-8059-440a-a666-4df5632dd7a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:27.026119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bda4c3-8059-440a-a666-4df5632dd7a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:27.026630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bda4c3-8059-440a-a666-4df5632dd7a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:27.028152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bda4c3-8059-440a-a666-4df5632dd7a0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:27.031710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4047915-2914-4446-823a-b4a9b494d510 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:27.043403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 470/936] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:27.049793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bda4c3-8059-440a-a666-4df5632dd7a0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:27.146190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4047915-2914-4446-823a-b4a9b494d510 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:27.158499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bda4c3-8059-440a-a666-4df5632dd7a0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:27.183084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16effff1-9523-40a9-8653-078e254c1608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:27.183898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16effff1-9523-40a9-8653-078e254c1608 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:27.184225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16effff1-9523-40a9-8653-078e254c1608 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:27.184455 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16effff1-9523-40a9-8653-078e254c1608 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:27.185162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16effff1-9523-40a9-8653-078e254c1608 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:27.186722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16effff1-9523-40a9-8653-078e254c1608 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:27.195019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500e047-65e7-44e7-b3ee-65e0aa210df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:27.196051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500e047-65e7-44e7-b3ee-65e0aa210df0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:27.196592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500e047-65e7-44e7-b3ee-65e0aa210df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:27.197175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500e047-65e7-44e7-b3ee-65e0aa210df0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-16effff1-9523-40a9-8653-078e254c1608 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:27.199174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:27.200147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:27.201058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:27.205871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 467/937] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 23 12:54:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:27.207070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16effff1-9523-40a9-8653-078e254c1608 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:27.209311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500e047-65e7-44e7-b3ee-65e0aa210df0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:27.210963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500e047-65e7-44e7-b3ee-65e0aa210df0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-6500e047-65e7-44e7-b3ee-65e0aa210df0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:27.226844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:27.227789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:27.229114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:27.229114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:27.229114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:27.229114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:27.229114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:27.229114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:27.229114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:27.229114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:27.236392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 471/938] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:27.237463 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500e047-65e7-44e7-b3ee-65e0aa210df0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:27.249642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:27.256892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:27.314946 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16effff1-9523-40a9-8653-078e254c1608 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:27.350560 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dcf64-05a5-4917-8533-d669accb162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:27.351232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dcf64-05a5-4917-8533-d669accb162a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:27.351565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dcf64-05a5-4917-8533-d669accb162a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:27.352107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dcf64-05a5-4917-8533-d669accb162a None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:27.352541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dcf64-05a5-4917-8533-d669accb162a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:27.352893 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dcf64-05a5-4917-8533-d669accb162a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:27.354268 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dcf64-05a5-4917-8533-d669accb162a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:27.356483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500e047-65e7-44e7-b3ee-65e0aa210df0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:27.364525 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 468/939] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 23 12:54:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:27.365819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dcf64-05a5-4917-8533-d669accb162a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:27.401963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed950ce8-7f77-4664-b950-f8a3719e345d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:27.402629 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed950ce8-7f77-4664-b950-f8a3719e345d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:27.402962 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed950ce8-7f77-4664-b950-f8a3719e345d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:27.403330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed950ce8-7f77-4664-b950-f8a3719e345d None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:27.404435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed950ce8-7f77-4664-b950-f8a3719e345d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:27.406221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed950ce8-7f77-4664-b950-f8a3719e345d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:27.407674 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed950ce8-7f77-4664-b950-f8a3719e345d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:27.428290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 472/940] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:27.429580 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed950ce8-7f77-4664-b950-f8a3719e345d None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:27.475678 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:27.481835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dcf64-05a5-4917-8533-d669accb162a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:27.525183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbea87-206b-4e0c-ab9d-4b56d1fa3e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:27.525855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbea87-206b-4e0c-ab9d-4b56d1fa3e28 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:27.526146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbea87-206b-4e0c-ab9d-4b56d1fa3e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:27.526427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbea87-206b-4e0c-ab9d-4b56d1fa3e28 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:27.527137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbea87-206b-4e0c-ab9d-4b56d1fa3e28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:27.527453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbea87-206b-4e0c-ab9d-4b56d1fa3e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:27.528856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbea87-206b-4e0c-ab9d-4b56d1fa3e28 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:27.538815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:27.540093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 469/941] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 23 12:54:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:27.541252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbea87-206b-4e0c-ab9d-4b56d1fa3e28 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:27.570132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed950ce8-7f77-4664-b950-f8a3719e345d None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:27.618096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ccfae-62d5-4dda-8891-13f8a1ef1089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:27.619370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ccfae-62d5-4dda-8891-13f8a1ef1089 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:27.619868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ccfae-62d5-4dda-8891-13f8a1ef1089 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:27.620353 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ccfae-62d5-4dda-8891-13f8a1ef1089 None admin] PATH_INFO: `/v3/projects/311787f32b54485682be669bca9998f8/users/09e74199a07b481e837185c93b7c6455/roles/442af245d352472aa06e68c06a06a576` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:27.623814 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ccfae-62d5-4dda-8891-13f8a1ef1089 None admin] RBAC: Authorizing `identity:create_grant(project_id=311787f32b54485682be669bca9998f8, user_id=09e74199a07b481e837185c93b7c6455, role_id=442af245d352472aa06e68c06a06a576)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:27.626200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ccfae-62d5-4dda-8891-13f8a1ef1089 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:27.647277 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbea87-206b-4e0c-ab9d-4b56d1fa3e28 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:27.682310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2077fcb-89c8-443e-a7df-c7f33ab0dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:27.682973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2077fcb-89c8-443e-a7df-c7f33ab0dc46 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:27.683260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2077fcb-89c8-443e-a7df-c7f33ab0dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:27.683546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2077fcb-89c8-443e-a7df-c7f33ab0dc46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:27.684332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2077fcb-89c8-443e-a7df-c7f33ab0dc46 None admin] RBAC: Adding query filter params (interface=public, service_id=0ebd262fad144ccaafaa90a2518af7b9, region_id=RegionOne) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:27.684649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2077fcb-89c8-443e-a7df-c7f33ab0dc46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:27.686628 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2077fcb-89c8-443e-a7df-c7f33ab0dc46 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:27.691960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 470/942] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 23 12:54:27 2022] GET /identity/v3/endpoints?service_id=0ebd262fad144ccaafaa90a2518af7b9&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:27.697348 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2077fcb-89c8-443e-a7df-c7f33ab0dc46 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:27.704004 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 473/943] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:54:27 2022] PUT /identity/v3/projects/311787f32b54485682be669bca9998f8/users/09e74199a07b481e837185c93b7c6455/roles/442af245d352472aa06e68c06a06a576 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:54:27.729392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:27.814491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2077fcb-89c8-443e-a7df-c7f33ab0dc46 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:27.852583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd0d73-c726-4a2e-bb2e-8ab46a625356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:27.853220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd0d73-c726-4a2e-bb2e-8ab46a625356 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:27.853510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd0d73-c726-4a2e-bb2e-8ab46a625356 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:27.853845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd0d73-c726-4a2e-bb2e-8ab46a625356 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:27.854615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd0d73-c726-4a2e-bb2e-8ab46a625356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:27.856062 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd0d73-c726-4a2e-bb2e-8ab46a625356 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:27.867273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 471/944] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 23 12:54:27 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:54:27.925146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e32bfa-b770-4d52-bd97-538a31e9d2dd None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:27.925482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e32bfa-b770-4d52-bd97-538a31e9d2dd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:27.925729 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e32bfa-b770-4d52-bd97-538a31e9d2dd None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:27.927343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 474/945] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:27.933355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ec27d-d90b-47f2-98a2-9b7aa142b441 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:27.933677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ec27d-d90b-47f2-98a2-9b7aa142b441 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:27.933982 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ec27d-d90b-47f2-98a2-9b7aa142b441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:27.953388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-019ec27d-d90b-47f2-98a2-9b7aa142b441 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:27.955092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-019ec27d-d90b-47f2-98a2-9b7aa142b441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:28.032134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 472/946] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:28.056760 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e32bfa-b770-4d52-bd97-538a31e9d2dd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:28.173843 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e32bfa-b770-4d52-bd97-538a31e9d2dd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:28.209432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582e176-b9cf-4165-b08b-2dd3bb115a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:28.210231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582e176-b9cf-4165-b08b-2dd3bb115a72 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:28.210513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582e176-b9cf-4165-b08b-2dd3bb115a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:28.210795 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582e176-b9cf-4165-b08b-2dd3bb115a72 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:28.211448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582e176-b9cf-4165-b08b-2dd3bb115a72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:28.212896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582e176-b9cf-4165-b08b-2dd3bb115a72 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:28.215669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-e582e176-b9cf-4165-b08b-2dd3bb115a72 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:28.226655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:28.227686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:28.228532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 475/947] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:28.236621 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ec27d-d90b-47f2-98a2-9b7aa142b441 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:28.256090 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:28.347207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ec27d-d90b-47f2-98a2-9b7aa142b441 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:28.384027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39156e9-f5b6-4593-9866-9b071ebef29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:28.384804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39156e9-f5b6-4593-9866-9b071ebef29c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:28.385007 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39156e9-f5b6-4593-9866-9b071ebef29c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:28.385293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39156e9-f5b6-4593-9866-9b071ebef29c None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:28.386009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39156e9-f5b6-4593-9866-9b071ebef29c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:28.386320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39156e9-f5b6-4593-9866-9b071ebef29c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:28.387695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39156e9-f5b6-4593-9866-9b071ebef29c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:28.392853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 473/948] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:28.398674 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582e176-b9cf-4165-b08b-2dd3bb115a72 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:28.507718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582e176-b9cf-4165-b08b-2dd3bb115a72 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:28.542305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19495c0c-0442-4ada-bb8b-2fc998ead39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:28.542977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19495c0c-0442-4ada-bb8b-2fc998ead39f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:28.543264 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19495c0c-0442-4ada-bb8b-2fc998ead39f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:28.543548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19495c0c-0442-4ada-bb8b-2fc998ead39f None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:28.544258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19495c0c-0442-4ada-bb8b-2fc998ead39f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:28.544571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19495c0c-0442-4ada-bb8b-2fc998ead39f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:28.546492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19495c0c-0442-4ada-bb8b-2fc998ead39f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:28.551727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 476/949] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:28.853391 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5d6c9-f9f4-489a-a3c6-afc00a0f6fd9 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:28.853566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5d6c9-f9f4-489a-a3c6-afc00a0f6fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:28.853848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5d6c9-f9f4-489a-a3c6-afc00a0f6fd9 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:28.855475 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 474/950] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:28.860620 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb108d-b11b-45ed-b6f1-bd62cff1d827 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:28.860945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb108d-b11b-45ed-b6f1-bd62cff1d827 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:28.861227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb108d-b11b-45ed-b6f1-bd62cff1d827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:28.878570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-92eb108d-b11b-45ed-b6f1-bd62cff1d827 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:28.879757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-92eb108d-b11b-45ed-b6f1-bd62cff1d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:28.947956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:28.957376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 477/951] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:28.980246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5d6c9-f9f4-489a-a3c6-afc00a0f6fd9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:29.069053 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:29.089227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5d6c9-f9f4-489a-a3c6-afc00a0f6fd9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:29.124416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02393fc2-e85c-4093-980b-88d80a15fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:29.125032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02393fc2-e85c-4093-980b-88d80a15fcd8 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:29.125317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02393fc2-e85c-4093-980b-88d80a15fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:29.125592 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02393fc2-e85c-4093-980b-88d80a15fcd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:29.126295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02393fc2-e85c-4093-980b-88d80a15fcd8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:29.127729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02393fc2-e85c-4093-980b-88d80a15fcd8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:29.129123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: WARNING keystone.server.flask.common [None req-02393fc2-e85c-4093-980b-88d80a15fcd8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 12:54:29.177503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.sql.core [None req-02393fc2-e85c-4093-980b-88d80a15fcd8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 12:54:29.177503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 12:54:29.177503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [parameters: {'id': 'd514974dfc1446f98d041a9dd6006946', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 12:54:29.177503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80258) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-02393fc2-e85c-4093-980b-88d80a15fcd8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d514974dfc1446f98d041a9dd6006946.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d514974dfc1446f98d041a9dd6006946. Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application conn.query(q) Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 12:54:29.194660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result.read() Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 12:54:29.195507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application next(self.gen) Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application yield resource Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application next(self.gen) Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise self.value Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application session.commit() Jun 23 12:54:29.196489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.session.flush() Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application compat.raise_( Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 12:54:29.197456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 12:54:29.198371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application conn.query(q) Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result.read() Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 12:54:29.199176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [parameters: {'id': 'd514974dfc1446f98d041a9dd6006946', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:29.200044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:29.201245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:29.202881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:29.202881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 12:54:29.202881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 12:54:29.202881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:29.202881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:29.202881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 12:54:29.202881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 12:54:29.202881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d514974dfc1446f98d041a9dd6006946. Jun 23 12:54:29.202881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:29.202881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 475/952] 10.222.0.33 () {60 vars in 1140 bytes} [Thu Jun 23 12:54:28 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:29.208685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb108d-b11b-45ed-b6f1-bd62cff1d827 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:29.314546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb108d-b11b-45ed-b6f1-bd62cff1d827 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:29.352356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b81278-c782-49ef-a697-1bf4c8400092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:29.353185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b81278-c782-49ef-a697-1bf4c8400092 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:29.353473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b81278-c782-49ef-a697-1bf4c8400092 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:29.353753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b81278-c782-49ef-a697-1bf4c8400092 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:29.361246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b81278-c782-49ef-a697-1bf4c8400092 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:29.362677 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b81278-c782-49ef-a697-1bf4c8400092 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-86b81278-c782-49ef-a697-1bf4c8400092 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:29.377132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:29.379228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:29.381416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:29.381416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:29.381416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:29.381416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:29.381416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:29.381416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:29.381416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:29.381416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:29.381416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 478/953] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:29.390056 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02393fc2-e85c-4093-980b-88d80a15fcd8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:29.492858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02393fc2-e85c-4093-980b-88d80a15fcd8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:29.527350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c25235-e5f6-4fe6-8106-51e4d89e2f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:29.528352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c25235-e5f6-4fe6-8106-51e4d89e2f5a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:29.528976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c25235-e5f6-4fe6-8106-51e4d89e2f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:29.529487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c25235-e5f6-4fe6-8106-51e4d89e2f5a None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:29.531000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c25235-e5f6-4fe6-8106-51e4d89e2f5a None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:29.531533 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c25235-e5f6-4fe6-8106-51e4d89e2f5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:29.533428 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c25235-e5f6-4fe6-8106-51e4d89e2f5a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:29.544350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:29.554505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 476/954] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:29.905675 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d6570-df6c-4191-95e0-cc29feaa0f3b None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:29.906199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d6570-df6c-4191-95e0-cc29feaa0f3b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:29.906468 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d6570-df6c-4191-95e0-cc29feaa0f3b None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:29.908221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 479/955] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:29.913691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aa2ac-d741-43f4-8133-9bf36927df8c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:29.914096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aa2ac-d741-43f4-8133-9bf36927df8c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:29.914480 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aa2ac-d741-43f4-8133-9bf36927df8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:29.932238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3b1aa2ac-d741-43f4-8133-9bf36927df8c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:29.933806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3b1aa2ac-d741-43f4-8133-9bf36927df8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:30.005566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 477/956] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:30.026115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d6570-df6c-4191-95e0-cc29feaa0f3b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:30.061500 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79be35-527c-4248-a276-f48ac3c2105a None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:30.061799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79be35-527c-4248-a276-f48ac3c2105a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:30.062127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79be35-527c-4248-a276-f48ac3c2105a None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:30.063802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 478/957] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:30.068843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c382b-4f29-4a51-930f-b239c950313f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:30.069133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c382b-4f29-4a51-930f-b239c950313f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:30.069416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c382b-4f29-4a51-930f-b239c950313f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:30.086273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9b4c382b-4f29-4a51-930f-b239c950313f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:30.087482 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9b4c382b-4f29-4a51-930f-b239c950313f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:30.087810 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:30.136240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d6570-df6c-4191-95e0-cc29feaa0f3b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:30.172893 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 479/958] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:30.178929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028615e-c28a-43ff-9d4c-7acb05022a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:30.179808 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028615e-c28a-43ff-9d4c-7acb05022a60 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:30.180093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028615e-c28a-43ff-9d4c-7acb05022a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:30.180375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028615e-c28a-43ff-9d4c-7acb05022a60 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:30.191779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028615e-c28a-43ff-9d4c-7acb05022a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:30.196027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c382b-4f29-4a51-930f-b239c950313f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-0028615e-c28a-43ff-9d4c-7acb05022a60 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:30.202027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:30.203026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:30.203853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:30.203853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:30.203853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:30.203853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:30.203853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:30.203853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:30.203853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:30.203853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:30.203853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:30.203853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:30.203853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:54:30.203853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:30.208199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 480/959] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jun 23 12:54:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:30.209467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028615e-c28a-43ff-9d4c-7acb05022a60 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:30.289061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:30.305343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c382b-4f29-4a51-930f-b239c950313f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:30.332858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028615e-c28a-43ff-9d4c-7acb05022a60 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:30.350119 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dbbc9-09b6-47e1-a7ab-1e0ed25d0bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:30.351251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:30.352100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dbbc9-09b6-47e1-a7ab-1e0ed25d0bbe None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:30.352756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dbbc9-09b6-47e1-a7ab-1e0ed25d0bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:30.353530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dbbc9-09b6-47e1-a7ab-1e0ed25d0bbe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:30.354348 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dbbc9-09b6-47e1-a7ab-1e0ed25d0bbe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:30.356689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dbbc9-09b6-47e1-a7ab-1e0ed25d0bbe None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:30.372279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3508f2-cd88-470f-b4ea-ba45d619adf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-4a1dbbc9-09b6-47e1-a7ab-1e0ed25d0bbe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:30.372907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:30.374495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:30.375370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:30.376123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3508f2-cd88-470f-b4ea-ba45d619adf8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:30.376123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3508f2-cd88-470f-b4ea-ba45d619adf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:30.376123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3508f2-cd88-470f-b4ea-ba45d619adf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:30.376123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3508f2-cd88-470f-b4ea-ba45d619adf8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:30.376123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3508f2-cd88-470f-b4ea-ba45d619adf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:30.376511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3508f2-cd88-470f-b4ea-ba45d619adf8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:30.383084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 480/960] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 23 12:54:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:30.383801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dbbc9-09b6-47e1-a7ab-1e0ed25d0bbe None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:30.397061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 481/961] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 23 12:54:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:30.398390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3508f2-cd88-470f-b4ea-ba45d619adf8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:30.502875 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3508f2-cd88-470f-b4ea-ba45d619adf8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:30.509519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dbbc9-09b6-47e1-a7ab-1e0ed25d0bbe None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:30.539936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4988d0-39b2-4a5c-b466-699268151fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:30.540750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4988d0-39b2-4a5c-b466-699268151fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:30.541023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:30.541130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4988d0-39b2-4a5c-b466-699268151fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:30.541296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4988d0-39b2-4a5c-b466-699268151fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:30.552045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4988d0-39b2-4a5c-b466-699268151fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:30.553536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4988d0-39b2-4a5c-b466-699268151fd8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:30.557261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932fc89-1a23-4ead-a8fd-e6197e93809c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:30.558161 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fc89-1a23-4ead-a8fd-e6197e93809c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:30.558647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fc89-1a23-4ead-a8fd-e6197e93809c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:30.559149 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fc89-1a23-4ead-a8fd-e6197e93809c None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:30.560051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932fc89-1a23-4ead-a8fd-e6197e93809c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:30.561608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932fc89-1a23-4ead-a8fd-e6197e93809c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:30.563680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932fc89-1a23-4ead-a8fd-e6197e93809c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-2e4988d0-39b2-4a5c-b466-699268151fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:30.573603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:30.574513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:30.575399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:30.575399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:30.575399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:30.575399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:30.576315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 481/963] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 23 12:54:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:30.577914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932fc89-1a23-4ead-a8fd-e6197e93809c None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:30.579839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 482/963] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:30.581084 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4988d0-39b2-4a5c-b466-699268151fd8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:30.614401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:30.691642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932fc89-1a23-4ead-a8fd-e6197e93809c None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:30.707448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4988d0-39b2-4a5c-b466-699268151fd8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:30.731404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a869c-9672-440d-b857-ec171d41f855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:30.732523 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a869c-9672-440d-b857-ec171d41f855 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:30.733398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a869c-9672-440d-b857-ec171d41f855 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:30.733948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a869c-9672-440d-b857-ec171d41f855 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:30.734665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a869c-9672-440d-b857-ec171d41f855 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:30.735168 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a869c-9672-440d-b857-ec171d41f855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:30.737178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a869c-9672-440d-b857-ec171d41f855 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:30.750138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922466c-a053-410a-9892-5b777b35e97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:30.750359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 482/964] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 23 12:54:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:30.750456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922466c-a053-410a-9892-5b777b35e97e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:30.750456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922466c-a053-410a-9892-5b777b35e97e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:30.750456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922466c-a053-410a-9892-5b777b35e97e None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:30.750724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064519b-d4a6-4c7b-860e-22ddb7073b9b None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:30.750724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064519b-d4a6-4c7b-860e-22ddb7073b9b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:30.750877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922466c-a053-410a-9892-5b777b35e97e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:30.750958 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064519b-d4a6-4c7b-860e-22ddb7073b9b None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:30.751039 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922466c-a053-410a-9892-5b777b35e97e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:30.751128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 483/965] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:30.751210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922466c-a053-410a-9892-5b777b35e97e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:30.758450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064519b-d4a6-4c7b-860e-22ddb7073b9b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:30.768455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 483/966] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:30.768455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41096f82-ee8d-4e3c-9807-28aa54be3bb5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:30.768455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41096f82-ee8d-4e3c-9807-28aa54be3bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:30.768455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41096f82-ee8d-4e3c-9807-28aa54be3bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:30.785325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-41096f82-ee8d-4e3c-9807-28aa54be3bb5 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:30.786509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-41096f82-ee8d-4e3c-9807-28aa54be3bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:30.811768 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:30.857112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 484/967] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:30.858339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41096f82-ee8d-4e3c-9807-28aa54be3bb5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:30.869782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064519b-d4a6-4c7b-860e-22ddb7073b9b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:30.887206 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:30.907153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89a28b-6c03-47c6-b539-237d792adbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:30.907827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89a28b-6c03-47c6-b539-237d792adbce None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:30.908113 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89a28b-6c03-47c6-b539-237d792adbce None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:30.908392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89a28b-6c03-47c6-b539-237d792adbce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:30.909165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89a28b-6c03-47c6-b539-237d792adbce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:30.910569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89a28b-6c03-47c6-b539-237d792adbce None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:30.967822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41096f82-ee8d-4e3c-9807-28aa54be3bb5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:30.983777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 484/968] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 23 12:54:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:54:30.984822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89a28b-6c03-47c6-b539-237d792adbce None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:31.026823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd399fa-0b45-4ee3-a4d3-4d6019c51c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:31.028630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd399fa-0b45-4ee3-a4d3-4d6019c51c73 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:31.029099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd399fa-0b45-4ee3-a4d3-4d6019c51c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:31.030272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd399fa-0b45-4ee3-a4d3-4d6019c51c73 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:31.044956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd399fa-0b45-4ee3-a4d3-4d6019c51c73 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:31.047743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd399fa-0b45-4ee3-a4d3-4d6019c51c73 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-bfd399fa-0b45-4ee3-a4d3-4d6019c51c73 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:31.069254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:31.070492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:31.071785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:31.071785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:31.071785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:31.071785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:31.071785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:31.071785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:31.071785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:31.071785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:31.071785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:54:31.071785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:31.080849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 485/969] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 23 12:54:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:31.081533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd399fa-0b45-4ee3-a4d3-4d6019c51c73 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:31.133862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89a28b-6c03-47c6-b539-237d792adbce None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:31.145101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:31.169418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:31.185172 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d094c2-612e-4c14-a97b-e458c2e28dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:31.186367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d094c2-612e-4c14-a97b-e458c2e28dbf None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:31.186997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d094c2-612e-4c14-a97b-e458c2e28dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:31.187109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d094c2-612e-4c14-a97b-e458c2e28dbf None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:31.187816 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d094c2-612e-4c14-a97b-e458c2e28dbf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:31.189244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d094c2-612e-4c14-a97b-e458c2e28dbf None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:31.199259 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd399fa-0b45-4ee3-a4d3-4d6019c51c73 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:31.234520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715aee1-2686-4cb1-adde-552a3c2daea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:31.235201 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715aee1-2686-4cb1-adde-552a3c2daea1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:31.235545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715aee1-2686-4cb1-adde-552a3c2daea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:31.235827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715aee1-2686-4cb1-adde-552a3c2daea1 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:31.236721 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715aee1-2686-4cb1-adde-552a3c2daea1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:31.237039 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715aee1-2686-4cb1-adde-552a3c2daea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:31.238458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715aee1-2686-4cb1-adde-552a3c2daea1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:31.257576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 486/970] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jun 23 12:54:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:31.262888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715aee1-2686-4cb1-adde-552a3c2daea1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:31.301824 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 485/971] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:54:30 2022] POST /identity/v3/services => generated 242 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:54:31.381579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715aee1-2686-4cb1-adde-552a3c2daea1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:31.415667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:31.430125 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccb993-c4cc-41be-a498-10964351fab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:31.431412 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccb993-c4cc-41be-a498-10964351fab9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:31.431999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccb993-c4cc-41be-a498-10964351fab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:31.432487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccb993-c4cc-41be-a498-10964351fab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:31.506610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccb993-c4cc-41be-a498-10964351fab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:31.508082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccb993-c4cc-41be-a498-10964351fab9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:31.607573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 487/972] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:31 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 12:54:31.614209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d094c2-612e-4c14-a97b-e458c2e28dbf None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:31.698218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fcb2e-1755-4ba7-8141-9e647c3544b8 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:31.698532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fcb2e-1755-4ba7-8141-9e647c3544b8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:31.698791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fcb2e-1755-4ba7-8141-9e647c3544b8 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:31.700425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 488/973] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:31.707064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45cd26-50de-49d2-bddb-9e5208eebbc0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:31.707618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45cd26-50de-49d2-bddb-9e5208eebbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:31.708093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45cd26-50de-49d2-bddb-9e5208eebbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:31.722912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d094c2-612e-4c14-a97b-e458c2e28dbf None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:31.729734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ad45cd26-50de-49d2-bddb-9e5208eebbc0 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:31.731687 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ad45cd26-50de-49d2-bddb-9e5208eebbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:31.765373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:31.769543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080c00b-4a99-4e5c-a327-484999b7a255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:31.771856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080c00b-4a99-4e5c-a327-484999b7a255 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:31.772337 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080c00b-4a99-4e5c-a327-484999b7a255 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:31.772835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080c00b-4a99-4e5c-a327-484999b7a255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:31.787666 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080c00b-4a99-4e5c-a327-484999b7a255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:31.789409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080c00b-4a99-4e5c-a327-484999b7a255 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:31.810787 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 489/974] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-3080c00b-4a99-4e5c-a327-484999b7a255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:31.814174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:31.815032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:31.815924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:31.815924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:31.815924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:31.815924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:31.815924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 486/975] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:31.820899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45cd26-50de-49d2-bddb-9e5208eebbc0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:31.838974 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080c00b-4a99-4e5c-a327-484999b7a255 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:31.871105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:31.934313 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45cd26-50de-49d2-bddb-9e5208eebbc0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:31.972464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddec90-f830-4459-8601-880f74c2cd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:31.973943 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddec90-f830-4459-8601-880f74c2cd54 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:31.974454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddec90-f830-4459-8601-880f74c2cd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:31.974931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddec90-f830-4459-8601-880f74c2cd54 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:31.975234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080c00b-4a99-4e5c-a327-484999b7a255 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:31.976081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddec90-f830-4459-8601-880f74c2cd54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:31.976724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddec90-f830-4459-8601-880f74c2cd54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:31.978420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddec90-f830-4459-8601-880f74c2cd54 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:31.995384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 490/976] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:31.996686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddec90-f830-4459-8601-880f74c2cd54 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:32.015682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7f535-86b7-4f84-a63a-282d2e76678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:32.016623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7f535-86b7-4f84-a63a-282d2e76678e None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:32.016936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7f535-86b7-4f84-a63a-282d2e76678e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:32.017207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7f535-86b7-4f84-a63a-282d2e76678e None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:32.017901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7f535-86b7-4f84-a63a-282d2e76678e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:32.019910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:32.020556 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7f535-86b7-4f84-a63a-282d2e76678e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:32.089080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.sql.core [None req-25d7f535-86b7-4f84-a63a-282d2e76678e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 12:54:32.089080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 12:54:32.089080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [parameters: {'user_id': 'a07ac921b6894391b3a7f851526e395a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 12:54:32.089080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80258) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-25d7f535-86b7-4f84-a63a-282d2e76678e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application conn.query(q) Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result.read() Jun 23 12:54:32.097368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 12:54:32.105392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application next(self.gen) Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application yield resource Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application next(self.gen) Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise self.value Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application session.commit() Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 12:54:32.106355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.session.flush() Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application compat.raise_( Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 12:54:32.107253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 12:54:32.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application conn.query(q) Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application result.read() Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 12:54:32.110572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a07ac921b6894391b3a7f851526e395a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:32.112710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 12:54:32.115736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 12:54:32.117922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 12:54:32.117922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 12:54:32.117922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 12:54:32.117922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 12:54:32.117922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 12:54:32.117922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:32.117922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 487/977] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jun 23 12:54:31 2022] POST /identity/v3/users => generated 160 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:32.117922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7f535-86b7-4f84-a63a-282d2e76678e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:32.119148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddec90-f830-4459-8601-880f74c2cd54 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:32.154998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e8601-bd4e-49d9-8901-74953e250dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:32.155719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e8601-bd4e-49d9-8901-74953e250dba None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:32.156006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e8601-bd4e-49d9-8901-74953e250dba None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:32.156287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e8601-bd4e-49d9-8901-74953e250dba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:32.163608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e8601-bd4e-49d9-8901-74953e250dba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:32.165181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e8601-bd4e-49d9-8901-74953e250dba None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-eb1e8601-bd4e-49d9-8901-74953e250dba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:32.179974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:32.182098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:32.184291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:32.184291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:32.184291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:32.184291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:32.184291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:32.184291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:32.184291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:32.184291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:32.190316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 491/978] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:32.190316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e8601-bd4e-49d9-8901-74953e250dba None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:32.201980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:32.222968 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7f535-86b7-4f84-a63a-282d2e76678e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:32.259145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d6128-a286-458c-85fe-67217c79470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:32.260057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d6128-a286-458c-85fe-67217c79470b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:32.260401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d6128-a286-458c-85fe-67217c79470b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:32.260829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d6128-a286-458c-85fe-67217c79470b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:32.269537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d6128-a286-458c-85fe-67217c79470b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:32.271693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d6128-a286-458c-85fe-67217c79470b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-d92d6128-a286-458c-85fe-67217c79470b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:32.286770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:32.289573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:32.291231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:32.291231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:32.291231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:32.291231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:32.291231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:32.291231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:32.291231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:32.291231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:32.291231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:54:32.291231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:32.292198 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:32.295711 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 488/979] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:54:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:32.295711 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d6128-a286-458c-85fe-67217c79470b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:32.302049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e8601-bd4e-49d9-8901-74953e250dba None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:32.332436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471ab14-c6af-459a-bbb6-5421de0cfabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:32.333184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471ab14-c6af-459a-bbb6-5421de0cfabc None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:32.333475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471ab14-c6af-459a-bbb6-5421de0cfabc None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:32.333765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471ab14-c6af-459a-bbb6-5421de0cfabc None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:32.334659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471ab14-c6af-459a-bbb6-5421de0cfabc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:32.334917 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471ab14-c6af-459a-bbb6-5421de0cfabc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:32.336474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471ab14-c6af-459a-bbb6-5421de0cfabc None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:32.353976 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 492/980] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:32.355130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471ab14-c6af-459a-bbb6-5421de0cfabc None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:32.395866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d6128-a286-458c-85fe-67217c79470b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:32.431807 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fcf03-f165-4cba-b60c-cc5121a1d791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:32.432247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fcf03-f165-4cba-b60c-cc5121a1d791 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:32.432597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fcf03-f165-4cba-b60c-cc5121a1d791 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:32.433044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fcf03-f165-4cba-b60c-cc5121a1d791 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:32.434117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fcf03-f165-4cba-b60c-cc5121a1d791 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:32.434504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fcf03-f165-4cba-b60c-cc5121a1d791 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:32.436689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fcf03-f165-4cba-b60c-cc5121a1d791 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:32.460350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:32.463697 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471ab14-c6af-459a-bbb6-5421de0cfabc None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:32.479457 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 489/981] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 23 12:54:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:32.505572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180ee08-037d-47e5-a0bd-9322d9f4fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:32.506363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180ee08-037d-47e5-a0bd-9322d9f4fdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:32.506725 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180ee08-037d-47e5-a0bd-9322d9f4fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:32.507080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180ee08-037d-47e5-a0bd-9322d9f4fdc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:32.508021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180ee08-037d-47e5-a0bd-9322d9f4fdc0 None admin] RBAC: Adding query filter params (role.id=442af245d352472aa06e68c06a06a576, scope.project.id=311787f32b54485682be669bca9998f8, user.id=09e74199a07b481e837185c93b7c6455) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:32.508454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180ee08-037d-47e5-a0bd-9322d9f4fdc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:32.510127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180ee08-037d-47e5-a0bd-9322d9f4fdc0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:32.518683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 493/982] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:32 2022] GET /identity/v3/role_assignments?user.id=09e74199a07b481e837185c93b7c6455&scope.project.id=311787f32b54485682be669bca9998f8&role.id=442af245d352472aa06e68c06a06a576 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:33.176821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95c96c-9e5b-49f5-a5d4-af394fda1bef None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:33.177368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95c96c-9e5b-49f5-a5d4-af394fda1bef None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:33.177368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95c96c-9e5b-49f5-a5d4-af394fda1bef None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:33.178907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 490/983] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:33.183968 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a6f16-4d24-46d5-855a-d3e412b0ef14 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:33.184368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a6f16-4d24-46d5-855a-d3e412b0ef14 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:33.184538 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a6f16-4d24-46d5-855a-d3e412b0ef14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:33.189655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:33.201823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-746a6f16-4d24-46d5-855a-d3e412b0ef14 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:33.203000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-746a6f16-4d24-46d5-855a-d3e412b0ef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:33.269902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 494/984] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:33.293454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95c96c-9e5b-49f5-a5d4-af394fda1bef None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:33.394279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95c96c-9e5b-49f5-a5d4-af394fda1bef None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:33.424932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11de7f6-96e4-4f81-bf27-524b0c27a913 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:33.425315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11de7f6-96e4-4f81-bf27-524b0c27a913 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:33.425666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11de7f6-96e4-4f81-bf27-524b0c27a913 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:33.427114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 495/985] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:54:33.431886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25a517-cbef-4a2f-91b7-b86196712dda None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:33.432176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25a517-cbef-4a2f-91b7-b86196712dda None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:33.432456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25a517-cbef-4a2f-91b7-b86196712dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:33.432889 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cfe49-5ea6-450b-9f42-338d678d9075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:33.433888 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cfe49-5ea6-450b-9f42-338d678d9075 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:33.434367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cfe49-5ea6-450b-9f42-338d678d9075 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:33.434829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cfe49-5ea6-450b-9f42-338d678d9075 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:33.435653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cfe49-5ea6-450b-9f42-338d678d9075 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:33.437824 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cfe49-5ea6-450b-9f42-338d678d9075 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:33.449304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1f25a517-cbef-4a2f-91b7-b86196712dda None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-020cfe49-5ea6-450b-9f42-338d678d9075 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:33.450360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:33.452063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:33.453121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:33.454022 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1f25a517-cbef-4a2f-91b7-b86196712dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:33.455343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 491/986] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 23 12:54:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:33.461618 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cfe49-5ea6-450b-9f42-338d678d9075 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:33.520851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 496/987] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:33.530299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:33.543357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25a517-cbef-4a2f-91b7-b86196712dda None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:33.571341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cfe49-5ea6-450b-9f42-338d678d9075 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:33.605753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:33.606947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b369f20-62fd-459d-a512-066a12b2d721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:33.608189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b369f20-62fd-459d-a512-066a12b2d721 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:33.608497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b369f20-62fd-459d-a512-066a12b2d721 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:33.608811 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b369f20-62fd-459d-a512-066a12b2d721 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:33.609517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b369f20-62fd-459d-a512-066a12b2d721 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:33.609825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b369f20-62fd-459d-a512-066a12b2d721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:33.611188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b369f20-62fd-459d-a512-066a12b2d721 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:33.616286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 492/988] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 23 12:54:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:33.621952 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b369f20-62fd-459d-a512-066a12b2d721 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:33.653441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25a517-cbef-4a2f-91b7-b86196712dda None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:33.694105 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96657e-2ed8-43cc-88e8-08c6f87c2168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:33.695486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96657e-2ed8-43cc-88e8-08c6f87c2168 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:33.696159 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96657e-2ed8-43cc-88e8-08c6f87c2168 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:33.696589 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96657e-2ed8-43cc-88e8-08c6f87c2168 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:33.698273 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96657e-2ed8-43cc-88e8-08c6f87c2168 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:33.699827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96657e-2ed8-43cc-88e8-08c6f87c2168 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-0a96657e-2ed8-43cc-88e8-08c6f87c2168 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:33.715828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:33.717627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:54:33.718477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:33.719235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 497/989] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:33.724430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96657e-2ed8-43cc-88e8-08c6f87c2168 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:33.729545 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b369f20-62fd-459d-a512-066a12b2d721 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:33.758483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:33.770168 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad121f14-a1f8-4535-85a3-20999a77c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:33.770960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad121f14-a1f8-4535-85a3-20999a77c3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:33.771261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad121f14-a1f8-4535-85a3-20999a77c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:33.771809 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad121f14-a1f8-4535-85a3-20999a77c3a5 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:33.772518 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad121f14-a1f8-4535-85a3-20999a77c3a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:33.772878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad121f14-a1f8-4535-85a3-20999a77c3a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:33.774273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad121f14-a1f8-4535-85a3-20999a77c3a5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:33.779262 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 493/990] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 23 12:54:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:33.785577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad121f14-a1f8-4535-85a3-20999a77c3a5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:33.831355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96657e-2ed8-43cc-88e8-08c6f87c2168 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:33.857596 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:33.867516 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cf792-3efe-458e-9136-f021c670132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:33.868173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cf792-3efe-458e-9136-f021c670132a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:33.868455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cf792-3efe-458e-9136-f021c670132a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:33.868763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cf792-3efe-458e-9136-f021c670132a None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:33.869469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cf792-3efe-458e-9136-f021c670132a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:33.869805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cf792-3efe-458e-9136-f021c670132a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:33.871221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cf792-3efe-458e-9136-f021c670132a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:33.875895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 498/991] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:33.881543 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cf792-3efe-458e-9136-f021c670132a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:33.892685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad121f14-a1f8-4535-85a3-20999a77c3a5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:33.928724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f66217-8318-45a1-8e02-7b583de11d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:33.929616 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f66217-8318-45a1-8e02-7b583de11d24 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:33.930185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f66217-8318-45a1-8e02-7b583de11d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:33.930627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f66217-8318-45a1-8e02-7b583de11d24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:33.931666 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f66217-8318-45a1-8e02-7b583de11d24 None admin] RBAC: Adding query filter params (interface=admin, service_id=0ebd262fad144ccaafaa90a2518af7b9, region_id=RegionOne) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:33.932145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f66217-8318-45a1-8e02-7b583de11d24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:33.933809 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f66217-8318-45a1-8e02-7b583de11d24 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:33.947861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 494/992] 10.222.0.33 () {56 vars in 1249 bytes} [Thu Jun 23 12:54:33 2022] GET /identity/v3/endpoints?service_id=0ebd262fad144ccaafaa90a2518af7b9&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:33.948885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f66217-8318-45a1-8e02-7b583de11d24 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:33.982273 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cf792-3efe-458e-9136-f021c670132a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:34.006890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:34.017789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f72ddc-77fb-4149-9644-70a12ea67cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:34.018460 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f72ddc-77fb-4149-9644-70a12ea67cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:34.018746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f72ddc-77fb-4149-9644-70a12ea67cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:34.019021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f72ddc-77fb-4149-9644-70a12ea67cf9 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:34.019730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f72ddc-77fb-4149-9644-70a12ea67cf9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:34.020199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f72ddc-77fb-4149-9644-70a12ea67cf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:34.021663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f72ddc-77fb-4149-9644-70a12ea67cf9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:34.026549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 499/993] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:34.032758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f72ddc-77fb-4149-9644-70a12ea67cf9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:34.061056 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f66217-8318-45a1-8e02-7b583de11d24 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:34.090657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:34.104964 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e7b00-7b12-42d8-9629-46d177de3ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:34.106015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e7b00-7b12-42d8-9629-46d177de3ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:34.107189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e7b00-7b12-42d8-9629-46d177de3ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:34.107692 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e7b00-7b12-42d8-9629-46d177de3ac0 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:34.108530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e7b00-7b12-42d8-9629-46d177de3ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:34.110076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e7b00-7b12-42d8-9629-46d177de3ac0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:34.118945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 495/994] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 23 12:54:33 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:54:34.137823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f72ddc-77fb-4149-9644-70a12ea67cf9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:34.176177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ccf4a-6e52-4492-975c-abfea7059644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:34.176892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ccf4a-6e52-4492-975c-abfea7059644 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:34.177178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ccf4a-6e52-4492-975c-abfea7059644 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:34.177453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ccf4a-6e52-4492-975c-abfea7059644 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:34.178314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ccf4a-6e52-4492-975c-abfea7059644 None admin] RBAC: Adding query filter params (interface=public, service_id=541439c6c4f44dd4ae0841a52531d807, region_id=RegionOne) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:34.178673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ccf4a-6e52-4492-975c-abfea7059644 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:34.180116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ccf4a-6e52-4492-975c-abfea7059644 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:34.186946 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 500/995] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 23 12:54:34 2022] GET /identity/v3/endpoints?service_id=541439c6c4f44dd4ae0841a52531d807&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:34.192243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e7b00-7b12-42d8-9629-46d177de3ac0 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:34.299424 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e7b00-7b12-42d8-9629-46d177de3ac0 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:34.317757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:34.334914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193360d-a78f-4aff-998e-d53d2d2d052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:34.335588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193360d-a78f-4aff-998e-d53d2d2d052f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:34.335876 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193360d-a78f-4aff-998e-d53d2d2d052f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:34.336160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193360d-a78f-4aff-998e-d53d2d2d052f None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:34.336887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193360d-a78f-4aff-998e-d53d2d2d052f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:34.338260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193360d-a78f-4aff-998e-d53d2d2d052f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:34.352757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 496/996] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 23 12:54:34 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:54:34.597872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b95e3-73d0-485d-97d0-e004d59fc415 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:34.598220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b95e3-73d0-485d-97d0-e004d59fc415 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:34.598434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b95e3-73d0-485d-97d0-e004d59fc415 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:34.599963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 501/997] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:34.605010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e82781-d60b-48b7-908f-22e86501839e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:34.605307 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e82781-d60b-48b7-908f-22e86501839e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:34.605589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e82781-d60b-48b7-908f-22e86501839e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:34.623001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-40e82781-d60b-48b7-908f-22e86501839e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:34.625096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-40e82781-d60b-48b7-908f-22e86501839e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:34.694346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 497/998] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:34.716531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b95e3-73d0-485d-97d0-e004d59fc415 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:34.819293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b95e3-73d0-485d-97d0-e004d59fc415 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:34.837309 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:34.854396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d33c6-a743-4fad-b1cd-75cf18ba5520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:34.855112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d33c6-a743-4fad-b1cd-75cf18ba5520 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:34.855395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d33c6-a743-4fad-b1cd-75cf18ba5520 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:34.855667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d33c6-a743-4fad-b1cd-75cf18ba5520 None admin] PATH_INFO: `/v3/services/image` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:34.856312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d33c6-a743-4fad-b1cd-75cf18ba5520 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:34.857728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d33c6-a743-4fad-b1cd-75cf18ba5520 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-9a7d33c6-a743-4fad-b1cd-75cf18ba5520 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:34.869179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:34.870194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:54:34.871164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:34.872868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 502/999] 10.222.0.33 () {56 vars in 1105 bytes} [Thu Jun 23 12:54:34 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:34.876857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e82781-d60b-48b7-908f-22e86501839e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:34.974001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e82781-d60b-48b7-908f-22e86501839e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:34.987347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:35.008323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394b781-bf4b-4a3e-8b8e-85480257f8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:35.009013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b781-bf4b-4a3e-8b8e-85480257f8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:35.009299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b781-bf4b-4a3e-8b8e-85480257f8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:35.009573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b781-bf4b-4a3e-8b8e-85480257f8b3 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:35.010279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394b781-bf4b-4a3e-8b8e-85480257f8b3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:35.010589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394b781-bf4b-4a3e-8b8e-85480257f8b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:35.011947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394b781-bf4b-4a3e-8b8e-85480257f8b3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:35.018349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 498/1000] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:35.023177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d33c6-a743-4fad-b1cd-75cf18ba5520 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:35.131903 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d33c6-a743-4fad-b1cd-75cf18ba5520 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:35.166007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30c193-1af7-44fa-96be-307aa60ea75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:35.166926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30c193-1af7-44fa-96be-307aa60ea75a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:35.167390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30c193-1af7-44fa-96be-307aa60ea75a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:35.167845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30c193-1af7-44fa-96be-307aa60ea75a None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:35.168796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30c193-1af7-44fa-96be-307aa60ea75a None admin] RBAC: Adding query filter params (type=image) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:35.169282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30c193-1af7-44fa-96be-307aa60ea75a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:35.170860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30c193-1af7-44fa-96be-307aa60ea75a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:35.180687 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 503/1001] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:36.173857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aada1-7b24-4230-b50d-b8c9d1daa1cc None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:36.174378 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aada1-7b24-4230-b50d-b8c9d1daa1cc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:36.174456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aada1-7b24-4230-b50d-b8c9d1daa1cc None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:36.175858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 499/1002] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:36.180954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c3152-5d2f-4787-861c-dc41cdb482ae None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:36.181340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c3152-5d2f-4787-861c-dc41cdb482ae None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:36.181529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c3152-5d2f-4787-861c-dc41cdb482ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:36.197943 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b65c3152-5d2f-4787-861c-dc41cdb482ae None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:36.199122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b65c3152-5d2f-4787-861c-dc41cdb482ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:36.244516 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:36.271122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 504/1003] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:36.295527 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462aada1-7b24-4230-b50d-b8c9d1daa1cc None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:36.371236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9411db5-6462-4021-a122-80a77a79892e None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:36.371411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9411db5-6462-4021-a122-80a77a79892e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:36.371697 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9411db5-6462-4021-a122-80a77a79892e None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:36.373770 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 505/1004] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:54:36.378293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cf1dd-05fc-46a2-b0f4-c8039d5afad4 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:36.378579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cf1dd-05fc-46a2-b0f4-c8039d5afad4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:36.378856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cf1dd-05fc-46a2-b0f4-c8039d5afad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:36.395345 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-726cf1dd-05fc-46a2-b0f4-c8039d5afad4 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:36.396791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-726cf1dd-05fc-46a2-b0f4-c8039d5afad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:36.402849 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462aada1-7b24-4230-b50d-b8c9d1daa1cc None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:36.436943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaedbed-2835-4f4f-906e-725b70136221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:36.437750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaedbed-2835-4f4f-906e-725b70136221 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:36.438037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaedbed-2835-4f4f-906e-725b70136221 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:36.438320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaedbed-2835-4f4f-906e-725b70136221 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:36.438973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaedbed-2835-4f4f-906e-725b70136221 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:36.440336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaedbed-2835-4f4f-906e-725b70136221 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-7aaedbed-2835-4f4f-906e-725b70136221 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:36.452814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:36.453801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:36.454638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 500/1005] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 23 12:54:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:36.459778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaedbed-2835-4f4f-906e-725b70136221 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:36.465932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 506/1006] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:36.488212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cf1dd-05fc-46a2-b0f4-c8039d5afad4 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:36.501525 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:36.563529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaedbed-2835-4f4f-906e-725b70136221 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:36.590024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cf1dd-05fc-46a2-b0f4-c8039d5afad4 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:36.597813 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:36.601654 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974591ce-e29b-4b4a-aa22-85136cfbf8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:36.602519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974591ce-e29b-4b4a-aa22-85136cfbf8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:36.602948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974591ce-e29b-4b4a-aa22-85136cfbf8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:36.603384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974591ce-e29b-4b4a-aa22-85136cfbf8f4 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:36.604138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974591ce-e29b-4b4a-aa22-85136cfbf8f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:36.604455 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974591ce-e29b-4b4a-aa22-85136cfbf8f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:36.605844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974591ce-e29b-4b4a-aa22-85136cfbf8f4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:36.611341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 501/1007] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 23 12:54:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:36.616770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974591ce-e29b-4b4a-aa22-85136cfbf8f4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:36.626249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf824ce-8165-475e-babf-0186c902a7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:36.626972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf824ce-8165-475e-babf-0186c902a7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:36.627254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf824ce-8165-475e-babf-0186c902a7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:36.627526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf824ce-8165-475e-babf-0186c902a7c2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:36.628174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf824ce-8165-475e-babf-0186c902a7c2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:36.629640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf824ce-8165-475e-babf-0186c902a7c2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-bbf824ce-8165-475e-babf-0186c902a7c2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:36.641829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:36.643013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:54:36.644055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:36.646802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 507/1008] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:36.652481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf824ce-8165-475e-babf-0186c902a7c2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:36.731222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974591ce-e29b-4b4a-aa22-85136cfbf8f4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:36.735429 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:36.757285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf824ce-8165-475e-babf-0186c902a7c2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:36.767522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783af56d-4ebd-43a2-8a3a-597dfe0e5722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:36.768362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783af56d-4ebd-43a2-8a3a-597dfe0e5722 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:36.769040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783af56d-4ebd-43a2-8a3a-597dfe0e5722 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:36.769399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783af56d-4ebd-43a2-8a3a-597dfe0e5722 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:36.770346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783af56d-4ebd-43a2-8a3a-597dfe0e5722 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:36.771202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783af56d-4ebd-43a2-8a3a-597dfe0e5722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:36.772943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783af56d-4ebd-43a2-8a3a-597dfe0e5722 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:36.778046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 502/1009] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 23 12:54:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:36.785047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783af56d-4ebd-43a2-8a3a-597dfe0e5722 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:36.800963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782244e-0c0a-41e0-8981-8896ba0a1e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:36.801641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782244e-0c0a-41e0-8981-8896ba0a1e1e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:36.801928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782244e-0c0a-41e0-8981-8896ba0a1e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:36.802211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782244e-0c0a-41e0-8981-8896ba0a1e1e None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:36.802924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782244e-0c0a-41e0-8981-8896ba0a1e1e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:36.803234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782244e-0c0a-41e0-8981-8896ba0a1e1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:36.804627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782244e-0c0a-41e0-8981-8896ba0a1e1e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:36.809877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 508/1010] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:36.815274 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782244e-0c0a-41e0-8981-8896ba0a1e1e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:36.851860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:36.895200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783af56d-4ebd-43a2-8a3a-597dfe0e5722 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:36.925279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782244e-0c0a-41e0-8981-8896ba0a1e1e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:36.930379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584abb2-70ba-466b-b949-1baea7e063bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:36.931046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584abb2-70ba-466b-b949-1baea7e063bf None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:36.931335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584abb2-70ba-466b-b949-1baea7e063bf None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:36.931618 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584abb2-70ba-466b-b949-1baea7e063bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:36.932367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584abb2-70ba-466b-b949-1baea7e063bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:36.933818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584abb2-70ba-466b-b949-1baea7e063bf None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:36.960628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad88960-b17a-4a89-ae9a-8cb865072a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:36.961324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad88960-b17a-4a89-ae9a-8cb865072a0a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:36.961613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad88960-b17a-4a89-ae9a-8cb865072a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:36.962005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad88960-b17a-4a89-ae9a-8cb865072a0a None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:36.962718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad88960-b17a-4a89-ae9a-8cb865072a0a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:36.963032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad88960-b17a-4a89-ae9a-8cb865072a0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:36.964400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad88960-b17a-4a89-ae9a-8cb865072a0a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:36.970040 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 509/1011] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 23 12:54:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:36.975214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad88960-b17a-4a89-ae9a-8cb865072a0a None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:37.016594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 503/1012] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 23 12:54:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:54:37.084832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:37.089551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad88960-b17a-4a89-ae9a-8cb865072a0a None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:37.132991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9378909-309c-43e0-8804-24264ee5170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:37.133671 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9378909-309c-43e0-8804-24264ee5170f None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:37.133956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9378909-309c-43e0-8804-24264ee5170f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:37.134231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9378909-309c-43e0-8804-24264ee5170f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:37.134980 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9378909-309c-43e0-8804-24264ee5170f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:37.136374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9378909-309c-43e0-8804-24264ee5170f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:37.205331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e06714-e970-4833-9937-b0b5088f7241 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:37.205835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e06714-e970-4833-9937-b0b5088f7241 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:37.205835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e06714-e970-4833-9937-b0b5088f7241 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:37.207452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 504/1013] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:37.212407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab2d81-2d06-42e1-b7fe-13e747cdb7bb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:37.212770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab2d81-2d06-42e1-b7fe-13e747cdb7bb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:37.213008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab2d81-2d06-42e1-b7fe-13e747cdb7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:37.214389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 510/1014] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 23 12:54:36 2022] POST /identity/v3/endpoints => generated 334 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:54:37.232104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f3ab2d81-2d06-42e1-b7fe-13e747cdb7bb None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:37.233547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f3ab2d81-2d06-42e1-b7fe-13e747cdb7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:37.260736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:37.318524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 505/1015] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:37 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:37.342762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9378909-309c-43e0-8804-24264ee5170f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:37.448450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9378909-309c-43e0-8804-24264ee5170f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:37.483426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093531c-4f89-474a-ac52-907b9e3e99cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:37.484104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093531c-4f89-474a-ac52-907b9e3e99cd None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:37.484383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093531c-4f89-474a-ac52-907b9e3e99cd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:37.484725 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093531c-4f89-474a-ac52-907b9e3e99cd None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:37.485415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093531c-4f89-474a-ac52-907b9e3e99cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:37.486772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093531c-4f89-474a-ac52-907b9e3e99cd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:37.587325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 511/1016] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:54:37 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:54:39.099637 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9767425-a912-48c2-b7d1-498d6a58c6f2 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:39.100122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9767425-a912-48c2-b7d1-498d6a58c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:39.100198 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9767425-a912-48c2-b7d1-498d6a58c6f2 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:39.101653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 506/1017] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:39.106991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538621b5-2bd3-47ca-82df-346ff575253c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:39.107914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538621b5-2bd3-47ca-82df-346ff575253c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:39.108088 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538621b5-2bd3-47ca-82df-346ff575253c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:39.125309 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-538621b5-2bd3-47ca-82df-346ff575253c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:39.126520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-538621b5-2bd3-47ca-82df-346ff575253c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:39.130055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:39.201790 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 512/1018] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:39.225798 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9767425-a912-48c2-b7d1-498d6a58c6f2 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:39.325070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9767425-a912-48c2-b7d1-498d6a58c6f2 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:39.350925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d693c4f-8715-4525-ba64-aa7d7016a59b None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:39.351173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d693c4f-8715-4525-ba64-aa7d7016a59b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:39.351439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d693c4f-8715-4525-ba64-aa7d7016a59b None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:39.352809 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 513/1019] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:54:39.357552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9735d-0c6e-4d3b-9fcc-7b968b320a6a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:39.357847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9735d-0c6e-4d3b-9fcc-7b968b320a6a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:39.358132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9735d-0c6e-4d3b-9fcc-7b968b320a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:39.359566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7abc9-87ce-4b95-b7fb-2f35d5493c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:39.360388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7abc9-87ce-4b95-b7fb-2f35d5493c47 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:39.360686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7abc9-87ce-4b95-b7fb-2f35d5493c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:39.360983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7abc9-87ce-4b95-b7fb-2f35d5493c47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:39.362145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7abc9-87ce-4b95-b7fb-2f35d5493c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:39.363598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7abc9-87ce-4b95-b7fb-2f35d5493c47 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:39.365436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 507/1020] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:39.370830 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7abc9-87ce-4b95-b7fb-2f35d5493c47 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:39.375341 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1cc9735d-0c6e-4d3b-9fcc-7b968b320a6a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:39.376534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1cc9735d-0c6e-4d3b-9fcc-7b968b320a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:39.397672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:39.447287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 514/1021] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:39.470878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9735d-0c6e-4d3b-9fcc-7b968b320a6a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:39.481897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7abc9-87ce-4b95-b7fb-2f35d5493c47 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:39.525169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f4816-712a-4f67-a1a6-d07e6f70337f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:39.525836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f4816-712a-4f67-a1a6-d07e6f70337f None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:39.526267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f4816-712a-4f67-a1a6-d07e6f70337f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:39.526554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f4816-712a-4f67-a1a6-d07e6f70337f None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:39.527944 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f4816-712a-4f67-a1a6-d07e6f70337f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:39.529914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f4816-712a-4f67-a1a6-d07e6f70337f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:39.535885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:39.570211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9735d-0c6e-4d3b-9fcc-7b968b320a6a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:39.603992 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e510b5-1329-493e-8c98-ecf8aef38214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:39.604761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e510b5-1329-493e-8c98-ecf8aef38214 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:39.605052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e510b5-1329-493e-8c98-ecf8aef38214 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:39.605334 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e510b5-1329-493e-8c98-ecf8aef38214 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:39.615353 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e510b5-1329-493e-8c98-ecf8aef38214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:39.632690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 508/1022] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:54:39 2022] POST /identity/v3/projects => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-63e510b5-1329-493e-8c98-ecf8aef38214 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:39.632902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:39.634018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:39.635075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:39.635075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:39.635075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:39.635075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:39.635075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:39.635075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:39.635075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:39.635075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:39.635075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:39.635075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:39.635075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:54:39.635075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:39.635875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75032c-8e58-435c-bcba-18bd59af58b0 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:39.635875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75032c-8e58-435c-bcba-18bd59af58b0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:39.635875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75032c-8e58-435c-bcba-18bd59af58b0 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:39.636281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 515/1023] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jun 23 12:54:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:39.636365 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 509/1024] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:39.636447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6f658-c4b3-43b4-a7af-6a259e239bf8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:39.636542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75032c-8e58-435c-bcba-18bd59af58b0 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:39.636628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6f658-c4b3-43b4-a7af-6a259e239bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:39.636628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6f658-c4b3-43b4-a7af-6a259e239bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:39.653307 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d4a6f658-c4b3-43b4-a7af-6a259e239bf8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:39.654584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d4a6f658-c4b3-43b4-a7af-6a259e239bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:39.721709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:39.741620 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 516/1025] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:39.752806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75032c-8e58-435c-bcba-18bd59af58b0 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:39.766516 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6f658-c4b3-43b4-a7af-6a259e239bf8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:39.794491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc73b78-ec66-474a-ae3d-2d88f40387bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:39.795685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc73b78-ec66-474a-ae3d-2d88f40387bc None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:39.796030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc73b78-ec66-474a-ae3d-2d88f40387bc None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:39.796316 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc73b78-ec66-474a-ae3d-2d88f40387bc None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:39.797138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc73b78-ec66-474a-ae3d-2d88f40387bc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:39.797454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc73b78-ec66-474a-ae3d-2d88f40387bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:39.798836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc73b78-ec66-474a-ae3d-2d88f40387bc None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:39.809848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 510/1026] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 23 12:54:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:39.814316 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc73b78-ec66-474a-ae3d-2d88f40387bc None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:39.835037 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:39.887790 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6f658-c4b3-43b4-a7af-6a259e239bf8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:39.925723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc73b78-ec66-474a-ae3d-2d88f40387bc None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:39.926847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffcfa7-8548-4cd2-a675-4b67bab132d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:39.927800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffcfa7-8548-4cd2-a675-4b67bab132d6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:39.928896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffcfa7-8548-4cd2-a675-4b67bab132d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:39.929181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffcfa7-8548-4cd2-a675-4b67bab132d6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:39.929845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffcfa7-8548-4cd2-a675-4b67bab132d6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:39.931236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffcfa7-8548-4cd2-a675-4b67bab132d6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-52ffcfa7-8548-4cd2-a675-4b67bab132d6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:39.943735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:39.944806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:39.945644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 517/1027] 10.222.0.33 () {56 vars in 1105 bytes} [Thu Jun 23 12:54:39 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:39.950833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffcfa7-8548-4cd2-a675-4b67bab132d6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:39.966972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8f21d-24ec-4461-9762-ae0939f6752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:39.967668 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8f21d-24ec-4461-9762-ae0939f6752f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:39.967959 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8f21d-24ec-4461-9762-ae0939f6752f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:39.968239 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8f21d-24ec-4461-9762-ae0939f6752f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:39.971595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:39.980991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8f21d-24ec-4461-9762-ae0939f6752f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:39.983174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8f21d-24ec-4461-9762-ae0939f6752f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-13b8f21d-24ec-4461-9762-ae0939f6752f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:40.002210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:40.003323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:40.004572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:40.004572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:40.004572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:40.004572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:40.004572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 511/1028] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:40.008949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8f21d-24ec-4461-9762-ae0939f6752f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:40.068692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffcfa7-8548-4cd2-a675-4b67bab132d6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:40.092092 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:40.108241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29794df-531d-4d2e-bcff-6aebffeaf48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:40.109300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29794df-531d-4d2e-bcff-6aebffeaf48e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:40.109593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29794df-531d-4d2e-bcff-6aebffeaf48e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:40.109880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29794df-531d-4d2e-bcff-6aebffeaf48e None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:40.110758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29794df-531d-4d2e-bcff-6aebffeaf48e None admin] RBAC: Adding query filter params (name=image) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:40.111430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29794df-531d-4d2e-bcff-6aebffeaf48e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:40.112844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29794df-531d-4d2e-bcff-6aebffeaf48e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:40.118788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 518/1029] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:40.121725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8f21d-24ec-4461-9762-ae0939f6752f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:40.125916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29794df-531d-4d2e-bcff-6aebffeaf48e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:40.163344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774c117-896a-4e4d-82a2-aa76c7e7a5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:40.163935 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774c117-896a-4e4d-82a2-aa76c7e7a5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:40.164215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774c117-896a-4e4d-82a2-aa76c7e7a5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:40.164505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774c117-896a-4e4d-82a2-aa76c7e7a5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:40.165259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774c117-896a-4e4d-82a2-aa76c7e7a5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:40.165575 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774c117-896a-4e4d-82a2-aa76c7e7a5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:40.166950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774c117-896a-4e4d-82a2-aa76c7e7a5a2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:40.180948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 512/1030] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:40.186500 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774c117-896a-4e4d-82a2-aa76c7e7a5a2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:40.234414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29794df-531d-4d2e-bcff-6aebffeaf48e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:40.240211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:40.269990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac81a02-23bd-4573-8cf1-b3c29788a2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:40.270679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac81a02-23bd-4573-8cf1-b3c29788a2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:40.270973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac81a02-23bd-4573-8cf1-b3c29788a2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:40.271256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac81a02-23bd-4573-8cf1-b3c29788a2f3 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:40.272234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac81a02-23bd-4573-8cf1-b3c29788a2f3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:40.272547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac81a02-23bd-4573-8cf1-b3c29788a2f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:40.273940 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac81a02-23bd-4573-8cf1-b3c29788a2f3 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:40.283969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 519/1031] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:40.286191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac81a02-23bd-4573-8cf1-b3c29788a2f3 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:40.296276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774c117-896a-4e4d-82a2-aa76c7e7a5a2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:40.334606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3de76-2b0c-40da-95a4-2a0ccca9a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:40.335198 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:40.336172 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3de76-2b0c-40da-95a4-2a0ccca9a07a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:40.336462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3de76-2b0c-40da-95a4-2a0ccca9a07a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:40.336775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3de76-2b0c-40da-95a4-2a0ccca9a07a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:40.344628 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3de76-2b0c-40da-95a4-2a0ccca9a07a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:40.346130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3de76-2b0c-40da-95a4-2a0ccca9a07a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-eab3de76-2b0c-40da-95a4-2a0ccca9a07a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:40.361932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:40.362951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:40.363898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:40.363898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:40.363898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:40.363898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:40.363898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:40.363898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:40.363898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:40.363898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:40.363898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:54:40.363898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:40.363898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 513/1032] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 23 12:54:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:40.369185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3de76-2b0c-40da-95a4-2a0ccca9a07a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:40.391382 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac81a02-23bd-4573-8cf1-b3c29788a2f3 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:40.426489 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d74d77-ae10-4155-8de1-a9e472eacf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:40.427075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d74d77-ae10-4155-8de1-a9e472eacf5f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:40.427359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d74d77-ae10-4155-8de1-a9e472eacf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:40.427635 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d74d77-ae10-4155-8de1-a9e472eacf5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:40.428427 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d74d77-ae10-4155-8de1-a9e472eacf5f None admin] RBAC: Adding query filter params (interface=public, service_id=426551076c534c13a320f5f023fd25ce, region_id=RegionOne) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:40.428791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d74d77-ae10-4155-8de1-a9e472eacf5f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:40.430166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d74d77-ae10-4155-8de1-a9e472eacf5f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:40.439750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 520/1033] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 23 12:54:40 2022] GET /identity/v3/endpoints?service_id=426551076c534c13a320f5f023fd25ce&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:40.441563 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d74d77-ae10-4155-8de1-a9e472eacf5f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:40.478100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3de76-2b0c-40da-95a4-2a0ccca9a07a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:40.489092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:40.514283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b2062-59bf-4bd7-bd1b-0ec6727a170b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:40.514953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b2062-59bf-4bd7-bd1b-0ec6727a170b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:40.515237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b2062-59bf-4bd7-bd1b-0ec6727a170b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:40.516074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b2062-59bf-4bd7-bd1b-0ec6727a170b None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:40.516341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b2062-59bf-4bd7-bd1b-0ec6727a170b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:40.516652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b2062-59bf-4bd7-bd1b-0ec6727a170b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:40.518101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b2062-59bf-4bd7-bd1b-0ec6727a170b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:40.536687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 514/1034] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 23 12:54:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:40.542383 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b2062-59bf-4bd7-bd1b-0ec6727a170b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:40.550951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d74d77-ae10-4155-8de1-a9e472eacf5f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:40.565703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:40.590921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948488c6-87ec-438d-a59f-5184e38f08c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:40.591630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948488c6-87ec-438d-a59f-5184e38f08c2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:40.592430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948488c6-87ec-438d-a59f-5184e38f08c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:40.592742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948488c6-87ec-438d-a59f-5184e38f08c2 None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:40.593423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948488c6-87ec-438d-a59f-5184e38f08c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:40.594780 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948488c6-87ec-438d-a59f-5184e38f08c2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:40.608690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 521/1035] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 23 12:54:40 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:54:40.656280 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b2062-59bf-4bd7-bd1b-0ec6727a170b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:40.692920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc90e0b-ba23-4c5f-8d2d-c5e35aaf7d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:40.693499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc90e0b-ba23-4c5f-8d2d-c5e35aaf7d45 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:40.693785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc90e0b-ba23-4c5f-8d2d-c5e35aaf7d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:40.694062 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc90e0b-ba23-4c5f-8d2d-c5e35aaf7d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:40.731111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:40.770025 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc90e0b-ba23-4c5f-8d2d-c5e35aaf7d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:40.771726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc90e0b-ba23-4c5f-8d2d-c5e35aaf7d45 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:40.872332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 515/1036] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 12:54:40.878821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948488c6-87ec-438d-a59f-5184e38f08c2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:40.980179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948488c6-87ec-438d-a59f-5184e38f08c2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:41.013218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18b2b8-f341-4edd-9039-bbf652648bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:41.014636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18b2b8-f341-4edd-9039-bbf652648bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:41.014918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18b2b8-f341-4edd-9039-bbf652648bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:41.015192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18b2b8-f341-4edd-9039-bbf652648bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:41.025970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18b2b8-f341-4edd-9039-bbf652648bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:41.027397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18b2b8-f341-4edd-9039-bbf652648bd7 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-3f18b2b8-f341-4edd-9039-bbf652648bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:41.044188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:41.045144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:41.046035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:41.046035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:41.046035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:41.046035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:41.046913 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 522/1037] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:41.051132 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc90e0b-ba23-4c5f-8d2d-c5e35aaf7d45 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:41.128174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:41.162951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc90e0b-ba23-4c5f-8d2d-c5e35aaf7d45 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:41.196953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2380a-0a2e-489b-98fb-78ecdb4a5f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:41.197617 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2380a-0a2e-489b-98fb-78ecdb4a5f25 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:41.197900 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2380a-0a2e-489b-98fb-78ecdb4a5f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:41.198176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2380a-0a2e-489b-98fb-78ecdb4a5f25 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:41.198893 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2380a-0a2e-489b-98fb-78ecdb4a5f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:41.199201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2380a-0a2e-489b-98fb-78ecdb4a5f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:41.200561 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2380a-0a2e-489b-98fb-78ecdb4a5f25 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:41.216631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 516/1038] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:41.218100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18b2b8-f341-4edd-9039-bbf652648bd7 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:41.248511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:41.320243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18b2b8-f341-4edd-9039-bbf652648bd7 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:41.353186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1b797-d71d-4937-baf9-014a7ecd9a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:41.354023 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1b797-d71d-4937-baf9-014a7ecd9a26 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:41.354319 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1b797-d71d-4937-baf9-014a7ecd9a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:41.354580 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1b797-d71d-4937-baf9-014a7ecd9a26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:41.361736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1b797-d71d-4937-baf9-014a7ecd9a26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:41.363216 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1b797-d71d-4937-baf9-014a7ecd9a26 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-86d1b797-d71d-4937-baf9-014a7ecd9a26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:41.376778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:41.377666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:41.378616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:41.378616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:41.378616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:41.378616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:41.378616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:41.378616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:41.378616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:41.378616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:41.378616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 523/1039] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:41.385068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2380a-0a2e-489b-98fb-78ecdb4a5f25 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:41.488784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2380a-0a2e-489b-98fb-78ecdb4a5f25 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:41.515105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:41.523828 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710636b0-fc87-4194-a09e-cdb7923be7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:41.531985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710636b0-fc87-4194-a09e-cdb7923be7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:41.531985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710636b0-fc87-4194-a09e-cdb7923be7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:41.531985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710636b0-fc87-4194-a09e-cdb7923be7f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:41.531985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710636b0-fc87-4194-a09e-cdb7923be7f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:41.531985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710636b0-fc87-4194-a09e-cdb7923be7f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:41.531985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710636b0-fc87-4194-a09e-cdb7923be7f4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:41.544217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 517/1040] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:41.546252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1b797-d71d-4937-baf9-014a7ecd9a26 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:41.633503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:41.645652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1b797-d71d-4937-baf9-014a7ecd9a26 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:41.680472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652043fc-8a16-4aa4-a5e3-13d2b39c6df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:41.681150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652043fc-8a16-4aa4-a5e3-13d2b39c6df2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:41.681431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652043fc-8a16-4aa4-a5e3-13d2b39c6df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:41.681705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652043fc-8a16-4aa4-a5e3-13d2b39c6df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:41.682531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652043fc-8a16-4aa4-a5e3-13d2b39c6df2 None admin] RBAC: Adding query filter params (role.id=442af245d352472aa06e68c06a06a576, scope.project.id=311787f32b54485682be669bca9998f8, user.id=5874e98df57242028c0f9983dee3b5e8) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:41.682842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652043fc-8a16-4aa4-a5e3-13d2b39c6df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:41.684251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652043fc-8a16-4aa4-a5e3-13d2b39c6df2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:41.696994 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 524/1041] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:41 2022] GET /identity/v3/role_assignments?user.id=5874e98df57242028c0f9983dee3b5e8&scope.project.id=311787f32b54485682be669bca9998f8&role.id=442af245d352472aa06e68c06a06a576 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:41.739786 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905a50b-e97d-4fc9-a0b5-77bfc55d62f4 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:41.740079 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905a50b-e97d-4fc9-a0b5-77bfc55d62f4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:41.740364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905a50b-e97d-4fc9-a0b5-77bfc55d62f4 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:41.741860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 518/1042] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:41.747999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e95f00-fb03-4795-b3b1-4b133816c7e3 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:41.748294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e95f00-fb03-4795-b3b1-4b133816c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:41.748584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e95f00-fb03-4795-b3b1-4b133816c7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:41.766279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d2e95f00-fb03-4795-b3b1-4b133816c7e3 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:41.767429 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d2e95f00-fb03-4795-b3b1-4b133816c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:41.842222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 525/1043] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:41.867732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905a50b-e97d-4fc9-a0b5-77bfc55d62f4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:41.968803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905a50b-e97d-4fc9-a0b5-77bfc55d62f4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:42.002463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f8f15-5882-4797-a775-657146e18cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:42.003256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f8f15-5882-4797-a775-657146e18cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:42.003543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f8f15-5882-4797-a775-657146e18cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:42.003834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f8f15-5882-4797-a775-657146e18cd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:42.005020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f8f15-5882-4797-a775-657146e18cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:42.006449 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f8f15-5882-4797-a775-657146e18cd4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:42.015914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 519/1044] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:42.016074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e95f00-fb03-4795-b3b1-4b133816c7e3 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:42.102393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:42.120114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e95f00-fb03-4795-b3b1-4b133816c7e3 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:42.154998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172431f0-3a64-4f6c-bc47-acc66204f796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:42.155689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172431f0-3a64-4f6c-bc47-acc66204f796 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:42.156099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172431f0-3a64-4f6c-bc47-acc66204f796 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:42.156803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172431f0-3a64-4f6c-bc47-acc66204f796 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:42.157898 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172431f0-3a64-4f6c-bc47-acc66204f796 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:42.159889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172431f0-3a64-4f6c-bc47-acc66204f796 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:42.255583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 526/1045] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:54:42 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:54:42.645512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24128de-fc39-4ade-b2b6-f846d157d2ff None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:42.646029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24128de-fc39-4ade-b2b6-f846d157d2ff None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:42.646135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24128de-fc39-4ade-b2b6-f846d157d2ff None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:42.647818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 520/1046] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:42.652742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87e244-4010-48e2-beb0-a86ebed2e0b5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:42.653041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87e244-4010-48e2-beb0-a86ebed2e0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:42.653322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87e244-4010-48e2-beb0-a86ebed2e0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:42.669901 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0e87e244-4010-48e2-beb0-a86ebed2e0b5 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:42.671064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0e87e244-4010-48e2-beb0-a86ebed2e0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:42.736128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 527/1047] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:42.759448 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24128de-fc39-4ade-b2b6-f846d157d2ff None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:42.825497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:42.870968 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24128de-fc39-4ade-b2b6-f846d157d2ff None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:42.904398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12663a74-9767-4a28-9c0d-73ccf3885bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:42.905143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12663a74-9767-4a28-9c0d-73ccf3885bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:42.905425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12663a74-9767-4a28-9c0d-73ccf3885bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:42.905698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12663a74-9767-4a28-9c0d-73ccf3885bf3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:42.906342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12663a74-9767-4a28-9c0d-73ccf3885bf3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:42.907697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12663a74-9767-4a28-9c0d-73ccf3885bf3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-12663a74-9767-4a28-9c0d-73ccf3885bf3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:42.919088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:42.920652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:42.926591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 521/1048] 10.222.0.33 () {56 vars in 1105 bytes} [Thu Jun 23 12:54:42 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:42.927541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87e244-4010-48e2-beb0-a86ebed2e0b5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:42.991897 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:43.025707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87e244-4010-48e2-beb0-a86ebed2e0b5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:43.063660 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a0f43-81e6-4b08-8102-83724a6b5efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:43.064702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a0f43-81e6-4b08-8102-83724a6b5efa None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:43.065220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a0f43-81e6-4b08-8102-83724a6b5efa None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:43.065712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a0f43-81e6-4b08-8102-83724a6b5efa None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:43.066630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a0f43-81e6-4b08-8102-83724a6b5efa None admin] RBAC: Adding query filter params (name=image) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:43.067141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a0f43-81e6-4b08-8102-83724a6b5efa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:43.068748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a0f43-81e6-4b08-8102-83724a6b5efa None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:43.079896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12663a74-9767-4a28-9c0d-73ccf3885bf3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:43.080232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 528/1049] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:43.185937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12663a74-9767-4a28-9c0d-73ccf3885bf3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:43.204159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:43.221108 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbf3a9-339e-4940-98ff-0c8ee05439e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:43.221833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbf3a9-339e-4940-98ff-0c8ee05439e2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:43.222120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbf3a9-339e-4940-98ff-0c8ee05439e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:43.222401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbf3a9-339e-4940-98ff-0c8ee05439e2 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:43.223107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbf3a9-339e-4940-98ff-0c8ee05439e2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:43.223418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbf3a9-339e-4940-98ff-0c8ee05439e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:43.224856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbf3a9-339e-4940-98ff-0c8ee05439e2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:43.234938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 522/1050] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:43.236155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a0f43-81e6-4b08-8102-83724a6b5efa None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:43.337239 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a0f43-81e6-4b08-8102-83724a6b5efa None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:43.366048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:43.371487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891f04c-5ada-42fa-bd97-c0546fa83ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:43.372155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891f04c-5ada-42fa-bd97-c0546fa83ba2 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:43.372445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891f04c-5ada-42fa-bd97-c0546fa83ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:43.373287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891f04c-5ada-42fa-bd97-c0546fa83ba2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:43.374044 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891f04c-5ada-42fa-bd97-c0546fa83ba2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:43.375555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891f04c-5ada-42fa-bd97-c0546fa83ba2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:43.475754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 529/1051] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 23 12:54:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:54:43.721956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b92ab-3b77-4b71-be2b-460c324521e3 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:43.722468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b92ab-3b77-4b71-be2b-460c324521e3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:43.722544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b92ab-3b77-4b71-be2b-460c324521e3 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:43.724036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 523/1052] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:43.729257 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acd164-08ab-4216-aac1-f0ba0a854dc5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:43.729496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acd164-08ab-4216-aac1-f0ba0a854dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:43.729775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acd164-08ab-4216-aac1-f0ba0a854dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:43.747049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b1acd164-08ab-4216-aac1-f0ba0a854dc5 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:43.748913 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b1acd164-08ab-4216-aac1-f0ba0a854dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:43.824701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 530/1053] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:43.846423 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b92ab-3b77-4b71-be2b-460c324521e3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:43.958819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b92ab-3b77-4b71-be2b-460c324521e3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:43.992944 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494f3f4-0fc4-40d0-a8a6-27a79fb238d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:43.993671 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494f3f4-0fc4-40d0-a8a6-27a79fb238d5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:43.993948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494f3f4-0fc4-40d0-a8a6-27a79fb238d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:43.994217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494f3f4-0fc4-40d0-a8a6-27a79fb238d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:44.004139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494f3f4-0fc4-40d0-a8a6-27a79fb238d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8494f3f4-0fc4-40d0-a8a6-27a79fb238d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:44.012336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:44.013352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:44.014196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:44.014196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:44.014196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:44.014196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:44.014196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:44.014196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:44.014196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:44.014196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:44.014196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:44.014196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:44.014196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:54:44.014196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:44.016960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 524/1054] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jun 23 12:54:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:44.019525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acd164-08ab-4216-aac1-f0ba0a854dc5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:44.173779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acd164-08ab-4216-aac1-f0ba0a854dc5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:44.173779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:44.173779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89696c-8118-4b8a-a2a1-6044d0bee07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:44.173779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89696c-8118-4b8a-a2a1-6044d0bee07a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:44.174676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89696c-8118-4b8a-a2a1-6044d0bee07a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:44.174676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89696c-8118-4b8a-a2a1-6044d0bee07a None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:44.174676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89696c-8118-4b8a-a2a1-6044d0bee07a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:44.174676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89696c-8118-4b8a-a2a1-6044d0bee07a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:44.174676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89696c-8118-4b8a-a2a1-6044d0bee07a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:44.175003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 531/1055] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 23 12:54:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:44.185327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494f3f4-0fc4-40d0-a8a6-27a79fb238d5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:44.241131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:44.297774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494f3f4-0fc4-40d0-a8a6-27a79fb238d5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:44.330572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2ae2c-ce2a-41c0-bea8-2c62866df37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:44.331362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2ae2c-ce2a-41c0-bea8-2c62866df37b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:44.331643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2ae2c-ce2a-41c0-bea8-2c62866df37b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:44.331917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2ae2c-ce2a-41c0-bea8-2c62866df37b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:44.342556 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2ae2c-ce2a-41c0-bea8-2c62866df37b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:44.343756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2ae2c-ce2a-41c0-bea8-2c62866df37b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:44.344153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948f564-d303-441c-b267-215451129051 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:44.344625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948f564-d303-441c-b267-215451129051 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:44.344763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948f564-d303-441c-b267-215451129051 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:44.346065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 532/1056] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:44.350835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905257f-eb65-4102-9e74-8756eadb28b1 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:44.351129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905257f-eb65-4102-9e74-8756eadb28b1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:44.351411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905257f-eb65-4102-9e74-8756eadb28b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-96a2ae2c-ce2a-41c0-bea8-2c62866df37b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:44.363027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:44.363975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:44.364910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:44.364910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:44.364910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:44.364910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:44.364910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 525/1057] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:44.369693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2ae2c-ce2a-41c0-bea8-2c62866df37b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:44.373775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d905257f-eb65-4102-9e74-8756eadb28b1 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:44.375003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d905257f-eb65-4102-9e74-8756eadb28b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:44.444702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 533/1058] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:44.465333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:44.465871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905257f-eb65-4102-9e74-8756eadb28b1 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:44.473624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2ae2c-ce2a-41c0-bea8-2c62866df37b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:44.509372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9b8e7-037c-4f27-9faf-f7549c4ce250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:44.510037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9b8e7-037c-4f27-9faf-f7549c4ce250 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:44.510390 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9b8e7-037c-4f27-9faf-f7549c4ce250 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:44.510600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9b8e7-037c-4f27-9faf-f7549c4ce250 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:44.511596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9b8e7-037c-4f27-9faf-f7549c4ce250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:44.511989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9b8e7-037c-4f27-9faf-f7549c4ce250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:44.514472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9b8e7-037c-4f27-9faf-f7549c4ce250 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:44.526237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 526/1059] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:44.532560 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9b8e7-037c-4f27-9faf-f7549c4ce250 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:44.576958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905257f-eb65-4102-9e74-8756eadb28b1 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:44.585140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:44.614636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7e257-2eeb-43e8-85d7-4b686134bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:44.614636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7e257-2eeb-43e8-85d7-4b686134bc25 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:44.614958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7e257-2eeb-43e8-85d7-4b686134bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:44.615194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7e257-2eeb-43e8-85d7-4b686134bc25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:44.625735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7e257-2eeb-43e8-85d7-4b686134bc25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-ebc7e257-2eeb-43e8-85d7-4b686134bc25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:44.633772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:44.634888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:44.635938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:44.635938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:44.635938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:44.635938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:44.635938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:44.635938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:44.635938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:44.635938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:44.635938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:44.635938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:44.635938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:44.635938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:44.638167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 534/1060] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:54:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:44.644847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7e257-2eeb-43e8-85d7-4b686134bc25 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:44.653029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9b8e7-037c-4f27-9faf-f7549c4ce250 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:44.689889 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bf173-0ecf-42a3-a7cd-639c31edfc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:44.690944 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bf173-0ecf-42a3-a7cd-639c31edfc43 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:44.691380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bf173-0ecf-42a3-a7cd-639c31edfc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:44.691914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bf173-0ecf-42a3-a7cd-639c31edfc43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:44.703190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bf173-0ecf-42a3-a7cd-639c31edfc43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:44.704648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bf173-0ecf-42a3-a7cd-639c31edfc43 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-ee1bf173-0ecf-42a3-a7cd-639c31edfc43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:44.719192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:44.720134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:44.721476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:44.721476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:44.721476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:44.721476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:44.721476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:44.721476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:44.721476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:44.721476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:44.721476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:54:44.721476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:44.721476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 527/1061] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 23 12:54:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:44.725983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bf173-0ecf-42a3-a7cd-639c31edfc43 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:44.740600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:44.754826 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7e257-2eeb-43e8-85d7-4b686134bc25 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:44.790958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a6dab-65d4-4f80-9dcd-215466d8f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:44.791929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a6dab-65d4-4f80-9dcd-215466d8f80f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:44.792361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a6dab-65d4-4f80-9dcd-215466d8f80f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:44.792829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a6dab-65d4-4f80-9dcd-215466d8f80f None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:44.793615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a6dab-65d4-4f80-9dcd-215466d8f80f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:44.793898 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a6dab-65d4-4f80-9dcd-215466d8f80f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:44.795561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a6dab-65d4-4f80-9dcd-215466d8f80f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:44.809526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 535/1062] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:54:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:44.811224 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a6dab-65d4-4f80-9dcd-215466d8f80f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:44.827055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bf173-0ecf-42a3-a7cd-639c31edfc43 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:44.840545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:44.863156 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b55df-00fb-4b93-8281-5bd18db409b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:44.863828 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b55df-00fb-4b93-8281-5bd18db409b3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:44.864100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b55df-00fb-4b93-8281-5bd18db409b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:44.864375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b55df-00fb-4b93-8281-5bd18db409b3 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:44.865225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b55df-00fb-4b93-8281-5bd18db409b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:44.865571 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b55df-00fb-4b93-8281-5bd18db409b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:44.866983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b55df-00fb-4b93-8281-5bd18db409b3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:44.885509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 528/1063] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 23 12:54:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:44.891145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b55df-00fb-4b93-8281-5bd18db409b3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:44.916263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a6dab-65d4-4f80-9dcd-215466d8f80f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:44.951473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291414e4-60c4-4508-866a-15525f497004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:44.952342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291414e4-60c4-4508-866a-15525f497004 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:44.952627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291414e4-60c4-4508-866a-15525f497004 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:44.952937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291414e4-60c4-4508-866a-15525f497004 None admin] PATH_INFO: `/v3/users/59284ee7efdf4895923ef51383e01762` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:44.966615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:44.967438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291414e4-60c4-4508-866a-15525f497004 None admin] RBAC: Authorizing `identity:get_user(user_id=59284ee7efdf4895923ef51383e01762)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:44.968910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291414e4-60c4-4508-866a-15525f497004 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:44.970791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 536/1064] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:54:44 2022] GET /identity/v3/users/59284ee7efdf4895923ef51383e01762 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:44.976231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291414e4-60c4-4508-866a-15525f497004 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:44.995662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b55df-00fb-4b93-8281-5bd18db409b3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:45.033843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffb5a4-833b-4d2d-b176-eeb2afe7b39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:45.034637 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffb5a4-833b-4d2d-b176-eeb2afe7b39e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:45.034921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffb5a4-833b-4d2d-b176-eeb2afe7b39e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:45.035200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffb5a4-833b-4d2d-b176-eeb2afe7b39e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:45.046099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffb5a4-833b-4d2d-b176-eeb2afe7b39e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:45.047703 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffb5a4-833b-4d2d-b176-eeb2afe7b39e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:45.067211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-8fffb5a4-833b-4d2d-b176-eeb2afe7b39e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:45.067395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:45.068433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:45.069635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:45.069635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:45.069635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:45.069635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:45.069635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 529/1065] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:45.074280 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffb5a4-833b-4d2d-b176-eeb2afe7b39e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:45.089116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291414e4-60c4-4508-866a-15525f497004 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:45.130052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68129d3-e790-40ef-920e-e4513843eebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:45.131096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68129d3-e790-40ef-920e-e4513843eebe None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:45.131387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68129d3-e790-40ef-920e-e4513843eebe None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:45.131667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68129d3-e790-40ef-920e-e4513843eebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:45.183194 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffb5a4-833b-4d2d-b176-eeb2afe7b39e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:45.204097 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68129d3-e790-40ef-920e-e4513843eebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:45.205576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68129d3-e790-40ef-920e-e4513843eebe None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:45.209263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:45.219683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697ea34-e14f-446b-aca9-5479fbd4c25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:45.220361 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697ea34-e14f-446b-aca9-5479fbd4c25a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:45.222945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697ea34-e14f-446b-aca9-5479fbd4c25a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:45.222945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697ea34-e14f-446b-aca9-5479fbd4c25a None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:45.222945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697ea34-e14f-446b-aca9-5479fbd4c25a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:45.222945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697ea34-e14f-446b-aca9-5479fbd4c25a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:45.223283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697ea34-e14f-446b-aca9-5479fbd4c25a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:45.235043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 530/1066] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:45.240553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697ea34-e14f-446b-aca9-5479fbd4c25a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:45.301390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:45.323279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 537/1067] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 12:54:45.324322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68129d3-e790-40ef-920e-e4513843eebe None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:45.350868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697ea34-e14f-446b-aca9-5479fbd4c25a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:45.386606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17812ddc-3b2f-4aa8-85ee-7a485ea88e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:45.387458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17812ddc-3b2f-4aa8-85ee-7a485ea88e46 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:45.387741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17812ddc-3b2f-4aa8-85ee-7a485ea88e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:45.388015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17812ddc-3b2f-4aa8-85ee-7a485ea88e46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:45.395258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17812ddc-3b2f-4aa8-85ee-7a485ea88e46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:45.396986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17812ddc-3b2f-4aa8-85ee-7a485ea88e46 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-17812ddc-3b2f-4aa8-85ee-7a485ea88e46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:45.412459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:45.413572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:45.414488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:45.414488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:45.414488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:45.414488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:45.414488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:45.414488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:45.414488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:45.414488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:45.414488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 531/1068] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:45.419267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17812ddc-3b2f-4aa8-85ee-7a485ea88e46 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:45.426873 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68129d3-e790-40ef-920e-e4513843eebe None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:45.465691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:45.466753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaa9fc-b4dc-491b-b101-5e370f07e1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:45.467605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa9fc-b4dc-491b-b101-5e370f07e1ef None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:45.467887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa9fc-b4dc-491b-b101-5e370f07e1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:45.468163 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa9fc-b4dc-491b-b101-5e370f07e1ef None admin] PATH_INFO: `/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:45.469500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaa9fc-b4dc-491b-b101-5e370f07e1ef None admin] RBAC: Authorizing `identity:get_project(project_id=0c42967bbeb7431d90af9cbbf39b39fd)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:45.470907 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaa9fc-b4dc-491b-b101-5e370f07e1ef None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:45.472784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 538/1069] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:54:45 2022] GET /identity/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:45.478982 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaa9fc-b4dc-491b-b101-5e370f07e1ef None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:45.529891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17812ddc-3b2f-4aa8-85ee-7a485ea88e46 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:45.540459 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:45.563910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc17af3-cd58-4a50-839f-7afc7d38b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:45.564560 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc17af3-cd58-4a50-839f-7afc7d38b6ee None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:45.564875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc17af3-cd58-4a50-839f-7afc7d38b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:45.565158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc17af3-cd58-4a50-839f-7afc7d38b6ee None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:45.565937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc17af3-cd58-4a50-839f-7afc7d38b6ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:45.566246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc17af3-cd58-4a50-839f-7afc7d38b6ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:45.567665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc17af3-cd58-4a50-839f-7afc7d38b6ee None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:45.579609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 532/1070] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:45.580922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933c77b-89dd-44ee-9660-05d22e287807 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:45.581212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933c77b-89dd-44ee-9660-05d22e287807 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:45.581493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933c77b-89dd-44ee-9660-05d22e287807 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:45.582797 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 533/1071] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:45.585340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933c77b-89dd-44ee-9660-05d22e287807 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:45.588296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaa9fc-b4dc-491b-b101-5e370f07e1ef None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:45.623517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00e41e-20bd-4715-878b-58b256a766b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:45.624091 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00e41e-20bd-4715-878b-58b256a766b9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:45.624373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00e41e-20bd-4715-878b-58b256a766b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:45.624671 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00e41e-20bd-4715-878b-58b256a766b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:45.625504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00e41e-20bd-4715-878b-58b256a766b9 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=0c42967bbeb7431d90af9cbbf39b39fd, user.id=59284ee7efdf4895923ef51383e01762) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:45.625819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00e41e-20bd-4715-878b-58b256a766b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:45.627241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00e41e-20bd-4715-878b-58b256a766b9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:45.632506 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 539/1072] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:45 2022] GET /identity/v3/role_assignments?user.id=59284ee7efdf4895923ef51383e01762&scope.project.id=0c42967bbeb7431d90af9cbbf39b39fd&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:45.633753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ba511-da73-45dd-96e9-a48f09f8d531 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:45.634046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ba511-da73-45dd-96e9-a48f09f8d531 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:45.634326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ba511-da73-45dd-96e9-a48f09f8d531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:45.657690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-086ba511-da73-45dd-96e9-a48f09f8d531 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:45.658923 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-086ba511-da73-45dd-96e9-a48f09f8d531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:45.700125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933c77b-89dd-44ee-9660-05d22e287807 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:45.704258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:45.734964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 540/1073] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:45.738485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2ee66-19c4-48fe-b47e-bf4faca08e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:45.740023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ee66-19c4-48fe-b47e-bf4faca08e48 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:45.740516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ee66-19c4-48fe-b47e-bf4faca08e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:45.741023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ee66-19c4-48fe-b47e-bf4faca08e48 None admin] PATH_INFO: `/v3/projects/311787f32b54485682be669bca9998f8/users/5874e98df57242028c0f9983dee3b5e8/roles/442af245d352472aa06e68c06a06a576` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:45.743590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2ee66-19c4-48fe-b47e-bf4faca08e48 None admin] RBAC: Authorizing `identity:create_grant(project_id=311787f32b54485682be669bca9998f8, user_id=5874e98df57242028c0f9983dee3b5e8, role_id=442af245d352472aa06e68c06a06a576)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:45.745324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2ee66-19c4-48fe-b47e-bf4faca08e48 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:45.758665 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ba511-da73-45dd-96e9-a48f09f8d531 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:45.808206 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:45.858333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 534/1074] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:54:45 2022] PUT /identity/v3/projects/311787f32b54485682be669bca9998f8/users/5874e98df57242028c0f9983dee3b5e8/roles/442af245d352472aa06e68c06a06a576 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:54:45.860517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ba511-da73-45dd-96e9-a48f09f8d531 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:45.900260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46893554-5c0d-4e81-abf6-ae832ce5a351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:45.900860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893554-5c0d-4e81-abf6-ae832ce5a351 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:45.901147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893554-5c0d-4e81-abf6-ae832ce5a351 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:45.901423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893554-5c0d-4e81-abf6-ae832ce5a351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:45.974140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46893554-5c0d-4e81-abf6-ae832ce5a351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:45.975684 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46893554-5c0d-4e81-abf6-ae832ce5a351 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:46.027362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:46.086930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 541/1075] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 12:54:46.092705 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2ee66-19c4-48fe-b47e-bf4faca08e48 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:46.195859 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2ee66-19c4-48fe-b47e-bf4faca08e48 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:46.230117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae0a8b-ff80-48d2-9179-3f3f8f579a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:46.230917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0a8b-ff80-48d2-9179-3f3f8f579a5c None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:46.231205 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0a8b-ff80-48d2-9179-3f3f8f579a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:46.231485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0a8b-ff80-48d2-9179-3f3f8f579a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:46.242289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae0a8b-ff80-48d2-9179-3f3f8f579a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:46.243739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae0a8b-ff80-48d2-9179-3f3f8f579a5c None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-0dae0a8b-ff80-48d2-9179-3f3f8f579a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:46.261240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:46.262145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:46.263101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:46.263101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:46.263101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:46.263101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:46.264722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 535/1076] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:46.268388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46893554-5c0d-4e81-abf6-ae832ce5a351 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:46.368966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46893554-5c0d-4e81-abf6-ae832ce5a351 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:46.403080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2491569-b0fa-420a-b0bd-7663ffdd07f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:46.404278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2491569-b0fa-420a-b0bd-7663ffdd07f4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:46.404565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2491569-b0fa-420a-b0bd-7663ffdd07f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:46.404880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2491569-b0fa-420a-b0bd-7663ffdd07f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:46.405600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2491569-b0fa-420a-b0bd-7663ffdd07f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:46.405909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2491569-b0fa-420a-b0bd-7663ffdd07f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:46.407268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2491569-b0fa-420a-b0bd-7663ffdd07f4 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:46.419136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 542/1077] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:47.638725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e302f-378f-45c3-a8d9-7faca9831af2 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:47.639261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e302f-378f-45c3-a8d9-7faca9831af2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:47.639261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e302f-378f-45c3-a8d9-7faca9831af2 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:47.640638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 536/1078] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:47.645986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c32ec-e0c3-4a8f-a4a1-ff7b66f2b87b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:47.646665 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c32ec-e0c3-4a8f-a4a1-ff7b66f2b87b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:47.646805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c32ec-e0c3-4a8f-a4a1-ff7b66f2b87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:47.663544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-897c32ec-e0c3-4a8f-a4a1-ff7b66f2b87b None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:47.664748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-897c32ec-e0c3-4a8f-a4a1-ff7b66f2b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:47.666729 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:47.729373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 543/1079] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:47.752180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e302f-378f-45c3-a8d9-7faca9831af2 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:47.769885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:47.851815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e302f-378f-45c3-a8d9-7faca9831af2 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:47.885328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ab234-6357-488b-9883-1cbdb3ac9717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:47.886113 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ab234-6357-488b-9883-1cbdb3ac9717 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:47.886397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ab234-6357-488b-9883-1cbdb3ac9717 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:47.886676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ab234-6357-488b-9883-1cbdb3ac9717 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:47.891187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09341fd-32e6-4a97-8858-a31358d92e9b None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:47.891579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09341fd-32e6-4a97-8858-a31358d92e9b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:47.891893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09341fd-32e6-4a97-8858-a31358d92e9b None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:47.893425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 544/1080] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:54:47.897017 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ab234-6357-488b-9883-1cbdb3ac9717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:47.898434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b488b00-21a2-4bf4-819f-f327d8d5ca2e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:47.898724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b488b00-21a2-4bf4-819f-f327d8d5ca2e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:47.899002 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b488b00-21a2-4bf4-819f-f327d8d5ca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c61ab234-6357-488b-9883-1cbdb3ac9717 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:47.905107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:47.906218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:47.907245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 537/1081] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:54:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:47.912066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ab234-6357-488b-9883-1cbdb3ac9717 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:47.918945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5b488b00-21a2-4bf4-819f-f327d8d5ca2e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:47.920720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5b488b00-21a2-4bf4-819f-f327d8d5ca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:47.984165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 545/1082] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:54:47.988653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:48.007232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b488b00-21a2-4bf4-819f-f327d8d5ca2e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:48.010178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ab234-6357-488b-9883-1cbdb3ac9717 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:48.044177 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6195026-9e24-455e-9e2a-89521c978029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:48.044922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6195026-9e24-455e-9e2a-89521c978029 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:48.045214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6195026-9e24-455e-9e2a-89521c978029 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:48.045493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6195026-9e24-455e-9e2a-89521c978029 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:48.046235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6195026-9e24-455e-9e2a-89521c978029 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:48.046552 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6195026-9e24-455e-9e2a-89521c978029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:48.047918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6195026-9e24-455e-9e2a-89521c978029 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:48.055822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 538/1083] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:54:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:48.061416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6195026-9e24-455e-9e2a-89521c978029 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:48.082576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:48.115776 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b488b00-21a2-4bf4-819f-f327d8d5ca2e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:48.150180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff143bd1-8a93-4a0e-94db-39f7285cb1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:48.150916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff143bd1-8a93-4a0e-94db-39f7285cb1fb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:48.151203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff143bd1-8a93-4a0e-94db-39f7285cb1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:48.151478 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff143bd1-8a93-4a0e-94db-39f7285cb1fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:48.162125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6195026-9e24-455e-9e2a-89521c978029 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:48.162283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff143bd1-8a93-4a0e-94db-39f7285cb1fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-ff143bd1-8a93-4a0e-94db-39f7285cb1fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:48.170272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:48.171393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:48.172231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 546/1084] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jun 23 12:54:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:48.177457 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff143bd1-8a93-4a0e-94db-39f7285cb1fb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:48.194744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a21f32-68a7-4bd9-b25a-d27e4ab5be6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:48.195608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a21f32-68a7-4bd9-b25a-d27e4ab5be6e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:48.195890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a21f32-68a7-4bd9-b25a-d27e4ab5be6e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:48.196164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a21f32-68a7-4bd9-b25a-d27e4ab5be6e None admin] PATH_INFO: `/v3/users/59284ee7efdf4895923ef51383e01762` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:48.197376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a21f32-68a7-4bd9-b25a-d27e4ab5be6e None admin] RBAC: Authorizing `identity:get_user(user_id=59284ee7efdf4895923ef51383e01762)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:48.198797 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a21f32-68a7-4bd9-b25a-d27e4ab5be6e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:48.200948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 539/1085] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:54:48 2022] GET /identity/v3/users/59284ee7efdf4895923ef51383e01762 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:48.206348 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a21f32-68a7-4bd9-b25a-d27e4ab5be6e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:48.219492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:48.277501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff143bd1-8a93-4a0e-94db-39f7285cb1fb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:48.302523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:48.310061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716310c-d7d2-4d21-a062-14e1c2cd3896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:48.310203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a21f32-68a7-4bd9-b25a-d27e4ab5be6e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:48.313510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716310c-d7d2-4d21-a062-14e1c2cd3896 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:48.313510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716310c-d7d2-4d21-a062-14e1c2cd3896 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:48.313510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716310c-d7d2-4d21-a062-14e1c2cd3896 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:48.313510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716310c-d7d2-4d21-a062-14e1c2cd3896 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:48.313510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716310c-d7d2-4d21-a062-14e1c2cd3896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:48.313870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716310c-d7d2-4d21-a062-14e1c2cd3896 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:48.321866 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 547/1086] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 23 12:54:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:48.327902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716310c-d7d2-4d21-a062-14e1c2cd3896 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:48.345074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010d9e0-d8aa-4aff-a77f-7696484538c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:48.345923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010d9e0-d8aa-4aff-a77f-7696484538c2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:48.346203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010d9e0-d8aa-4aff-a77f-7696484538c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:48.346480 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010d9e0-d8aa-4aff-a77f-7696484538c2 None admin] PATH_INFO: `/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:48.347642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010d9e0-d8aa-4aff-a77f-7696484538c2 None admin] RBAC: Authorizing `identity:get_project(project_id=0c42967bbeb7431d90af9cbbf39b39fd)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:48.349096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010d9e0-d8aa-4aff-a77f-7696484538c2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:48.350827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 540/1087] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:54:48 2022] GET /identity/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:48.356547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010d9e0-d8aa-4aff-a77f-7696484538c2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:48.422476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716310c-d7d2-4d21-a062-14e1c2cd3896 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:48.428245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:48.452648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010d9e0-d8aa-4aff-a77f-7696484538c2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:48.456142 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749be32-1c35-49a8-a4e4-418e170b4831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:48.456989 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749be32-1c35-49a8-a4e4-418e170b4831 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:48.457265 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749be32-1c35-49a8-a4e4-418e170b4831 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:48.457533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749be32-1c35-49a8-a4e4-418e170b4831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:48.467415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749be32-1c35-49a8-a4e4-418e170b4831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:48.468829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749be32-1c35-49a8-a4e4-418e170b4831 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:48.484953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027ec08-46e3-45c4-b52e-e9d0c81e7dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-1749be32-1c35-49a8-a4e4-418e170b4831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:48.485626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:48.486633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:48.487547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:48.487547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:48.487547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:48.487547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:48.487781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027ec08-46e3-45c4-b52e-e9d0c81e7dea None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:48.487781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027ec08-46e3-45c4-b52e-e9d0c81e7dea None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:48.487781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027ec08-46e3-45c4-b52e-e9d0c81e7dea None admin] PATH_INFO: `/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd/users/59284ee7efdf4895923ef51383e01762/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:48.487983 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 548/1088] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:48.488466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027ec08-46e3-45c4-b52e-e9d0c81e7dea None admin] RBAC: Authorizing `identity:create_grant(project_id=0c42967bbeb7431d90af9cbbf39b39fd, user_id=59284ee7efdf4895923ef51383e01762, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:48.489924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027ec08-46e3-45c4-b52e-e9d0c81e7dea None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:48.492384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749be32-1c35-49a8-a4e4-418e170b4831 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:48.533838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:48.583250 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 541/1089] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:54:48 2022] PUT /identity/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd/users/59284ee7efdf4895923ef51383e01762/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:54:48.587430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749be32-1c35-49a8-a4e4-418e170b4831 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:48.624624 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9577c91-9026-4f01-85cf-9de44242426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:48.625316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9577c91-9026-4f01-85cf-9de44242426b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:48.625599 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9577c91-9026-4f01-85cf-9de44242426b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:48.625876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9577c91-9026-4f01-85cf-9de44242426b None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:48.626614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9577c91-9026-4f01-85cf-9de44242426b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:48.626925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9577c91-9026-4f01-85cf-9de44242426b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:48.628328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9577c91-9026-4f01-85cf-9de44242426b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:48.641636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 549/1090] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:48.648751 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027ec08-46e3-45c4-b52e-e9d0c81e7dea None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:48.750710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027ec08-46e3-45c4-b52e-e9d0c81e7dea None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:48.784010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5de9e5-e3f4-43ed-998c-11c650c82b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:48.784831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de9e5-e3f4-43ed-998c-11c650c82b2e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:48.785116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de9e5-e3f4-43ed-998c-11c650c82b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:48.785394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de9e5-e3f4-43ed-998c-11c650c82b2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:48.787327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:48.793277 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5de9e5-e3f4-43ed-998c-11c650c82b2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:48.795248 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5de9e5-e3f4-43ed-998c-11c650c82b2e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-4d5de9e5-e3f4-43ed-998c-11c650c82b2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:54:48.808869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:48.810447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:48.811834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:48.811834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:48.811834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:54:48.811834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:54:48.811834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:54:48.811834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:54:48.811834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:54:48.811834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:54:48.811834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:54:48.811834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:48.811834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 542/1091] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 23 12:54:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:48.816258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9577c91-9026-4f01-85cf-9de44242426b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:48.912204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9577c91-9026-4f01-85cf-9de44242426b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:48.913747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:48.945926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97b8ea-7672-414c-962a-8b067c8f6284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:48.946640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97b8ea-7672-414c-962a-8b067c8f6284 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:48.947254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97b8ea-7672-414c-962a-8b067c8f6284 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:48.947532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97b8ea-7672-414c-962a-8b067c8f6284 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:48.948364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97b8ea-7672-414c-962a-8b067c8f6284 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:48.948696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97b8ea-7672-414c-962a-8b067c8f6284 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:48.950121 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97b8ea-7672-414c-962a-8b067c8f6284 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:48.966442 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 550/1092] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 23 12:54:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:48.972052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5de9e5-e3f4-43ed-998c-11c650c82b2e None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:49.071222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5de9e5-e3f4-43ed-998c-11c650c82b2e None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:49.103788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d955fc2-99a4-4a63-88e0-495184e8e4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:49.104430 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d955fc2-99a4-4a63-88e0-495184e8e4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:49.104745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d955fc2-99a4-4a63-88e0-495184e8e4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:49.105028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d955fc2-99a4-4a63-88e0-495184e8e4e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:49.163543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:49.171494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d955fc2-99a4-4a63-88e0-495184e8e4e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:49.178360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d955fc2-99a4-4a63-88e0-495184e8e4e4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:49.270516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 543/1093] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 12:54:49.276542 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97b8ea-7672-414c-962a-8b067c8f6284 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:49.370910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97b8ea-7672-414c-962a-8b067c8f6284 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:49.402487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265af1a-c9a1-4ccb-9b6a-e5aece35d093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:49.403254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265af1a-c9a1-4ccb-9b6a-e5aece35d093 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:49.404048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265af1a-c9a1-4ccb-9b6a-e5aece35d093 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:49.404320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265af1a-c9a1-4ccb-9b6a-e5aece35d093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:49.413851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265af1a-c9a1-4ccb-9b6a-e5aece35d093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:49.415262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265af1a-c9a1-4ccb-9b6a-e5aece35d093 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-3265af1a-c9a1-4ccb-9b6a-e5aece35d093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:54:49.432438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:49.433546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:49.434572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:54:49.434572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:54:49.434572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:54:49.434572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:49.434572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 551/1094] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:49.439587 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d955fc2-99a4-4a63-88e0-495184e8e4e4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:49.529245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:49.535729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d955fc2-99a4-4a63-88e0-495184e8e4e4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:49.568328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f6a45-8dd6-40d7-a69c-9e30122f5cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:49.569069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f6a45-8dd6-40d7-a69c-9e30122f5cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:49.569514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f6a45-8dd6-40d7-a69c-9e30122f5cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:49.570148 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f6a45-8dd6-40d7-a69c-9e30122f5cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:49.570866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f6a45-8dd6-40d7-a69c-9e30122f5cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:49.571176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f6a45-8dd6-40d7-a69c-9e30122f5cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:49.572542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f6a45-8dd6-40d7-a69c-9e30122f5cd3 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:49.584157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 544/1095] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:49.589844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265af1a-c9a1-4ccb-9b6a-e5aece35d093 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:49.604898 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:49.688544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265af1a-c9a1-4ccb-9b6a-e5aece35d093 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:49.722768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fa269-f7cc-4f6e-8b7a-f0dec7032161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:49.723563 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fa269-f7cc-4f6e-8b7a-f0dec7032161 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:49.723846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fa269-f7cc-4f6e-8b7a-f0dec7032161 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:49.724122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fa269-f7cc-4f6e-8b7a-f0dec7032161 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:49.730721 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fa269-f7cc-4f6e-8b7a-f0dec7032161 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:49.732141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fa269-f7cc-4f6e-8b7a-f0dec7032161 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-7a4fa269-f7cc-4f6e-8b7a-f0dec7032161 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:54:49.745462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:49.746613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:49.747556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:54:49.747556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:54:49.747556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:54:49.747556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:54:49.747556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:54:49.747556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:54:49.747556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:54:49.747556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:54:49.747556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 552/1096] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:54:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:54:49.752387 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f6a45-8dd6-40d7-a69c-9e30122f5cd3 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:49.849695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f6a45-8dd6-40d7-a69c-9e30122f5cd3 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:49.882731 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879abf32-3a32-4918-a459-5c112bdacfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:49.883379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879abf32-3a32-4918-a459-5c112bdacfab None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:49.883661 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879abf32-3a32-4918-a459-5c112bdacfab None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:49.883935 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879abf32-3a32-4918-a459-5c112bdacfab None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:49.884740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879abf32-3a32-4918-a459-5c112bdacfab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:49.885052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879abf32-3a32-4918-a459-5c112bdacfab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:49.886467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879abf32-3a32-4918-a459-5c112bdacfab None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:49.898327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 545/1097] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:54:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:49.904722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fa269-f7cc-4f6e-8b7a-f0dec7032161 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:49.970882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:49.999214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fa269-f7cc-4f6e-8b7a-f0dec7032161 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:50.031491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e31cd4-ae8f-488a-a82f-1af906c1c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:50.032132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e31cd4-ae8f-488a-a82f-1af906c1c693 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:50.032416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e31cd4-ae8f-488a-a82f-1af906c1c693 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:50.032717 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e31cd4-ae8f-488a-a82f-1af906c1c693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:50.033545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e31cd4-ae8f-488a-a82f-1af906c1c693 None admin] RBAC: Adding query filter params (role.id=442af245d352472aa06e68c06a06a576, scope.project.id=311787f32b54485682be669bca9998f8, user.id=5874e98df57242028c0f9983dee3b5e8) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:50.033859 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e31cd4-ae8f-488a-a82f-1af906c1c693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:50.035273 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e31cd4-ae8f-488a-a82f-1af906c1c693 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:50.052686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 553/1098] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:49 2022] GET /identity/v3/role_assignments?user.id=5874e98df57242028c0f9983dee3b5e8&scope.project.id=311787f32b54485682be669bca9998f8&role.id=442af245d352472aa06e68c06a06a576 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:50.603963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed6344-4006-47a5-a9f1-b7c69db04a16 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:50.604288 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed6344-4006-47a5-a9f1-b7c69db04a16 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:50.604568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed6344-4006-47a5-a9f1-b7c69db04a16 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:50.605999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 546/1099] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:50.611418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171400ad-b448-48ba-a0d2-5f7716c8c02c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:50.611710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171400ad-b448-48ba-a0d2-5f7716c8c02c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:50.611998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171400ad-b448-48ba-a0d2-5f7716c8c02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:50.629128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-171400ad-b448-48ba-a0d2-5f7716c8c02c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:50.630304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-171400ad-b448-48ba-a0d2-5f7716c8c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:50.697578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 554/1100] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:50.722019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed6344-4006-47a5-a9f1-b7c69db04a16 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:50.738646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:50.826894 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed6344-4006-47a5-a9f1-b7c69db04a16 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:50.860903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d416bb-ceff-49ee-b8b3-ac1c6cd8397b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:50.861753 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d416bb-ceff-49ee-b8b3-ac1c6cd8397b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:50.861958 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d416bb-ceff-49ee-b8b3-ac1c6cd8397b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:50.862240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d416bb-ceff-49ee-b8b3-ac1c6cd8397b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:50.872834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d416bb-ceff-49ee-b8b3-ac1c6cd8397b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-13d416bb-ceff-49ee-b8b3-ac1c6cd8397b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:54:50.880503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:54:50.881647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:54:50.882546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 547/1101] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:54:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:54:50.888545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171400ad-b448-48ba-a0d2-5f7716c8c02c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:50.951001 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:50.983092 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171400ad-b448-48ba-a0d2-5f7716c8c02c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:51.015913 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eb108-1da7-4336-b625-9079b124af7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:51.016563 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eb108-1da7-4336-b625-9079b124af7f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:51.016875 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eb108-1da7-4336-b625-9079b124af7f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:51.017155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eb108-1da7-4336-b625-9079b124af7f None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:51.017893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458eb108-1da7-4336-b625-9079b124af7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:51.018200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458eb108-1da7-4336-b625-9079b124af7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:51.019578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458eb108-1da7-4336-b625-9079b124af7f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:51.028005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 555/1102] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:51.033701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d416bb-ceff-49ee-b8b3-ac1c6cd8397b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:51.107539 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:51.132223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d416bb-ceff-49ee-b8b3-ac1c6cd8397b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:51.165308 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa624931-9b87-49f3-a4cf-e70d407af177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:51.166170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa624931-9b87-49f3-a4cf-e70d407af177 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:51.166452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa624931-9b87-49f3-a4cf-e70d407af177 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:51.166732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa624931-9b87-49f3-a4cf-e70d407af177 None admin] PATH_INFO: `/v3/users/59284ee7efdf4895923ef51383e01762` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:51.167920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa624931-9b87-49f3-a4cf-e70d407af177 None admin] RBAC: Authorizing `identity:get_user(user_id=59284ee7efdf4895923ef51383e01762)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:51.169954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa624931-9b87-49f3-a4cf-e70d407af177 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:51.171638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 548/1103] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:54:51 2022] GET /identity/v3/users/59284ee7efdf4895923ef51383e01762 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:54:51.177357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eb108-1da7-4336-b625-9079b124af7f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:51.272952 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eb108-1da7-4336-b625-9079b124af7f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:51.298758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:51.311244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc8768-0755-4716-b4b4-d3c962cb2865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:51.318949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc8768-0755-4716-b4b4-d3c962cb2865 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:51.318949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc8768-0755-4716-b4b4-d3c962cb2865 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:51.318949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc8768-0755-4716-b4b4-d3c962cb2865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:51.376832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc8768-0755-4716-b4b4-d3c962cb2865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:51.378254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc8768-0755-4716-b4b4-d3c962cb2865 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:51.470695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 556/1104] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:54:51.476445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa624931-9b87-49f3-a4cf-e70d407af177 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:51.571563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa624931-9b87-49f3-a4cf-e70d407af177 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:51.603492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b6b65-a58d-4fc1-9208-35e5c65b2992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:51.604338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b6b65-a58d-4fc1-9208-35e5c65b2992 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:51.604624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b6b65-a58d-4fc1-9208-35e5c65b2992 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:51.604928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b6b65-a58d-4fc1-9208-35e5c65b2992 None admin] PATH_INFO: `/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:51.606090 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b6b65-a58d-4fc1-9208-35e5c65b2992 None admin] RBAC: Authorizing `identity:get_project(project_id=0c42967bbeb7431d90af9cbbf39b39fd)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:51.608117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b6b65-a58d-4fc1-9208-35e5c65b2992 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:51.609817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 549/1105] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:54:51 2022] GET /identity/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:51.615628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc8768-0755-4716-b4b4-d3c962cb2865 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:51.641300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:51.708990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc8768-0755-4716-b4b4-d3c962cb2865 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:51.742712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb1007-51f7-4c83-805f-843683650c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:51.743295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb1007-51f7-4c83-805f-843683650c04 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:51.743579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb1007-51f7-4c83-805f-843683650c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:51.743857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb1007-51f7-4c83-805f-843683650c04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:51.744698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb1007-51f7-4c83-805f-843683650c04 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=0c42967bbeb7431d90af9cbbf39b39fd, user.id=59284ee7efdf4895923ef51383e01762) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:51.745016 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb1007-51f7-4c83-805f-843683650c04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:51.746425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb1007-51f7-4c83-805f-843683650c04 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:51.752089 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 557/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:51 2022] GET /identity/v3/role_assignments?user.id=59284ee7efdf4895923ef51383e01762&scope.project.id=0c42967bbeb7431d90af9cbbf39b39fd&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:53.760193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f35ae1-560f-4b88-b134-b0a4d3aa09a8 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:53.760744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f35ae1-560f-4b88-b134-b0a4d3aa09a8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:53.760873 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f35ae1-560f-4b88-b134-b0a4d3aa09a8 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:53.762139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 550/1107] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:53.767355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981679c4-4cb1-44dd-9fb3-57fa9a6dfee6 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:53.767756 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981679c4-4cb1-44dd-9fb3-57fa9a6dfee6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:53.767920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981679c4-4cb1-44dd-9fb3-57fa9a6dfee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:53.784975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-981679c4-4cb1-44dd-9fb3-57fa9a6dfee6 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:53.786151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-981679c4-4cb1-44dd-9fb3-57fa9a6dfee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:53.849746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 558/1108] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:53.874408 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f35ae1-560f-4b88-b134-b0a4d3aa09a8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:53.886721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:53.972647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f35ae1-560f-4b88-b134-b0a4d3aa09a8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:54.006221 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b54102-6240-4550-8086-87a31d0440d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:54.006989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b54102-6240-4550-8086-87a31d0440d0 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:54.007270 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b54102-6240-4550-8086-87a31d0440d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:54.007545 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b54102-6240-4550-8086-87a31d0440d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:54.008714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b54102-6240-4550-8086-87a31d0440d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:54.010128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b54102-6240-4550-8086-87a31d0440d0 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:54.011759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 551/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:54:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:54.017736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981679c4-4cb1-44dd-9fb3-57fa9a6dfee6 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:54.040807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:54.111969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981679c4-4cb1-44dd-9fb3-57fa9a6dfee6 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:54.143935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20257c38-323d-4c43-b472-2f11beb4fa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:54.144592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20257c38-323d-4c43-b472-2f11beb4fa58 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:54.144906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20257c38-323d-4c43-b472-2f11beb4fa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:54.145186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20257c38-323d-4c43-b472-2f11beb4fa58 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:54.145894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20257c38-323d-4c43-b472-2f11beb4fa58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:54.147575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20257c38-323d-4c43-b472-2f11beb4fa58 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:54.233861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 559/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:54:54 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:54:56.282579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f926b-1a70-4500-893f-7d037575af63 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:56.283164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f926b-1a70-4500-893f-7d037575af63 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:56.283164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f926b-1a70-4500-893f-7d037575af63 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:56.284515 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 552/1111] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:56.289713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc08be8-6d38-499c-8c3a-4e73844a965e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:56.290109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc08be8-6d38-499c-8c3a-4e73844a965e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:56.290266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc08be8-6d38-499c-8c3a-4e73844a965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:56.306293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2dc08be8-6d38-499c-8c3a-4e73844a965e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:56.307454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2dc08be8-6d38-499c-8c3a-4e73844a965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:56.370547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 560/1112] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:56.394001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f926b-1a70-4500-893f-7d037575af63 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:56.474317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:56.495208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f926b-1a70-4500-893f-7d037575af63 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:56.527637 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea004c-6b33-4825-b8f4-1feee286db06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:56.529092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea004c-6b33-4825-b8f4-1feee286db06 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:56.529375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea004c-6b33-4825-b8f4-1feee286db06 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:56.529650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea004c-6b33-4825-b8f4-1feee286db06 None admin] PATH_INFO: `/v3/roles/aa5b9dc3549b47aaabedcc3d727351c0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:56.531113 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea004c-6b33-4825-b8f4-1feee286db06 None admin] RBAC: Authorizing `identity:get_role(role_id=aa5b9dc3549b47aaabedcc3d727351c0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:56.532476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea004c-6b33-4825-b8f4-1feee286db06 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:56.533865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 553/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:54:56 2022] GET /identity/v3/roles/aa5b9dc3549b47aaabedcc3d727351c0 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:56.539413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc08be8-6d38-499c-8c3a-4e73844a965e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:56.549151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:56.637277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc08be8-6d38-499c-8c3a-4e73844a965e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:56.670051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf8fca-9a1d-41f4-9a4b-82045fff611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:56.670903 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf8fca-9a1d-41f4-9a4b-82045fff611c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:56.671188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf8fca-9a1d-41f4-9a4b-82045fff611c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:56.671467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf8fca-9a1d-41f4-9a4b-82045fff611c None admin] PATH_INFO: `/v3/users/056f889f57784b26a5a0731435f6e0d3` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:56.684104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf8fca-9a1d-41f4-9a4b-82045fff611c None admin] RBAC: Authorizing `identity:get_user(user_id=056f889f57784b26a5a0731435f6e0d3)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:56.686100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf8fca-9a1d-41f4-9a4b-82045fff611c None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:56.687720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 561/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:54:56 2022] GET /identity/v3/users/056f889f57784b26a5a0731435f6e0d3 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:56.693448 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea004c-6b33-4825-b8f4-1feee286db06 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:56.790634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea004c-6b33-4825-b8f4-1feee286db06 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:56.822687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c42c8-a470-44da-a0c3-d9f96e811d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:56.823324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c42c8-a470-44da-a0c3-d9f96e811d6f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:56.823609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c42c8-a470-44da-a0c3-d9f96e811d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:56.823887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c42c8-a470-44da-a0c3-d9f96e811d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:56.838792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:56.887213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c42c8-a470-44da-a0c3-d9f96e811d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:56.889334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c42c8-a470-44da-a0c3-d9f96e811d6f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:56.983040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 554/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:54:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:54:56.988753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf8fca-9a1d-41f4-9a4b-82045fff611c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:57.052856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:57.085979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf8fca-9a1d-41f4-9a4b-82045fff611c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:57.118523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf6b62-e310-4215-8917-a6ad2249c504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:57.119370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf6b62-e310-4215-8917-a6ad2249c504 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:57.119654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf6b62-e310-4215-8917-a6ad2249c504 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:57.119931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf6b62-e310-4215-8917-a6ad2249c504 None admin] PATH_INFO: `/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:57.121123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf6b62-e310-4215-8917-a6ad2249c504 None admin] RBAC: Authorizing `identity:get_project(project_id=0c42967bbeb7431d90af9cbbf39b39fd)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:57.123162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf6b62-e310-4215-8917-a6ad2249c504 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:57.124876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 562/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:54:56 2022] GET /identity/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:57.130870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c42c8-a470-44da-a0c3-d9f96e811d6f None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:57.175392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:57.225631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c42c8-a470-44da-a0c3-d9f96e811d6f None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:57.258516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065adf69-e5c6-43bc-bdff-4c1fe642e3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:57.259156 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065adf69-e5c6-43bc-bdff-4c1fe642e3eb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:57.259438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065adf69-e5c6-43bc-bdff-4c1fe642e3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:57.259713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065adf69-e5c6-43bc-bdff-4c1fe642e3eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:57.260531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065adf69-e5c6-43bc-bdff-4c1fe642e3eb None admin] RBAC: Adding query filter params (role.id=aa5b9dc3549b47aaabedcc3d727351c0, scope.project.id=0c42967bbeb7431d90af9cbbf39b39fd, user.id=056f889f57784b26a5a0731435f6e0d3) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:54:57.260868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065adf69-e5c6-43bc-bdff-4c1fe642e3eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:57.262281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065adf69-e5c6-43bc-bdff-4c1fe642e3eb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:57.267527 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 555/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:54:57 2022] GET /identity/v3/role_assignments?user.id=056f889f57784b26a5a0731435f6e0d3&scope.project.id=0c42967bbeb7431d90af9cbbf39b39fd&role.id=aa5b9dc3549b47aaabedcc3d727351c0 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:59.237436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0df67-0012-4591-aaa3-0e835c75606f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:59.237975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0df67-0012-4591-aaa3-0e835c75606f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:59.237975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0df67-0012-4591-aaa3-0e835c75606f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:59.239343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 563/1118] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:54:59.244386 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805c218-1fb2-4b3e-a881-bfdff1a8812e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:59.244839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805c218-1fb2-4b3e-a881-bfdff1a8812e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:59.244974 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805c218-1fb2-4b3e-a881-bfdff1a8812e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:59.261242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4805c218-1fb2-4b3e-a881-bfdff1a8812e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:54:59.262922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4805c218-1fb2-4b3e-a881-bfdff1a8812e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:54:59.327209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 556/1119] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:54:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:54:59.350158 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0df67-0012-4591-aaa3-0e835c75606f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:59.446610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0df67-0012-4591-aaa3-0e835c75606f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:59.479301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d244ae-68f7-49f3-97d6-206408312b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:59.480137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d244ae-68f7-49f3-97d6-206408312b04 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:59.480426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d244ae-68f7-49f3-97d6-206408312b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:59.480732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d244ae-68f7-49f3-97d6-206408312b04 None admin] PATH_INFO: `/v3/roles/aa5b9dc3549b47aaabedcc3d727351c0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:59.482235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d244ae-68f7-49f3-97d6-206408312b04 None admin] RBAC: Authorizing `identity:get_role(role_id=aa5b9dc3549b47aaabedcc3d727351c0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:59.483598 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d244ae-68f7-49f3-97d6-206408312b04 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:59.484971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 564/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:54:59 2022] GET /identity/v3/roles/aa5b9dc3549b47aaabedcc3d727351c0 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:59.490934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805c218-1fb2-4b3e-a881-bfdff1a8812e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:59.531253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:59.585920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805c218-1fb2-4b3e-a881-bfdff1a8812e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:59.618695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a2f38-6aad-4ae3-9520-94ef977826b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:59.619493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a2f38-6aad-4ae3-9520-94ef977826b7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:59.619774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a2f38-6aad-4ae3-9520-94ef977826b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:59.620047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a2f38-6aad-4ae3-9520-94ef977826b7 None admin] PATH_INFO: `/v3/users/056f889f57784b26a5a0731435f6e0d3` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:59.621299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a2f38-6aad-4ae3-9520-94ef977826b7 None admin] RBAC: Authorizing `identity:get_user(user_id=056f889f57784b26a5a0731435f6e0d3)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:59.623250 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a2f38-6aad-4ae3-9520-94ef977826b7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:59.624875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 557/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:54:59 2022] GET /identity/v3/users/056f889f57784b26a5a0731435f6e0d3 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:59.630857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d244ae-68f7-49f3-97d6-206408312b04 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:59.633652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:59.727806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d244ae-68f7-49f3-97d6-206408312b04 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:59.759772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2faccb-4e25-4f5d-bdf8-63e2f7d431d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:59.760608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2faccb-4e25-4f5d-bdf8-63e2f7d431d5 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:59.761097 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2faccb-4e25-4f5d-bdf8-63e2f7d431d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:59.761382 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2faccb-4e25-4f5d-bdf8-63e2f7d431d5 None admin] PATH_INFO: `/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:59.762580 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2faccb-4e25-4f5d-bdf8-63e2f7d431d5 None admin] RBAC: Authorizing `identity:get_project(project_id=0c42967bbeb7431d90af9cbbf39b39fd)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:59.763988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2faccb-4e25-4f5d-bdf8-63e2f7d431d5 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:59.765683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 565/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:54:59 2022] GET /identity/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:59.771657 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a2f38-6aad-4ae3-9520-94ef977826b7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:54:59.872276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a2f38-6aad-4ae3-9520-94ef977826b7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:54:59.880927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:59.904938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a1a0e-3c97-49a8-af1a-22218b58f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:54:59.905821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a1a0e-3c97-49a8-af1a-22218b58f63b None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:54:59.906107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a1a0e-3c97-49a8-af1a-22218b58f63b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:54:59.906388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a1a0e-3c97-49a8-af1a-22218b58f63b None admin] PATH_INFO: `/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd/users/056f889f57784b26a5a0731435f6e0d3/roles/aa5b9dc3549b47aaabedcc3d727351c0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:54:59.908595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a1a0e-3c97-49a8-af1a-22218b58f63b None admin] RBAC: Authorizing `identity:create_grant(project_id=0c42967bbeb7431d90af9cbbf39b39fd, user_id=056f889f57784b26a5a0731435f6e0d3, role_id=aa5b9dc3549b47aaabedcc3d727351c0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:54:59.910038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a1a0e-3c97-49a8-af1a-22218b58f63b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:54:59.976073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 558/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:54:59 2022] PUT /identity/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd/users/056f889f57784b26a5a0731435f6e0d3/roles/aa5b9dc3549b47aaabedcc3d727351c0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:55:01.968062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0331c-ffdf-4ee1-944f-d085de86786f None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:01.968612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0331c-ffdf-4ee1-944f-d085de86786f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:01.968612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0331c-ffdf-4ee1-944f-d085de86786f None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:01.969990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 566/1124] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:01.975111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649fd55-bfc8-4dec-93b0-f378c1efc143 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:01.975497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649fd55-bfc8-4dec-93b0-f378c1efc143 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:01.975664 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649fd55-bfc8-4dec-93b0-f378c1efc143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:01.991347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8649fd55-bfc8-4dec-93b0-f378c1efc143 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:01.992511 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8649fd55-bfc8-4dec-93b0-f378c1efc143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:02.056116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 559/1125] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:02.080723 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0331c-ffdf-4ee1-944f-d085de86786f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:02.149502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:02.179027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0331c-ffdf-4ee1-944f-d085de86786f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:02.211849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd1dbf-f581-4ed5-b1b3-349e7122a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:02.212707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd1dbf-f581-4ed5-b1b3-349e7122a732 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:02.212989 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd1dbf-f581-4ed5-b1b3-349e7122a732 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:02.213265 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd1dbf-f581-4ed5-b1b3-349e7122a732 None admin] PATH_INFO: `/v3/roles/aa5b9dc3549b47aaabedcc3d727351c0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:02.214714 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd1dbf-f581-4ed5-b1b3-349e7122a732 None admin] RBAC: Authorizing `identity:get_role(role_id=aa5b9dc3549b47aaabedcc3d727351c0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:02.216066 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd1dbf-f581-4ed5-b1b3-349e7122a732 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:02.217438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 567/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:55:02 2022] GET /identity/v3/roles/aa5b9dc3549b47aaabedcc3d727351c0 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:02.223242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649fd55-bfc8-4dec-93b0-f378c1efc143 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:02.314840 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:02.318210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649fd55-bfc8-4dec-93b0-f378c1efc143 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:02.350455 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479969a-3281-4ed8-9c81-e54bb843f0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:02.351311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479969a-3281-4ed8-9c81-e54bb843f0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:02.351589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479969a-3281-4ed8-9c81-e54bb843f0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:02.351860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479969a-3281-4ed8-9c81-e54bb843f0a8 None admin] PATH_INFO: `/v3/users/056f889f57784b26a5a0731435f6e0d3` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:02.353041 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479969a-3281-4ed8-9c81-e54bb843f0a8 None admin] RBAC: Authorizing `identity:get_user(user_id=056f889f57784b26a5a0731435f6e0d3)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:02.354467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479969a-3281-4ed8-9c81-e54bb843f0a8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:02.356590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 560/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:55:02 2022] GET /identity/v3/users/056f889f57784b26a5a0731435f6e0d3 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:02.362295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd1dbf-f581-4ed5-b1b3-349e7122a732 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:02.456950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd1dbf-f581-4ed5-b1b3-349e7122a732 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:02.489554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f11a68-f9d5-4d8c-8cc1-62049f45e1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:02.490157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11a68-f9d5-4d8c-8cc1-62049f45e1ae None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:02.490446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11a68-f9d5-4d8c-8cc1-62049f45e1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:02.490723 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11a68-f9d5-4d8c-8cc1-62049f45e1ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:02.498991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:02.555033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f11a68-f9d5-4d8c-8cc1-62049f45e1ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:02.556463 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f11a68-f9d5-4d8c-8cc1-62049f45e1ae None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:02.648945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 568/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:55:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:55:02.655534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479969a-3281-4ed8-9c81-e54bb843f0a8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:02.751206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479969a-3281-4ed8-9c81-e54bb843f0a8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:02.786091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877e86a-0cc2-4c44-87be-c219542757d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:02.786940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877e86a-0cc2-4c44-87be-c219542757d4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:02.787225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877e86a-0cc2-4c44-87be-c219542757d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:02.787502 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877e86a-0cc2-4c44-87be-c219542757d4 None admin] PATH_INFO: `/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:02.788786 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877e86a-0cc2-4c44-87be-c219542757d4 None admin] RBAC: Authorizing `identity:get_project(project_id=0c42967bbeb7431d90af9cbbf39b39fd)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:02.790221 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877e86a-0cc2-4c44-87be-c219542757d4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:02.791931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 561/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:55:02 2022] GET /identity/v3/projects/0c42967bbeb7431d90af9cbbf39b39fd => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:02.798509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f11a68-f9d5-4d8c-8cc1-62049f45e1ae None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:02.835021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:02.891177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f11a68-f9d5-4d8c-8cc1-62049f45e1ae None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:02.923997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db394f-59a1-4b3f-a9cf-a5fd35da8a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:02.924631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db394f-59a1-4b3f-a9cf-a5fd35da8a66 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:02.924944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db394f-59a1-4b3f-a9cf-a5fd35da8a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:02.925219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db394f-59a1-4b3f-a9cf-a5fd35da8a66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:02.926034 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db394f-59a1-4b3f-a9cf-a5fd35da8a66 None admin] RBAC: Adding query filter params (role.id=aa5b9dc3549b47aaabedcc3d727351c0, scope.project.id=0c42967bbeb7431d90af9cbbf39b39fd, user.id=056f889f57784b26a5a0731435f6e0d3) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:02.926345 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db394f-59a1-4b3f-a9cf-a5fd35da8a66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:02.927738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db394f-59a1-4b3f-a9cf-a5fd35da8a66 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:02.933308 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 569/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:55:02 2022] GET /identity/v3/role_assignments?user.id=056f889f57784b26a5a0731435f6e0d3&scope.project.id=0c42967bbeb7431d90af9cbbf39b39fd&role.id=aa5b9dc3549b47aaabedcc3d727351c0 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:04.942521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf07de8-e51a-414d-8dc7-a8a75e73db8c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:04.943076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf07de8-e51a-414d-8dc7-a8a75e73db8c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:04.943076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf07de8-e51a-414d-8dc7-a8a75e73db8c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:04.944487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 562/1131] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:04.950228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3c680-33de-4327-a9c8-e2d5ecf09f4b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:04.950656 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3c680-33de-4327-a9c8-e2d5ecf09f4b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:04.950833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3c680-33de-4327-a9c8-e2d5ecf09f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:04.966907 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-27b3c680-33de-4327-a9c8-e2d5ecf09f4b None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:04.968065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-27b3c680-33de-4327-a9c8-e2d5ecf09f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:05.030462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 570/1132] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:05.052811 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf07de8-e51a-414d-8dc7-a8a75e73db8c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:05.087999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:05.151952 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf07de8-e51a-414d-8dc7-a8a75e73db8c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:05.184534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a10315-e3f1-49b6-8960-c3b4d4121965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:05.185338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a10315-e3f1-49b6-8960-c3b4d4121965 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:05.185624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a10315-e3f1-49b6-8960-c3b4d4121965 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:05.185901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a10315-e3f1-49b6-8960-c3b4d4121965 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:05.187067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a10315-e3f1-49b6-8960-c3b4d4121965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:05.188483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a10315-e3f1-49b6-8960-c3b4d4121965 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:05.190138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 563/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:05.196058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3c680-33de-4327-a9c8-e2d5ecf09f4b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:05.237427 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:05.306986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3c680-33de-4327-a9c8-e2d5ecf09f4b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:05.340816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979ccd7-8b84-4ed2-bbd4-5ac01eead275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:05.341477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979ccd7-8b84-4ed2-bbd4-5ac01eead275 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:05.341764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979ccd7-8b84-4ed2-bbd4-5ac01eead275 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:05.342043 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979ccd7-8b84-4ed2-bbd4-5ac01eead275 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:05.342744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979ccd7-8b84-4ed2-bbd4-5ac01eead275 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:05.344192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979ccd7-8b84-4ed2-bbd4-5ac01eead275 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:05.460960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 571/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:55:05 2022] POST /identity/v3/projects => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:55:07.502909 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a6f24-a9f4-4120-8619-3bc1207564c8 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:07.503457 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a6f24-a9f4-4120-8619-3bc1207564c8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:07.503457 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a6f24-a9f4-4120-8619-3bc1207564c8 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:07.504889 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 564/1135] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:07.509895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8a332-2841-4582-b974-bc6d519691e5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:07.510291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8a332-2841-4582-b974-bc6d519691e5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:07.510453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8a332-2841-4582-b974-bc6d519691e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:07.527318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-79c8a332-2841-4582-b974-bc6d519691e5 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:07.529192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-79c8a332-2841-4582-b974-bc6d519691e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:07.592018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 572/1136] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:07.616648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a6f24-a9f4-4120-8619-3bc1207564c8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:07.718247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a6f24-a9f4-4120-8619-3bc1207564c8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:07.719714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:07.751880 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89eab7-19e2-40d8-a575-a7fa0ac7cd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:07.752652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89eab7-19e2-40d8-a575-a7fa0ac7cd3a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:07.753013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89eab7-19e2-40d8-a575-a7fa0ac7cd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:07.753242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89eab7-19e2-40d8-a575-a7fa0ac7cd3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:07.754403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89eab7-19e2-40d8-a575-a7fa0ac7cd3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:07.755822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89eab7-19e2-40d8-a575-a7fa0ac7cd3a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:07.757462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 565/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:07.763257 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8a332-2841-4582-b974-bc6d519691e5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:07.778000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:07.857062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8a332-2841-4582-b974-bc6d519691e5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:07.890794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954a4e4-2d91-43a6-8660-5178cad62a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:07.891453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954a4e4-2d91-43a6-8660-5178cad62a72 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:07.891731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954a4e4-2d91-43a6-8660-5178cad62a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:07.892001 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954a4e4-2d91-43a6-8660-5178cad62a72 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:07.892715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954a4e4-2d91-43a6-8660-5178cad62a72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:07.894119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954a4e4-2d91-43a6-8660-5178cad62a72 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:07.985509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 573/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:55:07 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:55:10.029740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dfc8f-d0e7-401f-818a-52ca140ea917 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:10.030296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dfc8f-d0e7-401f-818a-52ca140ea917 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:10.030296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dfc8f-d0e7-401f-818a-52ca140ea917 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:10.031672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 566/1139] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:10.036877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09c16a-04c8-4e08-a0fc-49875ecee108 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:10.037294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09c16a-04c8-4e08-a0fc-49875ecee108 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:10.037432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09c16a-04c8-4e08-a0fc-49875ecee108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:10.054006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2e09c16a-04c8-4e08-a0fc-49875ecee108 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:10.055169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2e09c16a-04c8-4e08-a0fc-49875ecee108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:10.114870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:10.119286 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 574/1140] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:10.142700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dfc8f-d0e7-401f-818a-52ca140ea917 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:10.240600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dfc8f-d0e7-401f-818a-52ca140ea917 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:10.272616 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee3805-4c23-4c70-93d3-c9175557f378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:10.273423 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee3805-4c23-4c70-93d3-c9175557f378 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:10.273707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee3805-4c23-4c70-93d3-c9175557f378 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:10.273986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee3805-4c23-4c70-93d3-c9175557f378 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:10.284223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee3805-4c23-4c70-93d3-c9175557f378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-48ee3805-4c23-4c70-93d3-c9175557f378 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:55:10.291758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:10.293507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:55:10.294611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 567/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:55:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:10.299536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09c16a-04c8-4e08-a0fc-49875ecee108 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:10.390410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09c16a-04c8-4e08-a0fc-49875ecee108 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:10.422796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30aa5c8-3c6d-4d13-af8d-d248b00325bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:10.423441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30aa5c8-3c6d-4d13-af8d-d248b00325bd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:10.423722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30aa5c8-3c6d-4d13-af8d-d248b00325bd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:10.423999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30aa5c8-3c6d-4d13-af8d-d248b00325bd None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:10.424763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30aa5c8-3c6d-4d13-af8d-d248b00325bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:10.425070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30aa5c8-3c6d-4d13-af8d-d248b00325bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:10.426420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30aa5c8-3c6d-4d13-af8d-d248b00325bd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:10.434006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 575/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:55:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:10.439680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee3805-4c23-4c70-93d3-c9175557f378 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:10.469379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:10.536687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee3805-4c23-4c70-93d3-c9175557f378 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:10.567996 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09217478-76f5-4e4d-94f7-51e31512de97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:10.568867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09217478-76f5-4e4d-94f7-51e31512de97 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:10.569150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09217478-76f5-4e4d-94f7-51e31512de97 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:10.569425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09217478-76f5-4e4d-94f7-51e31512de97 None admin] PATH_INFO: `/v3/users/c16bfeeec8a8423f82b1d873050e9df0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:10.583541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09217478-76f5-4e4d-94f7-51e31512de97 None admin] RBAC: Authorizing `identity:get_user(user_id=c16bfeeec8a8423f82b1d873050e9df0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:10.584990 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09217478-76f5-4e4d-94f7-51e31512de97 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:10.586629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 568/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:55:10 2022] GET /identity/v3/users/c16bfeeec8a8423f82b1d873050e9df0 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:10.592995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30aa5c8-3c6d-4d13-af8d-d248b00325bd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:10.650326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:10.686464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30aa5c8-3c6d-4d13-af8d-d248b00325bd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:10.718447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4e436-8083-4a26-ba97-00bdf7206e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:10.719075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4e436-8083-4a26-ba97-00bdf7206e56 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:10.719359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4e436-8083-4a26-ba97-00bdf7206e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:10.719636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4e436-8083-4a26-ba97-00bdf7206e56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:10.782486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4e436-8083-4a26-ba97-00bdf7206e56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:10.783902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4e436-8083-4a26-ba97-00bdf7206e56 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:10.842044 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:10.879890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 576/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:55:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:55:10.885620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09217478-76f5-4e4d-94f7-51e31512de97 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:10.969286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:10.980574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09217478-76f5-4e4d-94f7-51e31512de97 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:11.013570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7ebd-661e-4d4d-8038-c4dfca6e51ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:11.014408 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7ebd-661e-4d4d-8038-c4dfca6e51ac None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:11.014688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7ebd-661e-4d4d-8038-c4dfca6e51ac None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:11.014960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7ebd-661e-4d4d-8038-c4dfca6e51ac None admin] PATH_INFO: `/v3/projects/9d2e42277672458a813496fbfa63ca05` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:11.016109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb7ebd-661e-4d4d-8038-c4dfca6e51ac None admin] RBAC: Authorizing `identity:get_project(project_id=9d2e42277672458a813496fbfa63ca05)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:11.017547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb7ebd-661e-4d4d-8038-c4dfca6e51ac None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:11.019231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 569/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:55:10 2022] GET /identity/v3/projects/9d2e42277672458a813496fbfa63ca05 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:11.025596 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4e436-8083-4a26-ba97-00bdf7206e56 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:11.119871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4e436-8083-4a26-ba97-00bdf7206e56 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:11.152865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790fb08-d68a-4d39-9a1b-3d1ef3d98e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:11.153509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790fb08-d68a-4d39-9a1b-3d1ef3d98e0d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:11.153790 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790fb08-d68a-4d39-9a1b-3d1ef3d98e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:11.154064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790fb08-d68a-4d39-9a1b-3d1ef3d98e0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:11.154888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790fb08-d68a-4d39-9a1b-3d1ef3d98e0d None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=9d2e42277672458a813496fbfa63ca05, user.id=c16bfeeec8a8423f82b1d873050e9df0) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:11.155198 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790fb08-d68a-4d39-9a1b-3d1ef3d98e0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:11.156611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790fb08-d68a-4d39-9a1b-3d1ef3d98e0d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:11.161846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 577/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:55:11 2022] GET /identity/v3/role_assignments?user.id=c16bfeeec8a8423f82b1d873050e9df0&scope.project.id=9d2e42277672458a813496fbfa63ca05&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:13.153956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a631d-bf3a-4c94-8e3c-60c632a62f13 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:13.154427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a631d-bf3a-4c94-8e3c-60c632a62f13 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:13.154539 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a631d-bf3a-4c94-8e3c-60c632a62f13 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:13.155880 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 570/1147] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:13.161048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfef92c-cf92-46c1-90d9-f28786399361 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:13.161439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfef92c-cf92-46c1-90d9-f28786399361 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:13.161615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfef92c-cf92-46c1-90d9-f28786399361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:13.179072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3bfef92c-cf92-46c1-90d9-f28786399361 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:13.180252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3bfef92c-cf92-46c1-90d9-f28786399361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:13.199213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:13.243102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 578/1148] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:13.265541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a631d-bf3a-4c94-8e3c-60c632a62f13 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:13.362379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a631d-bf3a-4c94-8e3c-60c632a62f13 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:13.393636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6061f9-0d21-4893-915b-5ab06c0d28a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:13.394399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6061f9-0d21-4893-915b-5ab06c0d28a2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:13.394680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6061f9-0d21-4893-915b-5ab06c0d28a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:13.394953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6061f9-0d21-4893-915b-5ab06c0d28a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:13.405316 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6061f9-0d21-4893-915b-5ab06c0d28a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-5b6061f9-0d21-4893-915b-5ab06c0d28a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:55:13.412800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:13.413890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:55:13.415106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 571/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:55:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:13.420298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfef92c-cf92-46c1-90d9-f28786399361 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:13.513498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfef92c-cf92-46c1-90d9-f28786399361 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:13.545759 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45569a9c-3067-4ca2-9536-4e5af6e2a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:13.546406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45569a9c-3067-4ca2-9536-4e5af6e2a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:13.546689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45569a9c-3067-4ca2-9536-4e5af6e2a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:13.546967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45569a9c-3067-4ca2-9536-4e5af6e2a3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:13.547704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45569a9c-3067-4ca2-9536-4e5af6e2a3c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:13.548012 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45569a9c-3067-4ca2-9536-4e5af6e2a3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:13.549393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45569a9c-3067-4ca2-9536-4e5af6e2a3c2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:13.557052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 579/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:55:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:13.562448 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6061f9-0d21-4893-915b-5ab06c0d28a2 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:13.580633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:13.659527 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6061f9-0d21-4893-915b-5ab06c0d28a2 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:13.690881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35db453-ab7c-40bf-9807-6e73f609019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:13.691728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35db453-ab7c-40bf-9807-6e73f609019d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:13.692008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35db453-ab7c-40bf-9807-6e73f609019d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:13.692281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35db453-ab7c-40bf-9807-6e73f609019d None admin] PATH_INFO: `/v3/users/c16bfeeec8a8423f82b1d873050e9df0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:13.693473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35db453-ab7c-40bf-9807-6e73f609019d None admin] RBAC: Authorizing `identity:get_user(user_id=c16bfeeec8a8423f82b1d873050e9df0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:13.694888 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35db453-ab7c-40bf-9807-6e73f609019d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:13.696486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 572/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:55:13 2022] GET /identity/v3/users/c16bfeeec8a8423f82b1d873050e9df0 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:13.702692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45569a9c-3067-4ca2-9536-4e5af6e2a3c2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:13.721778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:13.797302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45569a9c-3067-4ca2-9536-4e5af6e2a3c2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:13.829196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6fd0e-36fa-4d0f-9dbe-d6bcb4d33fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:13.830038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6fd0e-36fa-4d0f-9dbe-d6bcb4d33fee None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:13.830318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6fd0e-36fa-4d0f-9dbe-d6bcb4d33fee None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:13.830590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6fd0e-36fa-4d0f-9dbe-d6bcb4d33fee None admin] PATH_INFO: `/v3/projects/9d2e42277672458a813496fbfa63ca05` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:13.831754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6fd0e-36fa-4d0f-9dbe-d6bcb4d33fee None admin] RBAC: Authorizing `identity:get_project(project_id=9d2e42277672458a813496fbfa63ca05)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:13.833202 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6fd0e-36fa-4d0f-9dbe-d6bcb4d33fee None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:13.834850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 580/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:55:13 2022] GET /identity/v3/projects/9d2e42277672458a813496fbfa63ca05 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:13.841301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35db453-ab7c-40bf-9807-6e73f609019d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:13.921627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:13.936897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35db453-ab7c-40bf-9807-6e73f609019d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:13.968970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5792d-d18b-4dc9-be55-2c611de79e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:13.969836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5792d-d18b-4dc9-be55-2c611de79e60 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:13.970120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5792d-d18b-4dc9-be55-2c611de79e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:13.970395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5792d-d18b-4dc9-be55-2c611de79e60 None admin] PATH_INFO: `/v3/projects/9d2e42277672458a813496fbfa63ca05/users/c16bfeeec8a8423f82b1d873050e9df0/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:13.972328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5792d-d18b-4dc9-be55-2c611de79e60 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d2e42277672458a813496fbfa63ca05, user_id=c16bfeeec8a8423f82b1d873050e9df0, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:13.973769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5792d-d18b-4dc9-be55-2c611de79e60 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:14.084766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 573/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:55:13 2022] PUT /identity/v3/projects/9d2e42277672458a813496fbfa63ca05/users/c16bfeeec8a8423f82b1d873050e9df0/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:55:16.070515 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8197b1e-6a04-48b6-bf8b-240b89d27f98 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:16.071095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8197b1e-6a04-48b6-bf8b-240b89d27f98 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:16.071095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8197b1e-6a04-48b6-bf8b-240b89d27f98 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:16.072415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 581/1154] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:16.078084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38fa2d-fbca-4a44-84d7-ae88a4400996 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:16.078942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38fa2d-fbca-4a44-84d7-ae88a4400996 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:16.079988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38fa2d-fbca-4a44-84d7-ae88a4400996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:16.096833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4a38fa2d-fbca-4a44-84d7-ae88a4400996 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:16.098088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4a38fa2d-fbca-4a44-84d7-ae88a4400996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:16.165286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 574/1155] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:16.189575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8197b1e-6a04-48b6-bf8b-240b89d27f98 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:16.274885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:16.290176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8197b1e-6a04-48b6-bf8b-240b89d27f98 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:16.322271 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c8e25-622b-4eab-ab60-30f02bbcc2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:16.322995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8e25-622b-4eab-ab60-30f02bbcc2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:16.323278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8e25-622b-4eab-ab60-30f02bbcc2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:16.323554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8e25-622b-4eab-ab60-30f02bbcc2c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:16.333105 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c8e25-622b-4eab-ab60-30f02bbcc2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-3a9c8e25-622b-4eab-ab60-30f02bbcc2c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:55:16.341168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:16.342268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:55:16.343329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 582/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:55:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:16.348484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38fa2d-fbca-4a44-84d7-ae88a4400996 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:16.420235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:16.443821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38fa2d-fbca-4a44-84d7-ae88a4400996 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:16.476826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289883b-af30-46ce-baf9-3c5f7b416443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:16.477481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289883b-af30-46ce-baf9-3c5f7b416443 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:16.477767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289883b-af30-46ce-baf9-3c5f7b416443 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:16.478081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289883b-af30-46ce-baf9-3c5f7b416443 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:16.478782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289883b-af30-46ce-baf9-3c5f7b416443 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:16.479091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289883b-af30-46ce-baf9-3c5f7b416443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:16.481040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289883b-af30-46ce-baf9-3c5f7b416443 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:16.488923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 575/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:55:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:16.494323 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c8e25-622b-4eab-ab60-30f02bbcc2c0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:16.590571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c8e25-622b-4eab-ab60-30f02bbcc2c0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:16.622071 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca3342-0388-445b-a1d4-a25ec7ffb585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:16.622919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca3342-0388-445b-a1d4-a25ec7ffb585 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:16.623204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca3342-0388-445b-a1d4-a25ec7ffb585 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:16.623480 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca3342-0388-445b-a1d4-a25ec7ffb585 None admin] PATH_INFO: `/v3/users/c16bfeeec8a8423f82b1d873050e9df0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:16.624651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca3342-0388-445b-a1d4-a25ec7ffb585 None admin] RBAC: Authorizing `identity:get_user(user_id=c16bfeeec8a8423f82b1d873050e9df0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:16.626096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca3342-0388-445b-a1d4-a25ec7ffb585 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:16.627683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 583/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:55:16 2022] GET /identity/v3/users/c16bfeeec8a8423f82b1d873050e9df0 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:16.633095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289883b-af30-46ce-baf9-3c5f7b416443 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:16.730129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289883b-af30-46ce-baf9-3c5f7b416443 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:16.762202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a7c06-7ed0-42aa-abc7-07b3b4ac5f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:16.762837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7c06-7ed0-42aa-abc7-07b3b4ac5f06 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:16.763122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7c06-7ed0-42aa-abc7-07b3b4ac5f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:16.763400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7c06-7ed0-42aa-abc7-07b3b4ac5f06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:16.766797 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:16.828214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a7c06-7ed0-42aa-abc7-07b3b4ac5f06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:16.829678 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a7c06-7ed0-42aa-abc7-07b3b4ac5f06 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:16.925377 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 576/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:55:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:55:16.931162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca3342-0388-445b-a1d4-a25ec7ffb585 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:16.946995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:17.026815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca3342-0388-445b-a1d4-a25ec7ffb585 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:17.058787 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448dc0f-b10a-483e-8837-04ff0a84f471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:17.059631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448dc0f-b10a-483e-8837-04ff0a84f471 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:17.059913 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448dc0f-b10a-483e-8837-04ff0a84f471 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:17.060190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448dc0f-b10a-483e-8837-04ff0a84f471 None admin] PATH_INFO: `/v3/projects/9d2e42277672458a813496fbfa63ca05` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:17.061377 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448dc0f-b10a-483e-8837-04ff0a84f471 None admin] RBAC: Authorizing `identity:get_project(project_id=9d2e42277672458a813496fbfa63ca05)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:17.062790 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448dc0f-b10a-483e-8837-04ff0a84f471 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:17.064462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 584/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:55:16 2022] GET /identity/v3/projects/9d2e42277672458a813496fbfa63ca05 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:17.070373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a7c06-7ed0-42aa-abc7-07b3b4ac5f06 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:17.103421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:17.165942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a7c06-7ed0-42aa-abc7-07b3b4ac5f06 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:17.199530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb4751-70e5-4613-b73e-63af7d737ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:17.200118 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb4751-70e5-4613-b73e-63af7d737ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:17.200400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb4751-70e5-4613-b73e-63af7d737ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:17.200693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb4751-70e5-4613-b73e-63af7d737ab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:17.201516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb4751-70e5-4613-b73e-63af7d737ab2 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=9d2e42277672458a813496fbfa63ca05, user.id=c16bfeeec8a8423f82b1d873050e9df0) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:17.201827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb4751-70e5-4613-b73e-63af7d737ab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:17.203250 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb4751-70e5-4613-b73e-63af7d737ab2 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:17.208889 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 577/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:55:17 2022] GET /identity/v3/role_assignments?user.id=c16bfeeec8a8423f82b1d873050e9df0&scope.project.id=9d2e42277672458a813496fbfa63ca05&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:19.217414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc1868-9463-4c11-bece-1b84cbb67441 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:19.217924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc1868-9463-4c11-bece-1b84cbb67441 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:19.218015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc1868-9463-4c11-bece-1b84cbb67441 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:19.219306 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 585/1162] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:19.224448 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94996bbf-7712-4a17-a30d-d630e3965cdd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:19.224896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94996bbf-7712-4a17-a30d-d630e3965cdd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:19.225023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94996bbf-7712-4a17-a30d-d630e3965cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:19.241662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-94996bbf-7712-4a17-a30d-d630e3965cdd None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:19.242829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-94996bbf-7712-4a17-a30d-d630e3965cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:19.307732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 578/1163] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:19.330346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc1868-9463-4c11-bece-1b84cbb67441 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:19.409460 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:19.427721 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc1868-9463-4c11-bece-1b84cbb67441 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:19.459364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd492bcd-c4dc-4a40-98b0-ed6dc772fc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:19.459994 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd492bcd-c4dc-4a40-98b0-ed6dc772fc49 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:19.460280 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd492bcd-c4dc-4a40-98b0-ed6dc772fc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:19.460559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd492bcd-c4dc-4a40-98b0-ed6dc772fc49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:19.524424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd492bcd-c4dc-4a40-98b0-ed6dc772fc49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:19.526050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd492bcd-c4dc-4a40-98b0-ed6dc772fc49 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:19.601136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:19.619521 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 586/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:55:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:55:19.625991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94996bbf-7712-4a17-a30d-d630e3965cdd None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:19.654504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:19.721461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94996bbf-7712-4a17-a30d-d630e3965cdd None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:19.754164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08879b-ae6d-46c4-95ad-30dc334dd1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:19.754945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08879b-ae6d-46c4-95ad-30dc334dd1eb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:19.755226 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08879b-ae6d-46c4-95ad-30dc334dd1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:19.755497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08879b-ae6d-46c4-95ad-30dc334dd1eb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:19.761860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08879b-ae6d-46c4-95ad-30dc334dd1eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:19.763290 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08879b-ae6d-46c4-95ad-30dc334dd1eb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-5a08879b-ae6d-46c4-95ad-30dc334dd1eb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:19.777187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:19.778370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:55:19.779240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 579/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 23 12:55:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:19.784245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd492bcd-c4dc-4a40-98b0-ed6dc772fc49 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:19.878741 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd492bcd-c4dc-4a40-98b0-ed6dc772fc49 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:19.910777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ad2aa-9988-436c-890c-19d6bb2406db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:19.911419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ad2aa-9988-436c-890c-19d6bb2406db None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:19.911702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ad2aa-9988-436c-890c-19d6bb2406db None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:19.911976 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ad2aa-9988-436c-890c-19d6bb2406db None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:19.912800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ad2aa-9988-436c-890c-19d6bb2406db None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:19.913106 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ad2aa-9988-436c-890c-19d6bb2406db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:19.914447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ad2aa-9988-436c-890c-19d6bb2406db None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:19.921787 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 587/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 23 12:55:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:21.892273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6113ece-cf12-4c98-9a51-1b070a99c400 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:21.892820 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6113ece-cf12-4c98-9a51-1b070a99c400 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:21.892932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6113ece-cf12-4c98-9a51-1b070a99c400 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:21.894247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 580/1167] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:21.899858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83a037-a4b8-4887-8000-0eafe2b7b1fc None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:21.900256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83a037-a4b8-4887-8000-0eafe2b7b1fc None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:21.900414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83a037-a4b8-4887-8000-0eafe2b7b1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:21.916610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1f83a037-a4b8-4887-8000-0eafe2b7b1fc None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:21.918311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1f83a037-a4b8-4887-8000-0eafe2b7b1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:21.958299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:21.981705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 588/1168] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:22.004770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6113ece-cf12-4c98-9a51-1b070a99c400 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:22.094166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:22.103843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6113ece-cf12-4c98-9a51-1b070a99c400 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:22.137248 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bb5a6-0bff-4287-83f3-216bccb5dfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:22.137898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb5a6-0bff-4287-83f3-216bccb5dfc1 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:22.138184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb5a6-0bff-4287-83f3-216bccb5dfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:22.138463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb5a6-0bff-4287-83f3-216bccb5dfc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:22.139202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bb5a6-0bff-4287-83f3-216bccb5dfc1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:22.140563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bb5a6-0bff-4287-83f3-216bccb5dfc1 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:22.207933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 581/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Thu Jun 23 12:55:22 2022] POST /identity/v3/domains => generated 267 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:55:24.251571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09a7a0-15dc-4a48-9cec-c6cfd1179e01 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:24.252118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09a7a0-15dc-4a48-9cec-c6cfd1179e01 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:24.252118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09a7a0-15dc-4a48-9cec-c6cfd1179e01 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:24.253524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 589/1170] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:24.258566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f284f-2843-4533-9da6-c2ccb56b9479 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:24.258939 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f284f-2843-4533-9da6-c2ccb56b9479 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:24.259118 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f284f-2843-4533-9da6-c2ccb56b9479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:24.277080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b55f284f-2843-4533-9da6-c2ccb56b9479 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:24.278247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b55f284f-2843-4533-9da6-c2ccb56b9479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:24.342065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 582/1171] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:24.365120 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09a7a0-15dc-4a48-9cec-c6cfd1179e01 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:24.461342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09a7a0-15dc-4a48-9cec-c6cfd1179e01 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:24.493452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a11b1-e9ba-4a47-bacc-5b7d3224bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:24.494287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a11b1-e9ba-4a47-bacc-5b7d3224bcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:24.494569 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a11b1-e9ba-4a47-bacc-5b7d3224bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:24.494847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a11b1-e9ba-4a47-bacc-5b7d3224bcb4 None admin] PATH_INFO: `/v3/domains/a8d93afa0adb4204845beda71a96e125` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:24.505365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a11b1-e9ba-4a47-bacc-5b7d3224bcb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a8d93afa0adb4204845beda71a96e125)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:24.506836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a11b1-e9ba-4a47-bacc-5b7d3224bcb4 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:24.508672 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 590/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Thu Jun 23 12:55:24 2022] GET /identity/v3/domains/a8d93afa0adb4204845beda71a96e125 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:24.515027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f284f-2843-4533-9da6-c2ccb56b9479 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:24.591278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:24.609003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f284f-2843-4533-9da6-c2ccb56b9479 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:24.641795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fbb79-b7d5-409e-afe5-1eaac1b9924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:24.642438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fbb79-b7d5-409e-afe5-1eaac1b9924b None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:24.642723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fbb79-b7d5-409e-afe5-1eaac1b9924b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:24.643041 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fbb79-b7d5-409e-afe5-1eaac1b9924b None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:24.643730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fbb79-b7d5-409e-afe5-1eaac1b9924b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:24.645252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fbb79-b7d5-409e-afe5-1eaac1b9924b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:24.727381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 583/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:55:24 2022] POST /identity/v3/projects => generated 361 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:55:26.745478 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab085903-6061-486c-8145-f08b8561d746 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:26.746119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab085903-6061-486c-8145-f08b8561d746 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:26.746119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab085903-6061-486c-8145-f08b8561d746 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:26.747385 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 591/1174] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:26.752438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5b9c-1611-410d-b2e1-e40a114324e2 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:26.752853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5b9c-1611-410d-b2e1-e40a114324e2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:26.753017 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5b9c-1611-410d-b2e1-e40a114324e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:26.770426 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a82e5b9c-1611-410d-b2e1-e40a114324e2 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:26.771892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a82e5b9c-1611-410d-b2e1-e40a114324e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:26.835746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 584/1175] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:26.860397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab085903-6061-486c-8145-f08b8561d746 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:26.896461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:26.960000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab085903-6061-486c-8145-f08b8561d746 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:26.991208 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7706a-2a59-46a6-a144-77df9c854434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:26.992043 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7706a-2a59-46a6-a144-77df9c854434 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:26.992324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7706a-2a59-46a6-a144-77df9c854434 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:26.992594 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7706a-2a59-46a6-a144-77df9c854434 None admin] PATH_INFO: `/v3/domains/a8d93afa0adb4204845beda71a96e125` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:26.993768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7706a-2a59-46a6-a144-77df9c854434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a8d93afa0adb4204845beda71a96e125)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:26.995729 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7706a-2a59-46a6-a144-77df9c854434 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:26.997282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 592/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Thu Jun 23 12:55:26 2022] GET /identity/v3/domains/a8d93afa0adb4204845beda71a96e125 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:27.002842 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5b9c-1611-410d-b2e1-e40a114324e2 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:27.062373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:27.098655 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5b9c-1611-410d-b2e1-e40a114324e2 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:27.131810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765e98e-6e28-4647-b9e0-88baa4e4856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:27.132469 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765e98e-6e28-4647-b9e0-88baa4e4856e None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:27.132775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765e98e-6e28-4647-b9e0-88baa4e4856e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:27.133048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765e98e-6e28-4647-b9e0-88baa4e4856e None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:27.133746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765e98e-6e28-4647-b9e0-88baa4e4856e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:27.135160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765e98e-6e28-4647-b9e0-88baa4e4856e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:27.213028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 585/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:55:27 2022] POST /identity/v3/users => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:55:29.275993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979500b-0f1e-4658-adbb-61b77fb08031 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:29.277079 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979500b-0f1e-4658-adbb-61b77fb08031 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:29.277175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979500b-0f1e-4658-adbb-61b77fb08031 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:29.278502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 593/1178] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:29.283635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e757e9-80a4-4f08-8097-11c9acd2f0dc None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:29.284067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e757e9-80a4-4f08-8097-11c9acd2f0dc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:29.284213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e757e9-80a4-4f08-8097-11c9acd2f0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:29.300480 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-59e757e9-80a4-4f08-8097-11c9acd2f0dc None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:29.301723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-59e757e9-80a4-4f08-8097-11c9acd2f0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:29.364694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 586/1179] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:55:29.388207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979500b-0f1e-4658-adbb-61b77fb08031 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:29.484354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979500b-0f1e-4658-adbb-61b77fb08031 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:29.486568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:29.516156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3abfc-9c21-41c7-9145-002ca9ac3119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:29.516951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3abfc-9c21-41c7-9145-002ca9ac3119 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:29.517231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3abfc-9c21-41c7-9145-002ca9ac3119 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:29.517501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3abfc-9c21-41c7-9145-002ca9ac3119 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:29.528633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3abfc-9c21-41c7-9145-002ca9ac3119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-cad3abfc-9c21-41c7-9145-002ca9ac3119 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:55:29.538611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:29.539774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:55:29.540987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 594/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:55:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:55:29.547174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e757e9-80a4-4f08-8097-11c9acd2f0dc None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:29.597111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:29.645017 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e757e9-80a4-4f08-8097-11c9acd2f0dc None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:29.678169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd770a1-e71e-4aa4-8d73-e190545a8ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:29.678817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd770a1-e71e-4aa4-8d73-e190545a8ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:29.679099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd770a1-e71e-4aa4-8d73-e190545a8ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:29.679374 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd770a1-e71e-4aa4-8d73-e190545a8ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:29.680104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd770a1-e71e-4aa4-8d73-e190545a8ae5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:29.680409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd770a1-e71e-4aa4-8d73-e190545a8ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:29.681790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd770a1-e71e-4aa4-8d73-e190545a8ae5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:29.689470 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 587/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:55:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:29.695017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3abfc-9c21-41c7-9145-002ca9ac3119 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:29.792574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3abfc-9c21-41c7-9145-002ca9ac3119 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:29.824175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa1db8-fb0e-4d4e-aa18-7382df9c9518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:29.825054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa1db8-fb0e-4d4e-aa18-7382df9c9518 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:29.825337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa1db8-fb0e-4d4e-aa18-7382df9c9518 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:29.825628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa1db8-fb0e-4d4e-aa18-7382df9c9518 None admin] PATH_INFO: `/v3/users/3a5cbfd001694cd39b461e42b82033af` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:29.838387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa1db8-fb0e-4d4e-aa18-7382df9c9518 None admin] RBAC: Authorizing `identity:get_user(user_id=3a5cbfd001694cd39b461e42b82033af)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:29.840315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa1db8-fb0e-4d4e-aa18-7382df9c9518 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:29.841964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 595/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:55:29 2022] GET /identity/v3/users/3a5cbfd001694cd39b461e42b82033af => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:29.847750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd770a1-e71e-4aa4-8d73-e190545a8ae5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:29.944448 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd770a1-e71e-4aa4-8d73-e190545a8ae5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:29.954138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:29.976544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf602ab9-7078-489d-aecf-1b7c49c9a0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:29.977215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf602ab9-7078-489d-aecf-1b7c49c9a0fb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:29.977503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf602ab9-7078-489d-aecf-1b7c49c9a0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:29.977782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf602ab9-7078-489d-aecf-1b7c49c9a0fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:30.042907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf602ab9-7078-489d-aecf-1b7c49c9a0fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:30.044345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf602ab9-7078-489d-aecf-1b7c49c9a0fb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:30.142457 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 588/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:55:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:55:30.148522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa1db8-fb0e-4d4e-aa18-7382df9c9518 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:30.172284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:30.243124 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa1db8-fb0e-4d4e-aa18-7382df9c9518 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:30.275546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ebba0-73fa-400e-8409-9321bf8e9a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:30.276960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ebba0-73fa-400e-8409-9321bf8e9a6d None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:30.277502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ebba0-73fa-400e-8409-9321bf8e9a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:30.277502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ebba0-73fa-400e-8409-9321bf8e9a6d None admin] PATH_INFO: `/v3/projects/196bf148bc8c4fe5ba6624e603b16d63` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:30.278661 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ebba0-73fa-400e-8409-9321bf8e9a6d None admin] RBAC: Authorizing `identity:get_project(project_id=196bf148bc8c4fe5ba6624e603b16d63)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:30.280071 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ebba0-73fa-400e-8409-9321bf8e9a6d None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:30.281786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 596/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:55:30 2022] GET /identity/v3/projects/196bf148bc8c4fe5ba6624e603b16d63 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:30.287734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf602ab9-7078-489d-aecf-1b7c49c9a0fb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:30.298837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:30.382394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf602ab9-7078-489d-aecf-1b7c49c9a0fb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:30.414645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1240c-eeb1-4790-8fb7-81405f696584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:30.415274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1240c-eeb1-4790-8fb7-81405f696584 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:30.415554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1240c-eeb1-4790-8fb7-81405f696584 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:30.415826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1240c-eeb1-4790-8fb7-81405f696584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:30.416691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1240c-eeb1-4790-8fb7-81405f696584 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=196bf148bc8c4fe5ba6624e603b16d63, user.id=3a5cbfd001694cd39b461e42b82033af) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:30.417018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1240c-eeb1-4790-8fb7-81405f696584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:30.418424 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1240c-eeb1-4790-8fb7-81405f696584 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:30.423603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 589/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:55:30 2022] GET /identity/v3/role_assignments?user.id=3a5cbfd001694cd39b461e42b82033af&scope.project.id=196bf148bc8c4fe5ba6624e603b16d63&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:32.403876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c4c17-ecc2-41bd-8fc9-4ca1fb02dc8d None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:32.404374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c4c17-ecc2-41bd-8fc9-4ca1fb02dc8d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:32.404374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c4c17-ecc2-41bd-8fc9-4ca1fb02dc8d None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:32.405749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 597/1186] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:32.410975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74a72b-d8b5-490c-b7d8-3c03feff36e4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:32.411352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74a72b-d8b5-490c-b7d8-3c03feff36e4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:32.411535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74a72b-d8b5-490c-b7d8-3c03feff36e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:32.428170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1b74a72b-d8b5-490c-b7d8-3c03feff36e4 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:32.429443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1b74a72b-d8b5-490c-b7d8-3c03feff36e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:32.494053 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 590/1187] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:32.517462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c4c17-ecc2-41bd-8fc9-4ca1fb02dc8d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:32.602686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:32.612948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c4c17-ecc2-41bd-8fc9-4ca1fb02dc8d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:32.645488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdf5e2-931c-444c-a4cc-5c6ca71a123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:32.646516 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdf5e2-931c-444c-a4cc-5c6ca71a123c None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:32.646796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdf5e2-931c-444c-a4cc-5c6ca71a123c None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:32.647066 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdf5e2-931c-444c-a4cc-5c6ca71a123c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:32.657147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdf5e2-931c-444c-a4cc-5c6ca71a123c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-87fdf5e2-931c-444c-a4cc-5c6ca71a123c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:55:32.664565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:32.665745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:55:32.667376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 598/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:55:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:32.672234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74a72b-d8b5-490c-b7d8-3c03feff36e4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:32.675284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:32.765163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74a72b-d8b5-490c-b7d8-3c03feff36e4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:32.798072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9d71-938c-46b9-81c4-7bb03126b354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:32.798719 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9d71-938c-46b9-81c4-7bb03126b354 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:32.798999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9d71-938c-46b9-81c4-7bb03126b354 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:32.799276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9d71-938c-46b9-81c4-7bb03126b354 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:32.800005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba9d71-938c-46b9-81c4-7bb03126b354 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:32.800308 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba9d71-938c-46b9-81c4-7bb03126b354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:32.801684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba9d71-938c-46b9-81c4-7bb03126b354 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:32.809382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 591/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:55:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:32.814910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdf5e2-931c-444c-a4cc-5c6ca71a123c None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:32.912468 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdf5e2-931c-444c-a4cc-5c6ca71a123c None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:32.944397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1ba9d-8ba0-4042-94a1-062cc9ce27fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:32.945277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1ba9d-8ba0-4042-94a1-062cc9ce27fb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:32.945559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1ba9d-8ba0-4042-94a1-062cc9ce27fb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:32.945832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1ba9d-8ba0-4042-94a1-062cc9ce27fb None admin] PATH_INFO: `/v3/users/3a5cbfd001694cd39b461e42b82033af` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:32.947013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1ba9d-8ba0-4042-94a1-062cc9ce27fb None admin] RBAC: Authorizing `identity:get_user(user_id=3a5cbfd001694cd39b461e42b82033af)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:32.948462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1ba9d-8ba0-4042-94a1-062cc9ce27fb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:32.950085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 599/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:55:32 2022] GET /identity/v3/users/3a5cbfd001694cd39b461e42b82033af => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:32.955752 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9d71-938c-46b9-81c4-7bb03126b354 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:33.020202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:33.053507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9d71-938c-46b9-81c4-7bb03126b354 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:33.086538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd503fd-b325-48e3-8c30-084e79d89967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:33.087396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd503fd-b325-48e3-8c30-084e79d89967 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:33.087677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd503fd-b325-48e3-8c30-084e79d89967 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:33.087948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd503fd-b325-48e3-8c30-084e79d89967 None admin] PATH_INFO: `/v3/projects/196bf148bc8c4fe5ba6624e603b16d63` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:33.089725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd503fd-b325-48e3-8c30-084e79d89967 None admin] RBAC: Authorizing `identity:get_project(project_id=196bf148bc8c4fe5ba6624e603b16d63)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:33.091139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd503fd-b325-48e3-8c30-084e79d89967 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:33.092874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 592/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:55:32 2022] GET /identity/v3/projects/196bf148bc8c4fe5ba6624e603b16d63 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:33.098795 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1ba9d-8ba0-4042-94a1-062cc9ce27fb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:33.117485 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:33.194559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1ba9d-8ba0-4042-94a1-062cc9ce27fb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:33.225956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763e488-283d-4fa4-aae1-6be2f319ebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:33.226826 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763e488-283d-4fa4-aae1-6be2f319ebd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:33.227112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763e488-283d-4fa4-aae1-6be2f319ebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:33.227392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763e488-283d-4fa4-aae1-6be2f319ebd2 None admin] PATH_INFO: `/v3/projects/196bf148bc8c4fe5ba6624e603b16d63/users/3a5cbfd001694cd39b461e42b82033af/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:33.229876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763e488-283d-4fa4-aae1-6be2f319ebd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=196bf148bc8c4fe5ba6624e603b16d63, user_id=3a5cbfd001694cd39b461e42b82033af, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:33.231287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763e488-283d-4fa4-aae1-6be2f319ebd2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:33.317611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 600/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:55:33 2022] PUT /identity/v3/projects/196bf148bc8c4fe5ba6624e603b16d63/users/3a5cbfd001694cd39b461e42b82033af/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:55:35.282905 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4a5f9-1ffe-4d9e-a813-034deb4f45fa None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:35.283452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4a5f9-1ffe-4d9e-a813-034deb4f45fa None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:35.283452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4a5f9-1ffe-4d9e-a813-034deb4f45fa None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:35.284883 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 593/1193] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:35.290125 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746c81b-7eca-42e9-b051-e8958dc825c0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:35.290530 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746c81b-7eca-42e9-b051-e8958dc825c0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:35.290716 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746c81b-7eca-42e9-b051-e8958dc825c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:35.306726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9746c81b-7eca-42e9-b051-e8958dc825c0 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:35.307890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9746c81b-7eca-42e9-b051-e8958dc825c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:35.370570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 601/1194] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:35.393857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4a5f9-1ffe-4d9e-a813-034deb4f45fa None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:35.492235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4a5f9-1ffe-4d9e-a813-034deb4f45fa None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:35.524631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ebcf2-3e81-4bd8-8449-a8a2917e9c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:35.525437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ebcf2-3e81-4bd8-8449-a8a2917e9c9d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:35.526419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ebcf2-3e81-4bd8-8449-a8a2917e9c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:35.526896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ebcf2-3e81-4bd8-8449-a8a2917e9c9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:35.529756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:35.539232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ebcf2-3e81-4bd8-8449-a8a2917e9c9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-d70ebcf2-3e81-4bd8-8449-a8a2917e9c9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:55:35.546763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:35.547850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:55:35.548898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 594/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:55:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:35.554094 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746c81b-7eca-42e9-b051-e8958dc825c0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:35.563958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:35.649590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746c81b-7eca-42e9-b051-e8958dc825c0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:35.681088 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2fd58-566c-45fe-a7da-26b133b8a976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:35.681741 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2fd58-566c-45fe-a7da-26b133b8a976 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:35.682534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2fd58-566c-45fe-a7da-26b133b8a976 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:35.682815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2fd58-566c-45fe-a7da-26b133b8a976 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:35.683554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2fd58-566c-45fe-a7da-26b133b8a976 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:35.683865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2fd58-566c-45fe-a7da-26b133b8a976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:35.685249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2fd58-566c-45fe-a7da-26b133b8a976 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:35.693014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 602/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:55:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:35.699208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ebcf2-3e81-4bd8-8449-a8a2917e9c9d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:35.794729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ebcf2-3e81-4bd8-8449-a8a2917e9c9d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:35.827706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ecc23-7c3b-4713-9fd1-6f822009faef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:35.828558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ecc23-7c3b-4713-9fd1-6f822009faef None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:35.828865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ecc23-7c3b-4713-9fd1-6f822009faef None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:35.829145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ecc23-7c3b-4713-9fd1-6f822009faef None admin] PATH_INFO: `/v3/users/3a5cbfd001694cd39b461e42b82033af` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:35.830316 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ecc23-7c3b-4713-9fd1-6f822009faef None admin] RBAC: Authorizing `identity:get_user(user_id=3a5cbfd001694cd39b461e42b82033af)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:35.831726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ecc23-7c3b-4713-9fd1-6f822009faef None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:35.833361 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 595/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 23 12:55:35 2022] GET /identity/v3/users/3a5cbfd001694cd39b461e42b82033af => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:35.839073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2fd58-566c-45fe-a7da-26b133b8a976 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:35.904966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:35.934549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2fd58-566c-45fe-a7da-26b133b8a976 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:35.967651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa1ee7-4ce8-4c85-9b4c-6018e1fafcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:35.968290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa1ee7-4ce8-4c85-9b4c-6018e1fafcdd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:35.968573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa1ee7-4ce8-4c85-9b4c-6018e1fafcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:35.968876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa1ee7-4ce8-4c85-9b4c-6018e1fafcdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:36.032203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa1ee7-4ce8-4c85-9b4c-6018e1fafcdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:36.033654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa1ee7-4ce8-4c85-9b4c-6018e1fafcdd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:36.096747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:36.127015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 603/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:55:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:55:36.132914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ecc23-7c3b-4713-9fd1-6f822009faef None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:36.191797 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:36.227729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ecc23-7c3b-4713-9fd1-6f822009faef None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:36.260323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b42e5-3064-4b3a-a4ee-e17ac418205d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:36.261182 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b42e5-3064-4b3a-a4ee-e17ac418205d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:36.261471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b42e5-3064-4b3a-a4ee-e17ac418205d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:36.261745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b42e5-3064-4b3a-a4ee-e17ac418205d None admin] PATH_INFO: `/v3/projects/196bf148bc8c4fe5ba6624e603b16d63` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:36.262899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b42e5-3064-4b3a-a4ee-e17ac418205d None admin] RBAC: Authorizing `identity:get_project(project_id=196bf148bc8c4fe5ba6624e603b16d63)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:36.264306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b42e5-3064-4b3a-a4ee-e17ac418205d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:36.266005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 596/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 23 12:55:36 2022] GET /identity/v3/projects/196bf148bc8c4fe5ba6624e603b16d63 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:36.272172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa1ee7-4ce8-4c85-9b4c-6018e1fafcdd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:36.367240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa1ee7-4ce8-4c85-9b4c-6018e1fafcdd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:36.399899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676095d-dc9e-4159-86be-6cbb5f1f5ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:36.400539 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676095d-dc9e-4159-86be-6cbb5f1f5ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:36.401347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676095d-dc9e-4159-86be-6cbb5f1f5ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:36.401628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676095d-dc9e-4159-86be-6cbb5f1f5ca9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:36.402452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676095d-dc9e-4159-86be-6cbb5f1f5ca9 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=196bf148bc8c4fe5ba6624e603b16d63, user.id=3a5cbfd001694cd39b461e42b82033af) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:36.402767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676095d-dc9e-4159-86be-6cbb5f1f5ca9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:36.404178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676095d-dc9e-4159-86be-6cbb5f1f5ca9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:36.409825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 604/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:55:36 2022] GET /identity/v3/role_assignments?user.id=3a5cbfd001694cd39b461e42b82033af&scope.project.id=196bf148bc8c4fe5ba6624e603b16d63&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:46.256346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=35 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:46.407356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=83 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:53.729876 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428428eb-0a47-4379-89ef-8b1e5df7b154 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:53.730474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428428eb-0a47-4379-89ef-8b1e5df7b154 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:53.730474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428428eb-0a47-4379-89ef-8b1e5df7b154 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:53.731845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 597/1201] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:56:53.737039 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b177c-6445-465a-9bc6-15f5b25848ff None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:53.737443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b177c-6445-465a-9bc6-15f5b25848ff None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:53.737598 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b177c-6445-465a-9bc6-15f5b25848ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:53.754212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-fa5b177c-6445-465a-9bc6-15f5b25848ff None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:56:53.755432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fa5b177c-6445-465a-9bc6-15f5b25848ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:56:53.820155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 605/1202] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:56:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:56:53.845206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428428eb-0a47-4379-89ef-8b1e5df7b154 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:53.945224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428428eb-0a47-4379-89ef-8b1e5df7b154 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:53.978804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9cfea-2dc9-4244-861a-838c70abef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:53.979591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9cfea-2dc9-4244-861a-838c70abef48 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:53.979926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9cfea-2dc9-4244-861a-838c70abef48 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:53.980159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9cfea-2dc9-4244-861a-838c70abef48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:53.989899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9cfea-2dc9-4244-861a-838c70abef48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:53.991366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9cfea-2dc9-4244-861a-838c70abef48 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-f8d9cfea-2dc9-4244-861a-838c70abef48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:56:54.008359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:56:54.009393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:56:54.010663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:56:54.010663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:56:54.010663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:56:54.010663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:56:54.010663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 598/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:56:54.015588 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b177c-6445-465a-9bc6-15f5b25848ff None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:54.117646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b177c-6445-465a-9bc6-15f5b25848ff None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:54.146264 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:54.151922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b6076-110e-4f46-8a0b-da508dcbf26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:54.152577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b6076-110e-4f46-8a0b-da508dcbf26f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:54.152892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b6076-110e-4f46-8a0b-da508dcbf26f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:54.153174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b6076-110e-4f46-8a0b-da508dcbf26f None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:54.153892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b6076-110e-4f46-8a0b-da508dcbf26f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:56:54.154202 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b6076-110e-4f46-8a0b-da508dcbf26f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:54.155559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b6076-110e-4f46-8a0b-da508dcbf26f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:54.166376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 606/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:56:54.172035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9cfea-2dc9-4244-861a-838c70abef48 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:54.224869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:54.269692 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9cfea-2dc9-4244-861a-838c70abef48 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:54.302083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa56a20-bd57-42aa-81df-2866f80f9029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:54.302746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa56a20-bd57-42aa-81df-2866f80f9029 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:54.303030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa56a20-bd57-42aa-81df-2866f80f9029 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:54.303306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa56a20-bd57-42aa-81df-2866f80f9029 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:54.303996 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa56a20-bd57-42aa-81df-2866f80f9029 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:54.305452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa56a20-bd57-42aa-81df-2866f80f9029 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:54.401012 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 599/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 23 12:56:54 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:56:56.458292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a540a64-74f2-4986-b9f2-bbe2f9939b39 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:56.458825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a540a64-74f2-4986-b9f2-bbe2f9939b39 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:56.458941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a540a64-74f2-4986-b9f2-bbe2f9939b39 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:56.460213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 607/1206] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:56:56.465397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03c296-9ad3-45d5-aa76-f710319aff23 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:56.465780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03c296-9ad3-45d5-aa76-f710319aff23 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:56.468349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03c296-9ad3-45d5-aa76-f710319aff23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:56.483009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8f03c296-9ad3-45d5-aa76-f710319aff23 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:56:56.484194 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8f03c296-9ad3-45d5-aa76-f710319aff23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:56:56.550322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 600/1207] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:56:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:56:56.573527 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a540a64-74f2-4986-b9f2-bbe2f9939b39 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:56.672248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a540a64-74f2-4986-b9f2-bbe2f9939b39 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:56.706058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dcccc-7faa-46da-8e09-32d80c8b7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:56.706830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dcccc-7faa-46da-8e09-32d80c8b7b64 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:56.707107 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dcccc-7faa-46da-8e09-32d80c8b7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:56.707379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dcccc-7faa-46da-8e09-32d80c8b7b64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:56.717221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dcccc-7faa-46da-8e09-32d80c8b7b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-5a5dcccc-7faa-46da-8e09-32d80c8b7b64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:56:56.725544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:56:56.726678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:56:56.727918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 608/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:56:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:56:56.732764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03c296-9ad3-45d5-aa76-f710319aff23 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:56.771630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:56.828067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03c296-9ad3-45d5-aa76-f710319aff23 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:56.862425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77d345-7bb7-45d7-929e-9a3502078bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:56.863078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77d345-7bb7-45d7-929e-9a3502078bab None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:56.863358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77d345-7bb7-45d7-929e-9a3502078bab None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:56.863634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77d345-7bb7-45d7-929e-9a3502078bab None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:56.864452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77d345-7bb7-45d7-929e-9a3502078bab None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:56:56.864785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77d345-7bb7-45d7-929e-9a3502078bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:56.866212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77d345-7bb7-45d7-929e-9a3502078bab None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:56.874400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 601/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:56:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:56:56.880098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dcccc-7faa-46da-8e09-32d80c8b7b64 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:56.929267 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:56.977183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dcccc-7faa-46da-8e09-32d80c8b7b64 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:57.009486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c05b2-825d-479f-acb8-885acff78f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:57.010268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c05b2-825d-479f-acb8-885acff78f3b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:57.010557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c05b2-825d-479f-acb8-885acff78f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:57.010837 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c05b2-825d-479f-acb8-885acff78f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:57.021844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c05b2-825d-479f-acb8-885acff78f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:57.024424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c05b2-825d-479f-acb8-885acff78f3b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-b34c05b2-825d-479f-acb8-885acff78f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:56:57.040291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:56:57.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:56:57.042337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:56:57.042337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:56:57.042337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:56:57.042337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:56:57.042337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 609/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:56:57.047170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77d345-7bb7-45d7-929e-9a3502078bab None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:57.147338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:57.150261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77d345-7bb7-45d7-929e-9a3502078bab None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:57.182558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c1f03-fb38-4658-ad8b-b9d48eda3874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:57.183220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c1f03-fb38-4658-ad8b-b9d48eda3874 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:57.183506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c1f03-fb38-4658-ad8b-b9d48eda3874 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:57.183784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c1f03-fb38-4658-ad8b-b9d48eda3874 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:57.184505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c1f03-fb38-4658-ad8b-b9d48eda3874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:56:57.184902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c1f03-fb38-4658-ad8b-b9d48eda3874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:57.186279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c1f03-fb38-4658-ad8b-b9d48eda3874 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:57.198517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 602/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:56:57.204145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c05b2-825d-479f-acb8-885acff78f3b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:57.304510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c05b2-825d-479f-acb8-885acff78f3b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:57.305985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:57.338021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df738b4-1388-4a74-a7a0-5f376021c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:57.338813 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df738b4-1388-4a74-a7a0-5f376021c627 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:57.339098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df738b4-1388-4a74-a7a0-5f376021c627 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:57.339377 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df738b4-1388-4a74-a7a0-5f376021c627 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:57.346084 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df738b4-1388-4a74-a7a0-5f376021c627 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:57.347568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df738b4-1388-4a74-a7a0-5f376021c627 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-6df738b4-1388-4a74-a7a0-5f376021c627 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:56:57.361803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:56:57.364817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:56:57.365800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:56:57.365800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:56:57.365800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:56:57.365800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:56:57.365800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:56:57.365800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:56:57.365800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:56:57.365800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:56:57.365800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:56:57.365800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:56:57.365800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 610/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:56:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:56:57.368773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c1f03-fb38-4658-ad8b-b9d48eda3874 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:57.466317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c1f03-fb38-4658-ad8b-b9d48eda3874 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:57.498983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf89b6a-677c-4ff4-b6d3-263cf64bf788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:57.499641 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf89b6a-677c-4ff4-b6d3-263cf64bf788 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:57.499926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf89b6a-677c-4ff4-b6d3-263cf64bf788 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:57.500203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf89b6a-677c-4ff4-b6d3-263cf64bf788 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:57.501057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf89b6a-677c-4ff4-b6d3-263cf64bf788 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:56:57.501368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf89b6a-677c-4ff4-b6d3-263cf64bf788 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:57.503317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf89b6a-677c-4ff4-b6d3-263cf64bf788 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:57.519985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 603/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jun 23 12:56:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:56:57.525557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df738b4-1388-4a74-a7a0-5f376021c627 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:57.620871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df738b4-1388-4a74-a7a0-5f376021c627 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:57.654400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41147e-50e6-4e8a-82a4-b87dd8b0f54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:57.655040 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41147e-50e6-4e8a-82a4-b87dd8b0f54b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:57.655326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41147e-50e6-4e8a-82a4-b87dd8b0f54b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:57.655605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41147e-50e6-4e8a-82a4-b87dd8b0f54b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:57.685997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:57.725204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41147e-50e6-4e8a-82a4-b87dd8b0f54b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:57.726645 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41147e-50e6-4e8a-82a4-b87dd8b0f54b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:57.822795 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 611/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:56:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 12:56:57.828744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf89b6a-677c-4ff4-b6d3-263cf64bf788 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:57.848165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:57.928472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf89b6a-677c-4ff4-b6d3-263cf64bf788 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:57.961829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2e4f3-49c2-4d5e-856b-5f6301c37235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:57.966907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2e4f3-49c2-4d5e-856b-5f6301c37235 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:57.966907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2e4f3-49c2-4d5e-856b-5f6301c37235 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:57.966907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2e4f3-49c2-4d5e-856b-5f6301c37235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:57.974011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2e4f3-49c2-4d5e-856b-5f6301c37235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:57.975526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2e4f3-49c2-4d5e-856b-5f6301c37235 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-75d2e4f3-49c2-4d5e-856b-5f6301c37235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:56:57.993314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:56:57.994468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:56:57.995774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:56:57.995774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:56:57.995774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:56:57.995774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:56:57.995774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 604/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:56:58.000406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41147e-50e6-4e8a-82a4-b87dd8b0f54b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:58.060137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:58.097264 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41147e-50e6-4e8a-82a4-b87dd8b0f54b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:58.128965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f5d6b-8cd8-436b-8094-2f5f1ce87aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:58.129620 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f5d6b-8cd8-436b-8094-2f5f1ce87aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:58.129903 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f5d6b-8cd8-436b-8094-2f5f1ce87aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:58.130180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f5d6b-8cd8-436b-8094-2f5f1ce87aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:58.130892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f5d6b-8cd8-436b-8094-2f5f1ce87aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:56:58.131199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f5d6b-8cd8-436b-8094-2f5f1ce87aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:58.132545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f5d6b-8cd8-436b-8094-2f5f1ce87aa1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:58.143695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 612/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:56:58.149632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2e4f3-49c2-4d5e-856b-5f6301c37235 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:58.218805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:58.248887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2e4f3-49c2-4d5e-856b-5f6301c37235 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:58.281921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294d9a-5957-4abf-9403-b8a37094c240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:58.282701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294d9a-5957-4abf-9403-b8a37094c240 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:58.282981 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294d9a-5957-4abf-9403-b8a37094c240 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:58.283253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294d9a-5957-4abf-9403-b8a37094c240 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:58.290309 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26294d9a-5957-4abf-9403-b8a37094c240 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:58.291736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26294d9a-5957-4abf-9403-b8a37094c240 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-26294d9a-5957-4abf-9403-b8a37094c240 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:56:58.305052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:56:58.306183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:56:58.307501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:56:58.307501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:56:58.307501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:56:58.307501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:56:58.307501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:56:58.307501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:56:58.307501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:56:58.307501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:56:58.307501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 605/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:56:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:56:58.312051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f5d6b-8cd8-436b-8094-2f5f1ce87aa1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:58.409240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f5d6b-8cd8-436b-8094-2f5f1ce87aa1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:58.430960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:58.442126 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1604cd8-827d-4e8b-8987-5097ca2f3939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:58.442775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1604cd8-827d-4e8b-8987-5097ca2f3939 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:58.443060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1604cd8-827d-4e8b-8987-5097ca2f3939 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:58.443339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1604cd8-827d-4e8b-8987-5097ca2f3939 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:58.444113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1604cd8-827d-4e8b-8987-5097ca2f3939 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:56:58.444425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1604cd8-827d-4e8b-8987-5097ca2f3939 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:58.445879 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1604cd8-827d-4e8b-8987-5097ca2f3939 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:58.457437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 613/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:56:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:56:58.463482 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294d9a-5957-4abf-9403-b8a37094c240 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:56:58.562199 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294d9a-5957-4abf-9403-b8a37094c240 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:56:58.589261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:56:58.594837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb65d44-6897-4cf7-aa2f-8513e88c0e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:56:58.595474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb65d44-6897-4cf7-aa2f-8513e88c0e8e None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:56:58.596264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb65d44-6897-4cf7-aa2f-8513e88c0e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:56:58.596545 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb65d44-6897-4cf7-aa2f-8513e88c0e8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:56:58.597394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb65d44-6897-4cf7-aa2f-8513e88c0e8e None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=8644754798b5439c954c86dc9aa9e7af) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:56:58.597702 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb65d44-6897-4cf7-aa2f-8513e88c0e8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:56:58.599155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb65d44-6897-4cf7-aa2f-8513e88c0e8e None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:56:58.605529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 606/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:56:58 2022] GET /identity/v3/role_assignments?user.id=8644754798b5439c954c86dc9aa9e7af&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:00.577014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed619b-6a58-45a5-9ab1-88af58a44074 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:00.577629 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed619b-6a58-45a5-9ab1-88af58a44074 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:00.577629 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed619b-6a58-45a5-9ab1-88af58a44074 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:00.578934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 614/1220] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:57:00.584554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169a3a5-bced-4dd9-bacd-40a63246260d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:00.585046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169a3a5-bced-4dd9-bacd-40a63246260d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:00.585148 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169a3a5-bced-4dd9-bacd-40a63246260d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:00.601912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1169a3a5-bced-4dd9-bacd-40a63246260d None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:57:00.603096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1169a3a5-bced-4dd9-bacd-40a63246260d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:57:00.667204 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 607/1221] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:57:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:57:00.689298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed619b-6a58-45a5-9ab1-88af58a44074 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:00.787884 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed619b-6a58-45a5-9ab1-88af58a44074 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:00.820533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3415b-065d-427f-b02a-2db1b7fbef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:00.821345 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3415b-065d-427f-b02a-2db1b7fbef62 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:00.821632 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3415b-065d-427f-b02a-2db1b7fbef62 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:00.821912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3415b-065d-427f-b02a-2db1b7fbef62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:00.832333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3415b-065d-427f-b02a-2db1b7fbef62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-6ef3415b-065d-427f-b02a-2db1b7fbef62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:57:00.840147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:00.841359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:00.842467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 615/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:57:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:00.847647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169a3a5-bced-4dd9-bacd-40a63246260d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:00.945065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169a3a5-bced-4dd9-bacd-40a63246260d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:00.967923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:00.978032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c72df7-7674-423b-91ae-e19c9ce5190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:00.979683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c72df7-7674-423b-91ae-e19c9ce5190b None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:00.979683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c72df7-7674-423b-91ae-e19c9ce5190b None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:00.979683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c72df7-7674-423b-91ae-e19c9ce5190b None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:00.979933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c72df7-7674-423b-91ae-e19c9ce5190b None admin] RBAC: Adding query filter params (name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:00.980243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c72df7-7674-423b-91ae-e19c9ce5190b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:00.981637 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c72df7-7674-423b-91ae-e19c9ce5190b None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:00.989327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 608/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:57:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:00.995021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3415b-065d-427f-b02a-2db1b7fbef62 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:01.037441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:01.091821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3415b-065d-427f-b02a-2db1b7fbef62 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:01.122944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87281391-c3ce-429a-acb7-91bcd14c67e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:01.123732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281391-c3ce-429a-acb7-91bcd14c67e2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:01.124017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281391-c3ce-429a-acb7-91bcd14c67e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:01.124292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281391-c3ce-429a-acb7-91bcd14c67e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:01.135040 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87281391-c3ce-429a-acb7-91bcd14c67e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:01.136492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87281391-c3ce-429a-acb7-91bcd14c67e2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-87281391-c3ce-429a-acb7-91bcd14c67e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:57:01.153973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:01.155051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:01.155990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:57:01.155990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:57:01.155990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:01.155990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:01.155990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 616/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:01.160985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c72df7-7674-423b-91ae-e19c9ce5190b None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:01.259274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c72df7-7674-423b-91ae-e19c9ce5190b None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:01.291420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87cb02-d215-4ef2-baa7-4d8342f5dafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:01.292073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87cb02-d215-4ef2-baa7-4d8342f5dafe None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:01.292355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87cb02-d215-4ef2-baa7-4d8342f5dafe None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:01.292629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87cb02-d215-4ef2-baa7-4d8342f5dafe None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:01.293372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87cb02-d215-4ef2-baa7-4d8342f5dafe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:01.293677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87cb02-d215-4ef2-baa7-4d8342f5dafe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:01.295032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87cb02-d215-4ef2-baa7-4d8342f5dafe None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:01.307135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 609/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:01.312866 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87281391-c3ce-429a-acb7-91bcd14c67e2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:01.406800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:01.413071 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87281391-c3ce-429a-acb7-91bcd14c67e2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:01.445974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adcf6d-3e7c-494b-9880-7638fa92221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:01.446766 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adcf6d-3e7c-494b-9880-7638fa92221f None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:01.447047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adcf6d-3e7c-494b-9880-7638fa92221f None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:01.447331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adcf6d-3e7c-494b-9880-7638fa92221f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:01.454228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adcf6d-3e7c-494b-9880-7638fa92221f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:01.455669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adcf6d-3e7c-494b-9880-7638fa92221f None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-69adcf6d-3e7c-494b-9880-7638fa92221f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:57:01.470169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:01.471185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:01.472133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:01.472133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:01.472133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:57:01.472133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:57:01.472133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:57:01.472133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:57:01.472133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:57:01.472133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:57:01.472133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:57:01.472133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:01.472133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 617/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:01.477220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87cb02-d215-4ef2-baa7-4d8342f5dafe None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:01.523856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:01.574185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87cb02-d215-4ef2-baa7-4d8342f5dafe None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:01.606328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66acc4-80c2-4a92-a66c-21f466c4b77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:01.606985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66acc4-80c2-4a92-a66c-21f466c4b77a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:01.607269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66acc4-80c2-4a92-a66c-21f466c4b77a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:01.607546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66acc4-80c2-4a92-a66c-21f466c4b77a None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:01.608372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66acc4-80c2-4a92-a66c-21f466c4b77a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:01.608706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66acc4-80c2-4a92-a66c-21f466c4b77a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:01.610136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66acc4-80c2-4a92-a66c-21f466c4b77a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:01.628103 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 610/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jun 23 12:57:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:01.633670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adcf6d-3e7c-494b-9880-7638fa92221f None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:01.730179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adcf6d-3e7c-494b-9880-7638fa92221f None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:01.762872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcd8f7-c593-439a-9ce4-9173f537d5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:01.763646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcd8f7-c593-439a-9ce4-9173f537d5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:01.763933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcd8f7-c593-439a-9ce4-9173f537d5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:01.764213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcd8f7-c593-439a-9ce4-9173f537d5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:01.774286 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcd8f7-c593-439a-9ce4-9173f537d5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:01.775713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcd8f7-c593-439a-9ce4-9173f537d5a1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-bfbcd8f7-c593-439a-9ce4-9173f537d5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:57:01.793281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:01.794333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:01.795426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:57:01.795426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:57:01.795426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:01.795426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:01.795426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 618/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:01.800809 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66acc4-80c2-4a92-a66c-21f466c4b77a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:01.904371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66acc4-80c2-4a92-a66c-21f466c4b77a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:01.906672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:01.937888 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58467450-bd01-48e0-aa4c-34dbd13fc0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:01.938547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58467450-bd01-48e0-aa4c-34dbd13fc0ad None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:01.938834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58467450-bd01-48e0-aa4c-34dbd13fc0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:01.939134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58467450-bd01-48e0-aa4c-34dbd13fc0ad None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:01.939872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58467450-bd01-48e0-aa4c-34dbd13fc0ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:01.940183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58467450-bd01-48e0-aa4c-34dbd13fc0ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:01.941612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58467450-bd01-48e0-aa4c-34dbd13fc0ad None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:01.952590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 611/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:01.958744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcd8f7-c593-439a-9ce4-9173f537d5a1 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:01.967514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:02.054840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcd8f7-c593-439a-9ce4-9173f537d5a1 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:02.088176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b463b-6536-4543-b82a-2b0a6851ce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:02.088984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b463b-6536-4543-b82a-2b0a6851ce61 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:02.089304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b463b-6536-4543-b82a-2b0a6851ce61 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:02.089577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b463b-6536-4543-b82a-2b0a6851ce61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:02.096695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b463b-6536-4543-b82a-2b0a6851ce61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:02.098147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b463b-6536-4543-b82a-2b0a6851ce61 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-249b463b-6536-4543-b82a-2b0a6851ce61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:57:02.111984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:02.113139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:02.114253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:57:02.114253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:57:02.114253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:57:02.114253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:57:02.114253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:57:02.114253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:57:02.114253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:57:02.114253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:02.114253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 619/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:57:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:02.119099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58467450-bd01-48e0-aa4c-34dbd13fc0ad None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:02.222222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58467450-bd01-48e0-aa4c-34dbd13fc0ad None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:02.254597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cb63c-9f51-474a-93f5-db35a0bb2a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:02.255249 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cb63c-9f51-474a-93f5-db35a0bb2a14 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:02.255531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cb63c-9f51-474a-93f5-db35a0bb2a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:02.255801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cb63c-9f51-474a-93f5-db35a0bb2a14 None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:02.256580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cb63c-9f51-474a-93f5-db35a0bb2a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:02.257077 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cb63c-9f51-474a-93f5-db35a0bb2a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:02.258497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cb63c-9f51-474a-93f5-db35a0bb2a14 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:02.271179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 612/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:57:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:02.277153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b463b-6536-4543-b82a-2b0a6851ce61 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:02.340527 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:02.374557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b463b-6536-4543-b82a-2b0a6851ce61 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:02.407771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d032b1-f250-40f8-9be8-232f7a96b666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:02.408707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d032b1-f250-40f8-9be8-232f7a96b666 None admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:02.408984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d032b1-f250-40f8-9be8-232f7a96b666 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:02.409262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d032b1-f250-40f8-9be8-232f7a96b666 None admin] PATH_INFO: `/v3/projects/311787f32b54485682be669bca9998f8/users/8644754798b5439c954c86dc9aa9e7af/roles/af902c13373445999fcf70be57ba260f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:02.423739 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d032b1-f250-40f8-9be8-232f7a96b666 None admin] RBAC: Authorizing `identity:create_grant(project_id=311787f32b54485682be669bca9998f8, user_id=8644754798b5439c954c86dc9aa9e7af, role_id=af902c13373445999fcf70be57ba260f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:02.425122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d032b1-f250-40f8-9be8-232f7a96b666 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:02.517363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 620/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:57:02 2022] PUT /identity/v3/projects/311787f32b54485682be669bca9998f8/users/8644754798b5439c954c86dc9aa9e7af/roles/af902c13373445999fcf70be57ba260f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:57:04.519198 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324fe1a-709d-4ae9-9105-9d379e226a1e None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:04.519751 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324fe1a-709d-4ae9-9105-9d379e226a1e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:04.519751 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324fe1a-709d-4ae9-9105-9d379e226a1e None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:04.521150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 613/1233] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:57:04.526303 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f67595-898f-4a7d-ae65-fab1ce57fdd5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:04.526815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f67595-898f-4a7d-ae65-fab1ce57fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:04.526941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f67595-898f-4a7d-ae65-fab1ce57fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:04.543572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-37f67595-898f-4a7d-ae65-fab1ce57fdd5 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:57:04.544851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-37f67595-898f-4a7d-ae65-fab1ce57fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:57:04.608113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 621/1234] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:57:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:57:04.632112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324fe1a-709d-4ae9-9105-9d379e226a1e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:04.657369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:04.729051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324fe1a-709d-4ae9-9105-9d379e226a1e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:04.761163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eba81-218d-4793-bba8-d0a5ebc4d8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:04.761942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eba81-218d-4793-bba8-d0a5ebc4d8ee None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:04.762223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eba81-218d-4793-bba8-d0a5ebc4d8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:04.762500 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eba81-218d-4793-bba8-d0a5ebc4d8ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:04.773520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705eba81-218d-4793-bba8-d0a5ebc4d8ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-705eba81-218d-4793-bba8-d0a5ebc4d8ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:57:04.781252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:04.782462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:04.783532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 614/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 23 12:57:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:04.788514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f67595-898f-4a7d-ae65-fab1ce57fdd5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:04.834065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:04.883903 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f67595-898f-4a7d-ae65-fab1ce57fdd5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:04.916773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c64b-6060-439b-ab5a-14e8a3c54a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:04.917437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c64b-6060-439b-ab5a-14e8a3c54a19 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:04.917722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c64b-6060-439b-ab5a-14e8a3c54a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:04.918006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c64b-6060-439b-ab5a-14e8a3c54a19 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:04.918783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77c64b-6060-439b-ab5a-14e8a3c54a19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:04.919090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77c64b-6060-439b-ab5a-14e8a3c54a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:04.920444 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77c64b-6060-439b-ab5a-14e8a3c54a19 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:04.928558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 622/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 23 12:57:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:04.934320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eba81-218d-4793-bba8-d0a5ebc4d8ee None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:05.016229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:05.031460 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eba81-218d-4793-bba8-d0a5ebc4d8ee None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:05.063428 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f0af0-d6ab-4821-bcad-96e516a6d9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:05.064800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f0af0-d6ab-4821-bcad-96e516a6d9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:05.065084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f0af0-d6ab-4821-bcad-96e516a6d9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:05.065360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f0af0-d6ab-4821-bcad-96e516a6d9e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:05.075884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f0af0-d6ab-4821-bcad-96e516a6d9e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:05.077352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f0af0-d6ab-4821-bcad-96e516a6d9e9 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-2f6f0af0-d6ab-4821-bcad-96e516a6d9e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:57:05.093761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:05.094694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:05.095633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:57:05.095633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:57:05.095633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:05.095633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:05.095633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 615/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:05.100639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c64b-6060-439b-ab5a-14e8a3c54a19 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:05.195701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c64b-6060-439b-ab5a-14e8a3c54a19 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:05.204117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:05.228343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bba05c-1861-40b0-90b4-d529d2368861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:05.229029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba05c-1861-40b0-90b4-d529d2368861 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:05.229317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba05c-1861-40b0-90b4-d529d2368861 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:05.229595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba05c-1861-40b0-90b4-d529d2368861 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:05.230355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bba05c-1861-40b0-90b4-d529d2368861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:05.230664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bba05c-1861-40b0-90b4-d529d2368861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:05.232015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bba05c-1861-40b0-90b4-d529d2368861 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:05.243338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 623/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:05.248954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f0af0-d6ab-4821-bcad-96e516a6d9e9 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:05.347635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f0af0-d6ab-4821-bcad-96e516a6d9e9 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:05.379746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1a1e0-efa0-4de7-b7e4-c79253dfa86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:05.380529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1a1e0-efa0-4de7-b7e4-c79253dfa86a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:05.380843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1a1e0-efa0-4de7-b7e4-c79253dfa86a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:05.381121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1a1e0-efa0-4de7-b7e4-c79253dfa86a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:05.383713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:05.389233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1a1e0-efa0-4de7-b7e4-c79253dfa86a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:05.390721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1a1e0-efa0-4de7-b7e4-c79253dfa86a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c2c1a1e0-efa0-4de7-b7e4-c79253dfa86a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:57:05.405305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:05.406458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:05.407489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:05.407489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:05.407489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:57:05.407489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:57:05.407489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:57:05.407489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:57:05.407489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:57:05.407489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:57:05.407489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:57:05.407489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:05.407489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 616/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:05.412293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bba05c-1861-40b0-90b4-d529d2368861 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:05.508427 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bba05c-1861-40b0-90b4-d529d2368861 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:05.541200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990e47-3b1f-4884-8ae6-735771c56057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:05.541905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990e47-3b1f-4884-8ae6-735771c56057 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:05.542188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990e47-3b1f-4884-8ae6-735771c56057 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:05.542464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990e47-3b1f-4884-8ae6-735771c56057 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:05.543292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990e47-3b1f-4884-8ae6-735771c56057 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:05.543605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990e47-3b1f-4884-8ae6-735771c56057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:05.545047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990e47-3b1f-4884-8ae6-735771c56057 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:05.562299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 624/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jun 23 12:57:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:05.568499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1a1e0-efa0-4de7-b7e4-c79253dfa86a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:05.665159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1a1e0-efa0-4de7-b7e4-c79253dfa86a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:05.697797 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fce3f-3e27-431a-8499-84ed0bb80e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:05.701223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fce3f-3e27-431a-8499-84ed0bb80e4d None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:05.701223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fce3f-3e27-431a-8499-84ed0bb80e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:05.701223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fce3f-3e27-431a-8499-84ed0bb80e4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:05.758590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:05.764752 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fce3f-3e27-431a-8499-84ed0bb80e4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:05.766193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fce3f-3e27-431a-8499-84ed0bb80e4d None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:05.862591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 617/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:57:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:57:05.868484 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990e47-3b1f-4884-8ae6-735771c56057 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:05.895681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:05.965276 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990e47-3b1f-4884-8ae6-735771c56057 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:05.998470 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447a8e0-46ee-43d1-9cb5-f831a2f1d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:05.999245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447a8e0-46ee-43d1-9cb5-f831a2f1d8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:05.999527 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447a8e0-46ee-43d1-9cb5-f831a2f1d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:05.999804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447a8e0-46ee-43d1-9cb5-f831a2f1d8a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:06.010148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447a8e0-46ee-43d1-9cb5-f831a2f1d8a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:06.011621 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447a8e0-46ee-43d1-9cb5-f831a2f1d8a9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-1447a8e0-46ee-43d1-9cb5-f831a2f1d8a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:57:06.028804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:06.030606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:06.031719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:57:06.031719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:57:06.031719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:06.031719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:06.031719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 625/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:06.035800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fce3f-3e27-431a-8499-84ed0bb80e4d None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:06.126368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:06.131861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fce3f-3e27-431a-8499-84ed0bb80e4d None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:06.164130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f292e4-48a8-4d44-8628-8f67e0dc1268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:06.164809 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f292e4-48a8-4d44-8628-8f67e0dc1268 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:06.165094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f292e4-48a8-4d44-8628-8f67e0dc1268 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:06.169160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f292e4-48a8-4d44-8628-8f67e0dc1268 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:06.169160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f292e4-48a8-4d44-8628-8f67e0dc1268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:06.169160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f292e4-48a8-4d44-8628-8f67e0dc1268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:06.169160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f292e4-48a8-4d44-8628-8f67e0dc1268 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:06.179507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 618/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:06.185253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447a8e0-46ee-43d1-9cb5-f831a2f1d8a9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:06.260218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:06.280781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447a8e0-46ee-43d1-9cb5-f831a2f1d8a9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:06.313753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82837abb-6e9e-4ea3-a0aa-5fc569b56d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:06.314562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82837abb-6e9e-4ea3-a0aa-5fc569b56d39 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:06.314880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82837abb-6e9e-4ea3-a0aa-5fc569b56d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:06.315157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82837abb-6e9e-4ea3-a0aa-5fc569b56d39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:06.321729 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82837abb-6e9e-4ea3-a0aa-5fc569b56d39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:06.323149 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82837abb-6e9e-4ea3-a0aa-5fc569b56d39 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-82837abb-6e9e-4ea3-a0aa-5fc569b56d39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:57:06.336892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:06.342246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:06.343162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:57:06.343162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:57:06.343162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:57:06.343162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:57:06.343162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:57:06.343162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:57:06.343162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:57:06.343162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:06.343162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 626/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:06.344605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f292e4-48a8-4d44-8628-8f67e0dc1268 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:06.441210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f292e4-48a8-4d44-8628-8f67e0dc1268 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:06.474490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90152e-b9ca-4627-8c71-ecf7a5d234fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:06.475144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90152e-b9ca-4627-8c71-ecf7a5d234fa None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:06.475464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90152e-b9ca-4627-8c71-ecf7a5d234fa None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:06.475739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90152e-b9ca-4627-8c71-ecf7a5d234fa None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:06.476518 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90152e-b9ca-4627-8c71-ecf7a5d234fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:06.476855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90152e-b9ca-4627-8c71-ecf7a5d234fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:06.478273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90152e-b9ca-4627-8c71-ecf7a5d234fa None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:06.490466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 619/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:06.496377 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82837abb-6e9e-4ea3-a0aa-5fc569b56d39 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:06.592609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82837abb-6e9e-4ea3-a0aa-5fc569b56d39 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:06.624718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808ed3f-b018-4c58-847d-0905f5cc9284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:06.625366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808ed3f-b018-4c58-847d-0905f5cc9284 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:06.625647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808ed3f-b018-4c58-847d-0905f5cc9284 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:06.625923 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808ed3f-b018-4c58-847d-0905f5cc9284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:06.627321 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808ed3f-b018-4c58-847d-0905f5cc9284 None admin] RBAC: Adding query filter params (role.id=af902c13373445999fcf70be57ba260f, scope.project.id=311787f32b54485682be669bca9998f8, user.id=8644754798b5439c954c86dc9aa9e7af) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:06.627633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808ed3f-b018-4c58-847d-0905f5cc9284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:06.629123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808ed3f-b018-4c58-847d-0905f5cc9284 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:06.634991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 627/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:57:06 2022] GET /identity/v3/role_assignments?user.id=8644754798b5439c954c86dc9aa9e7af&scope.project.id=311787f32b54485682be669bca9998f8&role.id=af902c13373445999fcf70be57ba260f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:08.712946 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbd97f-44f2-4b26-8da4-bbaccdbfe3f9 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:08.713499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbd97f-44f2-4b26-8da4-bbaccdbfe3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:08.713499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbd97f-44f2-4b26-8da4-bbaccdbfe3f9 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:08.714878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 620/1247] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:57:08.720820 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4fca8-ac38-4125-a5b4-313c388455fb None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:08.721246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4fca8-ac38-4125-a5b4-313c388455fb None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:08.721369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4fca8-ac38-4125-a5b4-313c388455fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:08.726375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:08.738384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5ec4fca8-ac38-4125-a5b4-313c388455fb None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:57:08.739590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5ec4fca8-ac38-4125-a5b4-313c388455fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:57:08.803483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 628/1248] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:57:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:57:08.826609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbd97f-44f2-4b26-8da4-bbaccdbfe3f9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:08.844764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:08.926064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbd97f-44f2-4b26-8da4-bbaccdbfe3f9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:08.959366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b0e10-970c-4ae9-9f56-c9d6fa172eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:08.960144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b0e10-970c-4ae9-9f56-c9d6fa172eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:08.960428 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b0e10-970c-4ae9-9f56-c9d6fa172eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:08.960730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b0e10-970c-4ae9-9f56-c9d6fa172eb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:08.971126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b0e10-970c-4ae9-9f56-c9d6fa172eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-021b0e10-970c-4ae9-9f56-c9d6fa172eb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:57:08.978567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:08.979634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:08.980638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 621/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:57:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:08.985750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4fca8-ac38-4125-a5b4-313c388455fb None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:09.081392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4fca8-ac38-4125-a5b4-313c388455fb None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:09.109613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:09.114557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eb764-a493-4391-a4c7-08d58242d3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:09.115225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eb764-a493-4391-a4c7-08d58242d3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:09.115509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eb764-a493-4391-a4c7-08d58242d3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:09.115790 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eb764-a493-4391-a4c7-08d58242d3a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:09.116530 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eb764-a493-4391-a4c7-08d58242d3a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:09.116871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eb764-a493-4391-a4c7-08d58242d3a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:09.118259 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eb764-a493-4391-a4c7-08d58242d3a6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:09.125974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 629/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:57:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:09.132324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b0e10-970c-4ae9-9f56-c9d6fa172eb4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:09.208207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:09.230869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b0e10-970c-4ae9-9f56-c9d6fa172eb4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:09.263475 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54e98-eb1e-49d0-bc4d-4639cbbe1932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:09.264264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54e98-eb1e-49d0-bc4d-4639cbbe1932 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:09.264545 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54e98-eb1e-49d0-bc4d-4639cbbe1932 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:09.264850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54e98-eb1e-49d0-bc4d-4639cbbe1932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:09.276049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e54e98-eb1e-49d0-bc4d-4639cbbe1932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:09.277511 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e54e98-eb1e-49d0-bc4d-4639cbbe1932 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-e2e54e98-eb1e-49d0-bc4d-4639cbbe1932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:57:09.293855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:09.294887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:09.296043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:57:09.296043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:57:09.296043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:09.296043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:09.296043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 622/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:09.300886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eb764-a493-4391-a4c7-08d58242d3a6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:09.398459 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eb764-a493-4391-a4c7-08d58242d3a6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:09.430707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d786a1-0212-4e2c-8c28-2d4a90f0bb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:09.431359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d786a1-0212-4e2c-8c28-2d4a90f0bb3e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:09.431644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d786a1-0212-4e2c-8c28-2d4a90f0bb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:09.432464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d786a1-0212-4e2c-8c28-2d4a90f0bb3e None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:09.432715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d786a1-0212-4e2c-8c28-2d4a90f0bb3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:09.432951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d786a1-0212-4e2c-8c28-2d4a90f0bb3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:09.434310 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d786a1-0212-4e2c-8c28-2d4a90f0bb3e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:09.446194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 630/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:09.451870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54e98-eb1e-49d0-bc4d-4639cbbe1932 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:09.547750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54e98-eb1e-49d0-bc4d-4639cbbe1932 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:09.573377 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:09.580875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4628fc-3fba-4ac9-984b-6fcf14cd68d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:09.581661 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4628fc-3fba-4ac9-984b-6fcf14cd68d9 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:09.581945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4628fc-3fba-4ac9-984b-6fcf14cd68d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:09.582214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4628fc-3fba-4ac9-984b-6fcf14cd68d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:09.589318 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4628fc-3fba-4ac9-984b-6fcf14cd68d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:09.590743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4628fc-3fba-4ac9-984b-6fcf14cd68d9 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-3f4628fc-3fba-4ac9-984b-6fcf14cd68d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:57:09.604588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:09.605810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:09.606780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:09.606780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:09.606780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:57:09.606780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:57:09.606780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:57:09.606780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:57:09.606780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:57:09.606780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:57:09.606780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:57:09.606780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:09.606780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 623/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:09.612005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d786a1-0212-4e2c-8c28-2d4a90f0bb3e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:09.664557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:09.707256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d786a1-0212-4e2c-8c28-2d4a90f0bb3e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:09.739882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08090ef9-bdce-4867-af2c-486986f71811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:09.740537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08090ef9-bdce-4867-af2c-486986f71811 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:09.740850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08090ef9-bdce-4867-af2c-486986f71811 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:09.741130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08090ef9-bdce-4867-af2c-486986f71811 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:09.741958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08090ef9-bdce-4867-af2c-486986f71811 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:09.742269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08090ef9-bdce-4867-af2c-486986f71811 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:09.743688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08090ef9-bdce-4867-af2c-486986f71811 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:09.760443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 631/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jun 23 12:57:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:09.767602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4628fc-3fba-4ac9-984b-6fcf14cd68d9 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:09.865035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4628fc-3fba-4ac9-984b-6fcf14cd68d9 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:09.897066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97070a5-95aa-4e48-9136-c3ed7231c74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:09.897709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97070a5-95aa-4e48-9136-c3ed7231c74a None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:09.898000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97070a5-95aa-4e48-9136-c3ed7231c74a None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:09.898279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97070a5-95aa-4e48-9136-c3ed7231c74a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:09.951299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:09.962886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97070a5-95aa-4e48-9136-c3ed7231c74a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:09.964359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97070a5-95aa-4e48-9136-c3ed7231c74a None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:10.057897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 624/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:57:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:57:10.063851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08090ef9-bdce-4867-af2c-486986f71811 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:10.161616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08090ef9-bdce-4867-af2c-486986f71811 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:10.174885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:10.195173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ddbb7-558c-488a-92fc-4c80aa2d5508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:10.195959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ddbb7-558c-488a-92fc-4c80aa2d5508 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:10.196246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ddbb7-558c-488a-92fc-4c80aa2d5508 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:10.196524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ddbb7-558c-488a-92fc-4c80aa2d5508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:10.207098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ddbb7-558c-488a-92fc-4c80aa2d5508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:10.208593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ddbb7-558c-488a-92fc-4c80aa2d5508 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-9c9ddbb7-558c-488a-92fc-4c80aa2d5508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:57:10.226196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:10.228000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:10.230184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:57:10.230184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:57:10.230184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:10.230184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:10.230184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 632/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:10.234658 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97070a5-95aa-4e48-9136-c3ed7231c74a None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:10.319469 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:10.331186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97070a5-95aa-4e48-9136-c3ed7231c74a None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:10.363131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52035003-b783-400d-ba36-a439540a6387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:10.363778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52035003-b783-400d-ba36-a439540a6387 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:10.364060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52035003-b783-400d-ba36-a439540a6387 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:10.364334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52035003-b783-400d-ba36-a439540a6387 None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:10.365070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52035003-b783-400d-ba36-a439540a6387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:10.365371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52035003-b783-400d-ba36-a439540a6387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:10.366766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52035003-b783-400d-ba36-a439540a6387 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:10.377680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 625/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:10.383466 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ddbb7-558c-488a-92fc-4c80aa2d5508 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:10.480330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ddbb7-558c-488a-92fc-4c80aa2d5508 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:10.512663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1a941-ac99-4936-8483-cb295c166c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:10.513464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1a941-ac99-4936-8483-cb295c166c0e None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:10.513750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1a941-ac99-4936-8483-cb295c166c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:10.514029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1a941-ac99-4936-8483-cb295c166c0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:10.521302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1a941-ac99-4936-8483-cb295c166c0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:10.522728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1a941-ac99-4936-8483-cb295c166c0e None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-3ce1a941-ac99-4936-8483-cb295c166c0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:57:10.536593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:10.537679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:10.538736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:57:10.538736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:57:10.538736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:57:10.538736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:57:10.538736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:57:10.538736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:57:10.538736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:57:10.538736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:10.538736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 633/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:10.543558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52035003-b783-400d-ba36-a439540a6387 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:10.639879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52035003-b783-400d-ba36-a439540a6387 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:10.672423 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88832f1d-bb43-47a8-9c42-6313661b3bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:10.673112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88832f1d-bb43-47a8-9c42-6313661b3bdd None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:10.673396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88832f1d-bb43-47a8-9c42-6313661b3bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:10.673668 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88832f1d-bb43-47a8-9c42-6313661b3bdd None admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:10.674443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88832f1d-bb43-47a8-9c42-6313661b3bdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:10.674746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88832f1d-bb43-47a8-9c42-6313661b3bdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:10.676153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88832f1d-bb43-47a8-9c42-6313661b3bdd None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:10.687587 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 626/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:10.694176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1a941-ac99-4936-8483-cb295c166c0e None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:10.719724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:10.790679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1a941-ac99-4936-8483-cb295c166c0e None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:10.824103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302410a-5882-49d7-a06e-91affd2f0723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:10.824771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302410a-5882-49d7-a06e-91affd2f0723 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:10.825054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302410a-5882-49d7-a06e-91affd2f0723 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:10.825329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302410a-5882-49d7-a06e-91affd2f0723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:10.826166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302410a-5882-49d7-a06e-91affd2f0723 None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=311787f32b54485682be669bca9998f8, user.id=8644754798b5439c954c86dc9aa9e7af) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:10.826459 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302410a-5882-49d7-a06e-91affd2f0723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:10.827865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302410a-5882-49d7-a06e-91affd2f0723 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:10.833736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 634/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:57:10 2022] GET /identity/v3/role_assignments?user.id=8644754798b5439c954c86dc9aa9e7af&scope.project.id=311787f32b54485682be669bca9998f8&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:12.830907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e6e5a-05c8-4020-b10d-bcec30f3383f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:12.831450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e6e5a-05c8-4020-b10d-bcec30f3383f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:12.831561 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e6e5a-05c8-4020-b10d-bcec30f3383f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:12.833118 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 627/1261] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:57:12.838425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969fe8e-6488-4c20-bdf9-5e0d340f4941 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:12.838825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969fe8e-6488-4c20-bdf9-5e0d340f4941 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:12.838994 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969fe8e-6488-4c20-bdf9-5e0d340f4941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:12.855371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c969fe8e-6488-4c20-bdf9-5e0d340f4941 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:57:12.856544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c969fe8e-6488-4c20-bdf9-5e0d340f4941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:57:12.921381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 635/1262] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:57:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:57:12.944356 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e6e5a-05c8-4020-b10d-bcec30f3383f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:12.955592 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:13.041284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e6e5a-05c8-4020-b10d-bcec30f3383f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:13.074951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0e215-dcba-4743-852f-a381525c9e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:13.075748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0e215-dcba-4743-852f-a381525c9e64 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:13.076035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0e215-dcba-4743-852f-a381525c9e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:13.076337 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0e215-dcba-4743-852f-a381525c9e64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:13.087202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0e215-dcba-4743-852f-a381525c9e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-34b0e215-dcba-4743-852f-a381525c9e64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:57:13.094835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:13.096596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:13.097829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 628/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:57:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:13.102312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969fe8e-6488-4c20-bdf9-5e0d340f4941 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:13.120380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:13.198952 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969fe8e-6488-4c20-bdf9-5e0d340f4941 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:13.231587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b29b22-e04b-4c2d-abbb-8436a06722fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:13.232242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b29b22-e04b-4c2d-abbb-8436a06722fb None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:13.232546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b29b22-e04b-4c2d-abbb-8436a06722fb None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:13.232832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b29b22-e04b-4c2d-abbb-8436a06722fb None admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:13.233565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b29b22-e04b-4c2d-abbb-8436a06722fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:13.245364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b29b22-e04b-4c2d-abbb-8436a06722fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:13.245364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b29b22-e04b-4c2d-abbb-8436a06722fb None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:13.245364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 636/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:57:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:13.248682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0e215-dcba-4743-852f-a381525c9e64 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:13.313514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:13.347162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0e215-dcba-4743-852f-a381525c9e64 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:13.379309 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d5070-9db3-464e-b889-db3f97a040a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:13.380125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d5070-9db3-464e-b889-db3f97a040a5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:13.380408 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d5070-9db3-464e-b889-db3f97a040a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:13.380775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d5070-9db3-464e-b889-db3f97a040a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:13.391113 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d5070-9db3-464e-b889-db3f97a040a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:13.393128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d5070-9db3-464e-b889-db3f97a040a5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-6b2d5070-9db3-464e-b889-db3f97a040a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:57:13.411281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:13.415626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:13.416787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:57:13.416787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:57:13.416787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:13.416787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:13.416787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 629/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:13.418385 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b29b22-e04b-4c2d-abbb-8436a06722fb None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:13.496525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:13.514471 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b29b22-e04b-4c2d-abbb-8436a06722fb None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:13.547687 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5693c19-a908-4b26-9f45-d6f2f49d12fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:13.548399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5693c19-a908-4b26-9f45-d6f2f49d12fd None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:13.548713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5693c19-a908-4b26-9f45-d6f2f49d12fd None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:13.548999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5693c19-a908-4b26-9f45-d6f2f49d12fd None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:13.549740 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5693c19-a908-4b26-9f45-d6f2f49d12fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:13.550050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5693c19-a908-4b26-9f45-d6f2f49d12fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:13.551413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5693c19-a908-4b26-9f45-d6f2f49d12fd None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:13.562151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 637/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:13.568403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d5070-9db3-464e-b889-db3f97a040a5 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:13.665341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d5070-9db3-464e-b889-db3f97a040a5 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:13.683782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:13.697555 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4405aae-e207-4ca9-9b0c-49fa5a2c9062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:13.698334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4405aae-e207-4ca9-9b0c-49fa5a2c9062 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:13.698614 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4405aae-e207-4ca9-9b0c-49fa5a2c9062 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:13.698884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4405aae-e207-4ca9-9b0c-49fa5a2c9062 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:13.707332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4405aae-e207-4ca9-9b0c-49fa5a2c9062 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:13.708782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4405aae-e207-4ca9-9b0c-49fa5a2c9062 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-f4405aae-e207-4ca9-9b0c-49fa5a2c9062 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:57:13.722530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:13.723615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:13.724963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:13.724963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:13.724963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:57:13.724963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:57:13.724963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:57:13.724963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:57:13.724963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:57:13.724963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:57:13.724963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:57:13.724963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:13.724963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 630/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:13.729472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5693c19-a908-4b26-9f45-d6f2f49d12fd None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:13.825965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5693c19-a908-4b26-9f45-d6f2f49d12fd None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:13.858433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf0bc-32c4-43bb-8e61-de0c577422c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:13.859096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf0bc-32c4-43bb-8e61-de0c577422c2 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:13.859382 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf0bc-32c4-43bb-8e61-de0c577422c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:13.859660 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf0bc-32c4-43bb-8e61-de0c577422c2 None admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:13.860494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daf0bc-32c4-43bb-8e61-de0c577422c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:13.860834 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daf0bc-32c4-43bb-8e61-de0c577422c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:13.862251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daf0bc-32c4-43bb-8e61-de0c577422c2 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:13.870890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:13.879037 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 638/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jun 23 12:57:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:13.884895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4405aae-e207-4ca9-9b0c-49fa5a2c9062 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:13.982061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4405aae-e207-4ca9-9b0c-49fa5a2c9062 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:14.015486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03129d5a-9f4f-490e-8e1f-470126340e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:14.016267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03129d5a-9f4f-490e-8e1f-470126340e83 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:14.016551 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03129d5a-9f4f-490e-8e1f-470126340e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:14.016881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03129d5a-9f4f-490e-8e1f-470126340e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:14.027222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03129d5a-9f4f-490e-8e1f-470126340e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:14.028654 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03129d5a-9f4f-490e-8e1f-470126340e83 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-03129d5a-9f4f-490e-8e1f-470126340e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:57:14.045183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:14.046871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:14.047761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:57:14.047761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:57:14.047761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:14.047761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:14.047761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 631/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:14.052635 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf0bc-32c4-43bb-8e61-de0c577422c2 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:14.151860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf0bc-32c4-43bb-8e61-de0c577422c2 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:14.184947 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef9e4e-f3b9-48e0-8256-0bd36da381c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:14.185600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef9e4e-f3b9-48e0-8256-0bd36da381c6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:14.185891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef9e4e-f3b9-48e0-8256-0bd36da381c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:14.186165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef9e4e-f3b9-48e0-8256-0bd36da381c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:14.186901 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef9e4e-f3b9-48e0-8256-0bd36da381c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:14.187211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef9e4e-f3b9-48e0-8256-0bd36da381c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:14.188582 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef9e4e-f3b9-48e0-8256-0bd36da381c6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:14.199472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 639/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:14.205639 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03129d5a-9f4f-490e-8e1f-470126340e83 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:14.237529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:14.303234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03129d5a-9f4f-490e-8e1f-470126340e83 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:14.335643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc0730-2328-4e6a-ac4e-bdf890a9c6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:14.336460 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc0730-2328-4e6a-ac4e-bdf890a9c6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:14.336783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc0730-2328-4e6a-ac4e-bdf890a9c6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:14.337064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc0730-2328-4e6a-ac4e-bdf890a9c6b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:14.343441 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc0730-2328-4e6a-ac4e-bdf890a9c6b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:14.344943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc0730-2328-4e6a-ac4e-bdf890a9c6b7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-57bc0730-2328-4e6a-ac4e-bdf890a9c6b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:57:14.358677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:14.359701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:14.360744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:57:14.360744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:57:14.360744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:57:14.360744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:57:14.360744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:57:14.360744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:57:14.360744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:57:14.360744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:14.360744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 632/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:57:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:14.365805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef9e4e-f3b9-48e0-8256-0bd36da381c6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:14.423849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:14.464169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef9e4e-f3b9-48e0-8256-0bd36da381c6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:14.497180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62158d0-cc7b-4362-9028-b7fde8310092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:14.497784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62158d0-cc7b-4362-9028-b7fde8310092 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:14.498064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62158d0-cc7b-4362-9028-b7fde8310092 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:14.498338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62158d0-cc7b-4362-9028-b7fde8310092 None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:14.499117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62158d0-cc7b-4362-9028-b7fde8310092 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:14.499425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62158d0-cc7b-4362-9028-b7fde8310092 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:14.500859 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62158d0-cc7b-4362-9028-b7fde8310092 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:14.512270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 640/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:57:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:14.518437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc0730-2328-4e6a-ac4e-bdf890a9c6b7 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:14.610178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:14.619080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc0730-2328-4e6a-ac4e-bdf890a9c6b7 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:14.651345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c5da1-4322-4098-8741-c6a1faa46312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:14.652218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c5da1-4322-4098-8741-c6a1faa46312 None admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:14.652498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c5da1-4322-4098-8741-c6a1faa46312 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:14.652802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c5da1-4322-4098-8741-c6a1faa46312 None admin] PATH_INFO: `/v3/projects/311787f32b54485682be669bca9998f8/users/8644754798b5439c954c86dc9aa9e7af/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:14.654717 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c5da1-4322-4098-8741-c6a1faa46312 None admin] RBAC: Authorizing `identity:create_grant(project_id=311787f32b54485682be669bca9998f8, user_id=8644754798b5439c954c86dc9aa9e7af, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:14.656138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c5da1-4322-4098-8741-c6a1faa46312 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:14.798695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 633/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 23 12:57:14 2022] PUT /identity/v3/projects/311787f32b54485682be669bca9998f8/users/8644754798b5439c954c86dc9aa9e7af/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:57:16.814401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b44da-7e36-4168-a321-21df99bf4ed5 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:16.814997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b44da-7e36-4168-a321-21df99bf4ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:16.814997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b44da-7e36-4168-a321-21df99bf4ed5 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:16.816306 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 641/1274] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:57:16.821442 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9204aa9-34ac-4a65-a870-560c3d03fa12 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:16.821844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9204aa9-34ac-4a65-a870-560c3d03fa12 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:16.822013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9204aa9-34ac-4a65-a870-560c3d03fa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:16.837858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d9204aa9-34ac-4a65-a870-560c3d03fa12 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:57:16.839040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d9204aa9-34ac-4a65-a870-560c3d03fa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:57:16.905387 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 634/1275] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:57:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:57:16.929679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b44da-7e36-4168-a321-21df99bf4ed5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:17.027164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b44da-7e36-4168-a321-21df99bf4ed5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:17.044837 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:17.060712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd5c61-1499-4cdc-b2df-93c2c3092e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:17.061496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd5c61-1499-4cdc-b2df-93c2c3092e6b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:17.061783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd5c61-1499-4cdc-b2df-93c2c3092e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:17.062058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd5c61-1499-4cdc-b2df-93c2c3092e6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:17.072205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd5c61-1499-4cdc-b2df-93c2c3092e6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-dbbd5c61-1499-4cdc-b2df-93c2c3092e6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:57:17.080452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:17.081590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:17.082583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 642/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 23 12:57:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:17.087576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9204aa9-34ac-4a65-a870-560c3d03fa12 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:17.168013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:17.186037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9204aa9-34ac-4a65-a870-560c3d03fa12 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:17.220473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed59d37-045a-40da-b06d-ba188416f768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:17.221164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59d37-045a-40da-b06d-ba188416f768 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:17.221449 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59d37-045a-40da-b06d-ba188416f768 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:17.221723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59d37-045a-40da-b06d-ba188416f768 None admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:17.222490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed59d37-045a-40da-b06d-ba188416f768 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:17.222755 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed59d37-045a-40da-b06d-ba188416f768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:17.224114 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed59d37-045a-40da-b06d-ba188416f768 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:17.231940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 635/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 23 12:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:17.237636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd5c61-1499-4cdc-b2df-93c2c3092e6b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:17.334419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd5c61-1499-4cdc-b2df-93c2c3092e6b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:17.366299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf669fcd-3210-4e40-b39f-93f3cbf780ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:17.367120 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf669fcd-3210-4e40-b39f-93f3cbf780ed None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:17.367407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf669fcd-3210-4e40-b39f-93f3cbf780ed None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:17.367686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf669fcd-3210-4e40-b39f-93f3cbf780ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:17.378516 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf669fcd-3210-4e40-b39f-93f3cbf780ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:17.379944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf669fcd-3210-4e40-b39f-93f3cbf780ed None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-cf669fcd-3210-4e40-b39f-93f3cbf780ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:57:17.397230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:17.398294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:17.399397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:57:17.399397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:57:17.399397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:17.399397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:17.399397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 643/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:17.404127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed59d37-045a-40da-b06d-ba188416f768 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:17.500572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed59d37-045a-40da-b06d-ba188416f768 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:17.534528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4fb30-a7c5-4b3d-9042-3a3050cf12fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:17.535182 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4fb30-a7c5-4b3d-9042-3a3050cf12fb None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:17.535464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4fb30-a7c5-4b3d-9042-3a3050cf12fb None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:17.535740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4fb30-a7c5-4b3d-9042-3a3050cf12fb None admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:17.536445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4fb30-a7c5-4b3d-9042-3a3050cf12fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:17.536776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4fb30-a7c5-4b3d-9042-3a3050cf12fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:17.538130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4fb30-a7c5-4b3d-9042-3a3050cf12fb None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:17.549561 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 636/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:17.555288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf669fcd-3210-4e40-b39f-93f3cbf780ed None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:17.586010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:17.651070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf669fcd-3210-4e40-b39f-93f3cbf780ed None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:17.683969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364f70d-5305-4ca7-a848-cc69d2fa86f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:17.684789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364f70d-5305-4ca7-a848-cc69d2fa86f0 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:17.685078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364f70d-5305-4ca7-a848-cc69d2fa86f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:17.685356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364f70d-5305-4ca7-a848-cc69d2fa86f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:17.692691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364f70d-5305-4ca7-a848-cc69d2fa86f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:17.694139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364f70d-5305-4ca7-a848-cc69d2fa86f0 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-c364f70d-5305-4ca7-a848-cc69d2fa86f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:57:17.709145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:17.710281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:17.711664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:17.711664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:17.711664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:57:17.711664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:57:17.711664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:57:17.711664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:57:17.711664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:57:17.711664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:57:17.711664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:57:17.711664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:17.711664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 644/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:17.715988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4fb30-a7c5-4b3d-9042-3a3050cf12fb None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:17.719747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:17.812644 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4fb30-a7c5-4b3d-9042-3a3050cf12fb None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:17.848384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5cba0-4a6a-40fb-927a-963318139cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:17.849060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5cba0-4a6a-40fb-927a-963318139cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:17.849340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5cba0-4a6a-40fb-927a-963318139cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:17.849612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5cba0-4a6a-40fb-927a-963318139cc8 None admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:17.850440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5cba0-4a6a-40fb-927a-963318139cc8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:17.850748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5cba0-4a6a-40fb-927a-963318139cc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:17.852159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5cba0-4a6a-40fb-927a-963318139cc8 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:17.869312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 637/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jun 23 12:57:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:17.875020 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364f70d-5305-4ca7-a848-cc69d2fa86f0 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:17.961664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:17.970768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364f70d-5305-4ca7-a848-cc69d2fa86f0 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:18.003318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf7676-e4aa-44f2-93b1-405abe0aedd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:18.003953 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf7676-e4aa-44f2-93b1-405abe0aedd6 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:18.004238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf7676-e4aa-44f2-93b1-405abe0aedd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:18.004518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf7676-e4aa-44f2-93b1-405abe0aedd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:18.067887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf7676-e4aa-44f2-93b1-405abe0aedd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:18.069390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf7676-e4aa-44f2-93b1-405abe0aedd6 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:18.154807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:18.164926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 645/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 23 12:57:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:57:18.170794 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5cba0-4a6a-40fb-927a-963318139cc8 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:18.230891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:18.267738 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5cba0-4a6a-40fb-927a-963318139cc8 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:18.301059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad60324-6e60-4968-9bcc-116e79567888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:18.301867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad60324-6e60-4968-9bcc-116e79567888 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:18.302153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad60324-6e60-4968-9bcc-116e79567888 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:18.302431 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad60324-6e60-4968-9bcc-116e79567888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:18.312230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad60324-6e60-4968-9bcc-116e79567888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:18.313698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad60324-6e60-4968-9bcc-116e79567888 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-fad60324-6e60-4968-9bcc-116e79567888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:57:18.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:18.331941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:18.333057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:57:18.333057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:57:18.333057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:57:18.333057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:18.333057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 638/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 12:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:18.337727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf7676-e4aa-44f2-93b1-405abe0aedd6 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:18.433054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf7676-e4aa-44f2-93b1-405abe0aedd6 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:18.465223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4244ff-1a64-4fbb-b044-c37eca1640f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:18.465881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4244ff-1a64-4fbb-b044-c37eca1640f8 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:18.466163 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4244ff-1a64-4fbb-b044-c37eca1640f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:18.466438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4244ff-1a64-4fbb-b044-c37eca1640f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:18.467150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4244ff-1a64-4fbb-b044-c37eca1640f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:18.467462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4244ff-1a64-4fbb-b044-c37eca1640f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:18.468830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4244ff-1a64-4fbb-b044-c37eca1640f8 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:18.480106 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 646/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 23 12:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:57:18.485723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad60324-6e60-4968-9bcc-116e79567888 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:18.583106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad60324-6e60-4968-9bcc-116e79567888 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:18.597197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:18.616195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214f087-25e1-4800-bcc2-eb734b9051a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:18.616998 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214f087-25e1-4800-bcc2-eb734b9051a4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:18.617284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214f087-25e1-4800-bcc2-eb734b9051a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:18.617562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214f087-25e1-4800-bcc2-eb734b9051a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:18.623993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214f087-25e1-4800-bcc2-eb734b9051a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:18.629177 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214f087-25e1-4800-bcc2-eb734b9051a4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application [None req-c214f087-25e1-4800-bcc2-eb734b9051a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:57:18.640152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:18.641208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:18.642835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:57:18.642835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:57:18.642835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:57:18.642835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:57:18.642835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:57:18.642835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:57:18.642835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:57:18.642835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: ERROR keystone.server.flask.application Jun 23 12:57:18.642835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 639/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 23 12:57:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:18.647868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4244ff-1a64-4fbb-b044-c37eca1640f8 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:18.695674 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:18.743704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4244ff-1a64-4fbb-b044-c37eca1640f8 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:18.776577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec6795-c3ee-4459-9339-4aad24db151a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:18.777266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec6795-c3ee-4459-9339-4aad24db151a None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:18.777552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec6795-c3ee-4459-9339-4aad24db151a None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:18.777836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec6795-c3ee-4459-9339-4aad24db151a None admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:18.778620 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec6795-c3ee-4459-9339-4aad24db151a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:18.778930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec6795-c3ee-4459-9339-4aad24db151a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:18.780353 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec6795-c3ee-4459-9339-4aad24db151a None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:18.792351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 647/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 23 12:57:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:18.798951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214f087-25e1-4800-bcc2-eb734b9051a4 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:18.895675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214f087-25e1-4800-bcc2-eb734b9051a4 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:18.929245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42743-fd2f-42d0-9590-91dd4543217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:18.929890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42743-fd2f-42d0-9590-91dd4543217f None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:18.930166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42743-fd2f-42d0-9590-91dd4543217f None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:18.930434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42743-fd2f-42d0-9590-91dd4543217f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:18.931253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de42743-fd2f-42d0-9590-91dd4543217f None admin] RBAC: Adding query filter params (role.id=da42ba69df1c4d8a90a6bb1904777e5e, scope.project.id=311787f32b54485682be669bca9998f8, user.id=8644754798b5439c954c86dc9aa9e7af) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:18.931561 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de42743-fd2f-42d0-9590-91dd4543217f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:18.933006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de42743-fd2f-42d0-9590-91dd4543217f None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:18.938667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 640/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 23 12:57:18 2022] GET /identity/v3/role_assignments?user.id=8644754798b5439c954c86dc9aa9e7af&scope.project.id=311787f32b54485682be669bca9998f8&role.id=da42ba69df1c4d8a90a6bb1904777e5e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:20.975028 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cabe1-1352-4998-864b-2827340c393e None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:20.975561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cabe1-1352-4998-864b-2827340c393e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:20.975561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cabe1-1352-4998-864b-2827340c393e None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:20.976989 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 648/1288] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:57:20.982175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d944f28-0949-41a0-8481-78d11a9c5675 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:20.982630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d944f28-0949-41a0-8481-78d11a9c5675 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:20.982765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d944f28-0949-41a0-8481-78d11a9c5675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:20.999260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8d944f28-0949-41a0-8481-78d11a9c5675 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:57:21.000450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8d944f28-0949-41a0-8481-78d11a9c5675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:57:21.029551 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:21.066606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 641/1289] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:57:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:57:21.089732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cabe1-1352-4998-864b-2827340c393e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:21.187517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cabe1-1352-4998-864b-2827340c393e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:21.199084 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:21.221615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2a439-4268-4dc1-b546-bbf942b0124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:21.222396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2a439-4268-4dc1-b546-bbf942b0124b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:21.222679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2a439-4268-4dc1-b546-bbf942b0124b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:21.222955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2a439-4268-4dc1-b546-bbf942b0124b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:21.223594 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2a439-4268-4dc1-b546-bbf942b0124b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:21.225014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2a439-4268-4dc1-b546-bbf942b0124b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-53d2a439-4268-4dc1-b546-bbf942b0124b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:21.236448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:21.237696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:21.238765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 649/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 23 12:57:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:21.243555 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d944f28-0949-41a0-8481-78d11a9c5675 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:21.342007 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d944f28-0949-41a0-8481-78d11a9c5675 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:21.374027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1587b-7827-4940-9b8a-14c18dacefa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:21.374680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1587b-7827-4940-9b8a-14c18dacefa5 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:21.374963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1587b-7827-4940-9b8a-14c18dacefa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:21.375236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1587b-7827-4940-9b8a-14c18dacefa5 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:21.376454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1587b-7827-4940-9b8a-14c18dacefa5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:21.376787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1587b-7827-4940-9b8a-14c18dacefa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:21.378190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1587b-7827-4940-9b8a-14c18dacefa5 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:21.382915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 642/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Jun 23 12:57:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:21.388949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2a439-4268-4dc1-b546-bbf942b0124b None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:21.486532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2a439-4268-4dc1-b546-bbf942b0124b None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:21.519016 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be61dd-c48a-45a8-94e8-ffd3b06a576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:21.519664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be61dd-c48a-45a8-94e8-ffd3b06a576b None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:21.519944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be61dd-c48a-45a8-94e8-ffd3b06a576b None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:21.520218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be61dd-c48a-45a8-94e8-ffd3b06a576b None admin] PATH_INFO: `/v3/services` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:21.521002 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be61dd-c48a-45a8-94e8-ffd3b06a576b None admin] RBAC: Adding query filter params (type=placement) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:21.521309 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be61dd-c48a-45a8-94e8-ffd3b06a576b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:21.522653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be61dd-c48a-45a8-94e8-ffd3b06a576b None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:21.526955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 650/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Jun 23 12:57:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:23.543074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94667c-6c9a-414a-8a24-d056711db0c9 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:23.543672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94667c-6c9a-414a-8a24-d056711db0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:23.543768 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94667c-6c9a-414a-8a24-d056711db0c9 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:23.545190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 643/1293] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:57:23.551302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47b531-84bc-4487-9162-568b4f7fcfe2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:23.551734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47b531-84bc-4487-9162-568b4f7fcfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:23.551858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47b531-84bc-4487-9162-568b4f7fcfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:23.568149 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2f47b531-84bc-4487-9162-568b4f7fcfe2 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:57:23.572032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2f47b531-84bc-4487-9162-568b4f7fcfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:57:23.598484 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:23.633492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 651/1294] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:57:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:57:23.657166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94667c-6c9a-414a-8a24-d056711db0c9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:23.687844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:23.755518 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94667c-6c9a-414a-8a24-d056711db0c9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:23.788371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16eeb5-297d-49a0-b616-74cb27cb5cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:23.789049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16eeb5-297d-49a0-b616-74cb27cb5cc7 None admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:23.789333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16eeb5-297d-49a0-b616-74cb27cb5cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:23.789608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16eeb5-297d-49a0-b616-74cb27cb5cc7 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:23.790321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16eeb5-297d-49a0-b616-74cb27cb5cc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:23.791674 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16eeb5-297d-49a0-b616-74cb27cb5cc7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:23.902004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 644/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 23 12:57:23 2022] POST /identity/v3/services => generated 246 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:57:25.913255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce73264-1d6d-491e-96ae-654de173cad5 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:25.913792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce73264-1d6d-491e-96ae-654de173cad5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:25.913792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce73264-1d6d-491e-96ae-654de173cad5 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:25.915163 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 652/1296] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:57:25.920316 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a97725-0ec3-44ae-ad05-0d8424988660 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:25.920754 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a97725-0ec3-44ae-ad05-0d8424988660 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:25.920921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a97725-0ec3-44ae-ad05-0d8424988660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:25.937772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-82a97725-0ec3-44ae-ad05-0d8424988660 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:57:25.938954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-82a97725-0ec3-44ae-ad05-0d8424988660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:57:26.009400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 645/1297] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:57:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:57:26.033291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce73264-1d6d-491e-96ae-654de173cad5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:26.130179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce73264-1d6d-491e-96ae-654de173cad5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:26.163348 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00049dd4-ae12-49a3-a27b-fa45d56d27f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:26.164077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00049dd4-ae12-49a3-a27b-fa45d56d27f9 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:26.164359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00049dd4-ae12-49a3-a27b-fa45d56d27f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:26.164634 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00049dd4-ae12-49a3-a27b-fa45d56d27f9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:26.165310 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00049dd4-ae12-49a3-a27b-fa45d56d27f9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:26.166669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00049dd4-ae12-49a3-a27b-fa45d56d27f9 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-00049dd4-ae12-49a3-a27b-fa45d56d27f9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:26.178255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:26.179415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:26.180704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 653/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 23 12:57:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:26.185472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a97725-0ec3-44ae-ad05-0d8424988660 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:26.202973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:26.282276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a97725-0ec3-44ae-ad05-0d8424988660 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:26.315581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aae381-f4cd-44be-8bad-7776b45b4925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:26.316259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae381-f4cd-44be-8bad-7776b45b4925 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:26.316547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae381-f4cd-44be-8bad-7776b45b4925 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:26.316906 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae381-f4cd-44be-8bad-7776b45b4925 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:26.317611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aae381-f4cd-44be-8bad-7776b45b4925 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:26.317919 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aae381-f4cd-44be-8bad-7776b45b4925 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:26.319312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aae381-f4cd-44be-8bad-7776b45b4925 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:26.324331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 646/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Jun 23 12:57:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:26.330934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00049dd4-ae12-49a3-a27b-fa45d56d27f9 None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:26.361706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:26.426709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00049dd4-ae12-49a3-a27b-fa45d56d27f9 None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:26.460127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0df5c9-d074-46d0-9a43-20fe0c2fdba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:26.460800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0df5c9-d074-46d0-9a43-20fe0c2fdba1 None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:26.461084 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0df5c9-d074-46d0-9a43-20fe0c2fdba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:26.461359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0df5c9-d074-46d0-9a43-20fe0c2fdba1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:26.462137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0df5c9-d074-46d0-9a43-20fe0c2fdba1 None admin] RBAC: Adding query filter params (interface=public, service_id=9245ab99a0344487818478a352b6ed37, region_id=RegionOne) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:26.462446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0df5c9-d074-46d0-9a43-20fe0c2fdba1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:26.463785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0df5c9-d074-46d0-9a43-20fe0c2fdba1 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:26.468625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 654/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 23 12:57:26 2022] GET /identity/v3/endpoints?service_id=9245ab99a0344487818478a352b6ed37&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:26.474492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aae381-f4cd-44be-8bad-7776b45b4925 None admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:26.552354 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:26.569724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aae381-f4cd-44be-8bad-7776b45b4925 None admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:26.602365 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae642883-0f30-4ccb-b6ea-d2bc7f8643c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:26.604134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae642883-0f30-4ccb-b6ea-d2bc7f8643c4 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:26.604134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae642883-0f30-4ccb-b6ea-d2bc7f8643c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:26.604134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae642883-0f30-4ccb-b6ea-d2bc7f8643c4 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:26.604398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae642883-0f30-4ccb-b6ea-d2bc7f8643c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:26.605581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae642883-0f30-4ccb-b6ea-d2bc7f8643c4 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:26.612217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 647/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 23 12:57:26 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:57:28.629589 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466904-50a3-4736-85e1-688942004522 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:28.630151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466904-50a3-4736-85e1-688942004522 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:28.630151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466904-50a3-4736-85e1-688942004522 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:28.631536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 655/1302] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 12:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:57:28.636461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c904d1-17bc-49fe-8972-bb2ae539b106 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:28.636874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c904d1-17bc-49fe-8972-bb2ae539b106 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:28.637054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c904d1-17bc-49fe-8972-bb2ae539b106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:28.653305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d3c904d1-17bc-49fe-8972-bb2ae539b106 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:57:28.654492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d3c904d1-17bc-49fe-8972-bb2ae539b106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:57:28.720255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 648/1303] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 12:57:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:57:28.743984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc466904-50a3-4736-85e1-688942004522 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:28.836630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:28.843151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc466904-50a3-4736-85e1-688942004522 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:28.876078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ab67-b8ec-41d9-aadf-d484912166df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:28.876894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ab67-b8ec-41d9-aadf-d484912166df None admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:28.877182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ab67-b8ec-41d9-aadf-d484912166df None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:28.877462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ab67-b8ec-41d9-aadf-d484912166df None admin] PATH_INFO: `/v3/services/placement` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:28.878108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ab67-b8ec-41d9-aadf-d484912166df None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:28.879487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ab67-b8ec-41d9-aadf-d484912166df None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-fbf6ab67-b8ec-41d9-aadf-d484912166df None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:57:28.891419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:57:28.892603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 12:57:28.894132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 656/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 23 12:57:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:57:28.899011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c904d1-17bc-49fe-8972-bb2ae539b106 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:28.973235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:28.994890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c904d1-17bc-49fe-8972-bb2ae539b106 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:29.027706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c3e12-6068-4115-800c-9ed4bb5ec9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:29.028360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c3e12-6068-4115-800c-9ed4bb5ec9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:29.028642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c3e12-6068-4115-800c-9ed4bb5ec9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:29.028973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c3e12-6068-4115-800c-9ed4bb5ec9e7 None admin] PATH_INFO: `/v3/services` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:29.029666 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c3e12-6068-4115-800c-9ed4bb5ec9e7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:57:29.029970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c3e12-6068-4115-800c-9ed4bb5ec9e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:29.031931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c3e12-6068-4115-800c-9ed4bb5ec9e7 None admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:29.037099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 649/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Jun 23 12:57:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:57:29.042837 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ab67-b8ec-41d9-aadf-d484912166df None admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:57:29.139249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ab67-b8ec-41d9-aadf-d484912166df None admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:57:29.172443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b8313-629c-46ea-9c1c-e63c22535308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:57:29.173059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8313-629c-46ea-9c1c-e63c22535308 None admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:57:29.173344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8313-629c-46ea-9c1c-e63c22535308 None admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:57:29.173619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8313-629c-46ea-9c1c-e63c22535308 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:57:29.174393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b8313-629c-46ea-9c1c-e63c22535308 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:57:29.175749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b8313-629c-46ea-9c1c-e63c22535308 None admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:57:29.362805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 657/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 23 12:57:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:57:39.033932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=30 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:57:39.358036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:47.637151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c791-be2c-46e3-8e1a-b7f6bf9aaeed None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:47.638189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c791-be2c-46e3-8e1a-b7f6bf9aaeed None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:47.638737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c791-be2c-46e3-8e1a-b7f6bf9aaeed None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:47.640365 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 650/1307] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:47.645839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb7bf4-c994-44a8-a1ab-0d49a0bc4cc1 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:47.646688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb7bf4-c994-44a8-a1ab-0d49a0bc4cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:47.647186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb7bf4-c994-44a8-a1ab-0d49a0bc4cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:47.734204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-aceb7bf4-c994-44a8-a1ab-0d49a0bc4cc1 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:47.735812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-aceb7bf4-c994-44a8-a1ab-0d49a0bc4cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:47.898285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 658/1308] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:47.944145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea97e7-373f-4e9d-8de3-db0154bc6c47 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:47.944606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea97e7-373f-4e9d-8de3-db0154bc6c47 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:47.945109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea97e7-373f-4e9d-8de3-db0154bc6c47 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:47.947217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 651/1309] 10.222.0.33 () {54 vars in 964 bytes} [Thu Jun 23 13:04:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:47.955410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a26c8b-bb24-4b11-9ad4-1813c0d02281 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:47.955707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a26c8b-bb24-4b11-9ad4-1813c0d02281 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:47.956029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a26c8b-bb24-4b11-9ad4-1813c0d02281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:48.058396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-82a26c8b-bb24-4b11-9ad4-1813c0d02281 None None] MFA Rules not processed for user `b1eb257517674c63840d6a2090eb2200`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:48.059778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-82a26c8b-bb24-4b11-9ad4-1813c0d02281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:48.087999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:48.151944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 659/1310] 10.222.0.33 () {58 vars in 1061 bytes} [Thu Jun 23 13:04:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:48.161703 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea97e7-373f-4e9d-8de3-db0154bc6c47 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:48.163464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-13ea97e7-373f-4e9d-8de3-db0154bc6c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:48.275173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea97e7-373f-4e9d-8de3-db0154bc6c47 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:48.353503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d36e15-b29b-4036-8c06-b19b69e45994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:48.354542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d36e15-b29b-4036-8c06-b19b69e45994 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:48.355070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d36e15-b29b-4036-8c06-b19b69e45994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:48.355561 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d36e15-b29b-4036-8c06-b19b69e45994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:48.358245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-28d36e15-b29b-4036-8c06-b19b69e45994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:48.416634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:48.471414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d36e15-b29b-4036-8c06-b19b69e45994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:48.473051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d36e15-b29b-4036-8c06-b19b69e45994 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:48.493081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 652/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:50.801787 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01695f-8990-4f3a-9a5a-cb627083c6e4 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:50.802297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01695f-8990-4f3a-9a5a-cb627083c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:50.802297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01695f-8990-4f3a-9a5a-cb627083c6e4 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:50.803677 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 660/1312] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:50.809495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eaecf-417e-428d-ba84-685fcbadfe1a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:50.809932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eaecf-417e-428d-ba84-685fcbadfe1a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:50.810191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eaecf-417e-428d-ba84-685fcbadfe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:50.879524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-037eaecf-417e-428d-ba84-685fcbadfe1a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:50.880737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-037eaecf-417e-428d-ba84-685fcbadfe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:50.985465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 653/1313] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:51.037906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09fde4-6a30-475d-a01a-359ed97a0746 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:51.038328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09fde4-6a30-475d-a01a-359ed97a0746 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:51.038685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09fde4-6a30-475d-a01a-359ed97a0746 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:51.040180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 661/1314] 10.222.0.33 () {54 vars in 964 bytes} [Thu Jun 23 13:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:51.046734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21f2f-3a95-4402-86b4-5f9930dd06a6 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:51.047026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21f2f-3a95-4402-86b4-5f9930dd06a6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:51.047311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21f2f-3a95-4402-86b4-5f9930dd06a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:51.057776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:51.120732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-35a21f2f-3a95-4402-86b4-5f9930dd06a6 None None] MFA Rules not processed for user `b1eb257517674c63840d6a2090eb2200`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:51.121929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-35a21f2f-3a95-4402-86b4-5f9930dd06a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:51.200437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 654/1315] 10.222.0.33 () {58 vars in 1061 bytes} [Thu Jun 23 13:04:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:51.209758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09fde4-6a30-475d-a01a-359ed97a0746 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:51.211287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fc09fde4-6a30-475d-a01a-359ed97a0746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:51.314009 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09fde4-6a30-475d-a01a-359ed97a0746 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:51.383141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:51.385659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4256f-2fd1-4434-957f-bdf78ea11549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:51.386296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4256f-2fd1-4434-957f-bdf78ea11549 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:51.386575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4256f-2fd1-4434-957f-bdf78ea11549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:51.386848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4256f-2fd1-4434-957f-bdf78ea11549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:51.389137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b3a4256f-2fd1-4434-957f-bdf78ea11549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:51.494227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4256f-2fd1-4434-957f-bdf78ea11549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:51.495657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4256f-2fd1-4434-957f-bdf78ea11549 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:51.514455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 662/1316] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:54.261055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f1af6-96f4-45f4-9690-869baa9b6d7e None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:54.261055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f1af6-96f4-45f4-9690-869baa9b6d7e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:54.261055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f1af6-96f4-45f4-9690-869baa9b6d7e None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:54.261055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 655/1317] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:54.262954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a001b-cb1f-4fce-8131-f20ba38b185f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:54.263348 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a001b-cb1f-4fce-8131-f20ba38b185f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:54.263537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a001b-cb1f-4fce-8131-f20ba38b185f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:54.326333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6e9a001b-cb1f-4fce-8131-f20ba38b185f None None] MFA Rules not processed for user `447b7a5e893a41caa2ad9f9322c097ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:54.327537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6e9a001b-cb1f-4fce-8131-f20ba38b185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:54.378750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:54.422614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 663/1318] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:54.462044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f1af6-96f4-45f4-9690-869baa9b6d7e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:54.463599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-560f1af6-96f4-45f4-9690-869baa9b6d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:54.565414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f1af6-96f4-45f4-9690-869baa9b6d7e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:54.568119 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:54.637771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd791d-d9d0-42f3-8fab-77985eca6100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:54.638940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd791d-d9d0-42f3-8fab-77985eca6100 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:54.639229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd791d-d9d0-42f3-8fab-77985eca6100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:54.639506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd791d-d9d0-42f3-8fab-77985eca6100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:54.641171 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-41bd791d-d9d0-42f3-8fab-77985eca6100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:54.745599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd791d-d9d0-42f3-8fab-77985eca6100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:54.747022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd791d-d9d0-42f3-8fab-77985eca6100 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:54.765828 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 656/1319] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:57.665816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989070f1-9725-47eb-a2e2-a2f9a3bf6a59 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:57.666354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989070f1-9725-47eb-a2e2-a2f9a3bf6a59 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:57.666354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989070f1-9725-47eb-a2e2-a2f9a3bf6a59 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:57.667734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 664/1320] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:57.673541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4331e-b733-491d-8efd-b32818943b78 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:57.673931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4331e-b733-491d-8efd-b32818943b78 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:57.674102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4331e-b733-491d-8efd-b32818943b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:57.712255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:57.736908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-74b4331e-b733-491d-8efd-b32818943b78 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:57.738112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-74b4331e-b733-491d-8efd-b32818943b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:57.833564 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 657/1321] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:57.873380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989070f1-9725-47eb-a2e2-a2f9a3bf6a59 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:57.874922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-989070f1-9725-47eb-a2e2-a2f9a3bf6a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:57.974548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989070f1-9725-47eb-a2e2-a2f9a3bf6a59 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:58.043223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c9b0c-9ebf-4ece-8bc5-28ccd9caa09e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:58.043854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c9b0c-9ebf-4ece-8bc5-28ccd9caa09e service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:58.044135 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c9b0c-9ebf-4ece-8bc5-28ccd9caa09e service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:58.044986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c9b0c-9ebf-4ece-8bc5-28ccd9caa09e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:58.046585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c91c9b0c-9ebf-4ece-8bc5-28ccd9caa09e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:58.053619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:58.151048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c9b0c-9ebf-4ece-8bc5-28ccd9caa09e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:58.152484 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c9b0c-9ebf-4ece-8bc5-28ccd9caa09e service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:58.170911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 665/1322] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:01.332274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da020e8-8ecc-4097-a3a0-b79275367e7b None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:01.333014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da020e8-8ecc-4097-a3a0-b79275367e7b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:01.333014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da020e8-8ecc-4097-a3a0-b79275367e7b None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:01.334155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 658/1323] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:01.339475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29fb07-c4cb-4bb2-9c5b-0ad1bb9e4040 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:01.339873 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29fb07-c4cb-4bb2-9c5b-0ad1bb9e4040 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:01.340034 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29fb07-c4cb-4bb2-9c5b-0ad1bb9e4040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:01.406338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2b29fb07-c4cb-4bb2-9c5b-0ad1bb9e4040 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:01.407680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2b29fb07-c4cb-4bb2-9c5b-0ad1bb9e4040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:01.472605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:01.516720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 666/1324] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:01.548067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da020e8-8ecc-4097-a3a0-b79275367e7b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:01.549648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3da020e8-8ecc-4097-a3a0-b79275367e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:01.658531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da020e8-8ecc-4097-a3a0-b79275367e7b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:01.671828 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:01.738263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43028398-52da-4e35-9d9b-ae59c64186e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:01.738918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43028398-52da-4e35-9d9b-ae59c64186e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:01.739203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43028398-52da-4e35-9d9b-ae59c64186e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:01.739478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43028398-52da-4e35-9d9b-ae59c64186e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:01.741207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-43028398-52da-4e35-9d9b-ae59c64186e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:01.850989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43028398-52da-4e35-9d9b-ae59c64186e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:01.852435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43028398-52da-4e35-9d9b-ae59c64186e1 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:01.870978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 659/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:03.975467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89b3de-822e-43de-8a61-47b3609b1593 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:03.976025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89b3de-822e-43de-8a61-47b3609b1593 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:03.976025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89b3de-822e-43de-8a61-47b3609b1593 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:03.977426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 667/1326] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:03.982826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d248f75-203d-4749-a3fb-f07535d7d9c4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:03.983217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d248f75-203d-4749-a3fb-f07535d7d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:03.983393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d248f75-203d-4749-a3fb-f07535d7d9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:04.030871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:04.048164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5d248f75-203d-4749-a3fb-f07535d7d9c4 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:04.049395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5d248f75-203d-4749-a3fb-f07535d7d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:04.147529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 660/1327] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:04.184851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89b3de-822e-43de-8a61-47b3609b1593 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:04.186416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-cc89b3de-822e-43de-8a61-47b3609b1593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:04.287591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89b3de-822e-43de-8a61-47b3609b1593 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:04.360418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef731f73-a3ca-43f2-89be-dbc13d3cbce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:04.361014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef731f73-a3ca-43f2-89be-dbc13d3cbce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:04.361297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef731f73-a3ca-43f2-89be-dbc13d3cbce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:04.361572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef731f73-a3ca-43f2-89be-dbc13d3cbce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:04.363212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ef731f73-a3ca-43f2-89be-dbc13d3cbce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:04.379468 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:04.481730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef731f73-a3ca-43f2-89be-dbc13d3cbce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:04.483307 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef731f73-a3ca-43f2-89be-dbc13d3cbce9 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:04.502328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 668/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:06.586251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69bfa-6b78-4f35-b4ed-6d006f67b9a2 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:06.586813 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69bfa-6b78-4f35-b4ed-6d006f67b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:06.586923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69bfa-6b78-4f35-b4ed-6d006f67b9a2 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:06.588383 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 661/1329] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:06.596556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243e7b-fea6-49a8-818a-b78b3e4ceee0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:06.597067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243e7b-fea6-49a8-818a-b78b3e4ceee0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:06.597182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243e7b-fea6-49a8-818a-b78b3e4ceee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:06.661428 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9b243e7b-fea6-49a8-818a-b78b3e4ceee0 None None] MFA Rules not processed for user `447b7a5e893a41caa2ad9f9322c097ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:06.662630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9b243e7b-fea6-49a8-818a-b78b3e4ceee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:06.726612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:06.759756 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 669/1330] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:06.798227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69bfa-6b78-4f35-b4ed-6d006f67b9a2 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:06.799851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d7a69bfa-6b78-4f35-b4ed-6d006f67b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:06.907732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69bfa-6b78-4f35-b4ed-6d006f67b9a2 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:06.928081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:06.982121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5648f-aef9-4068-92ff-78a3894542d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:06.982688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5648f-aef9-4068-92ff-78a3894542d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:06.982974 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5648f-aef9-4068-92ff-78a3894542d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:06.983251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5648f-aef9-4068-92ff-78a3894542d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:06.984928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-20c5648f-aef9-4068-92ff-78a3894542d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:07.097376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5648f-aef9-4068-92ff-78a3894542d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:07.098823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5648f-aef9-4068-92ff-78a3894542d8 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:07.117671 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 662/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:09.749410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27721d-fdc8-429d-ad39-97ff0eab1727 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:09.749960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27721d-fdc8-429d-ad39-97ff0eab1727 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:09.749960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27721d-fdc8-429d-ad39-97ff0eab1727 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:09.751333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 670/1332] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:09.756367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc818f-d7ea-4e64-b008-0201c325a340 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:09.756782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc818f-d7ea-4e64-b008-0201c325a340 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:09.756964 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc818f-d7ea-4e64-b008-0201c325a340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:09.817587 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:09.820329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-dcdc818f-d7ea-4e64-b008-0201c325a340 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:09.821568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dcdc818f-d7ea-4e64-b008-0201c325a340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:09.916117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 663/1333] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:09.952226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27721d-fdc8-429d-ad39-97ff0eab1727 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:09.953831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fa27721d-fdc8-429d-ad39-97ff0eab1727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:10.053060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27721d-fdc8-429d-ad39-97ff0eab1727 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:10.123456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481dac7-2451-4685-a878-d948710df7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:10.124093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481dac7-2451-4685-a878-d948710df7ef service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:10.124373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481dac7-2451-4685-a878-d948710df7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:10.124644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481dac7-2451-4685-a878-d948710df7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:10.126292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9481dac7-2451-4685-a878-d948710df7ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:10.153803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:10.229331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481dac7-2451-4685-a878-d948710df7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:10.230744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481dac7-2451-4685-a878-d948710df7ef service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:10.248162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 671/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:12.317722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf09e3a-e7ab-4c25-ad68-54fe039ab66b None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:12.318321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf09e3a-e7ab-4c25-ad68-54fe039ab66b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:12.318321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf09e3a-e7ab-4c25-ad68-54fe039ab66b None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:12.319698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 664/1335] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:12.325116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dae914-7f6a-4c0f-a5e8-eca98ef4905e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:12.325567 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dae914-7f6a-4c0f-a5e8-eca98ef4905e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:12.325671 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dae914-7f6a-4c0f-a5e8-eca98ef4905e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:12.388373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-29dae914-7f6a-4c0f-a5e8-eca98ef4905e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:12.389559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-29dae914-7f6a-4c0f-a5e8-eca98ef4905e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:12.460902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:12.483168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 672/1336] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:12.522028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf09e3a-e7ab-4c25-ad68-54fe039ab66b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:12.523550 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7bf09e3a-e7ab-4c25-ad68-54fe039ab66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:12.625185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf09e3a-e7ab-4c25-ad68-54fe039ab66b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:12.654027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:12.697395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb92e11-5fc1-4cd8-ae55-1f344e97d543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:12.698032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb92e11-5fc1-4cd8-ae55-1f344e97d543 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:12.698310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb92e11-5fc1-4cd8-ae55-1f344e97d543 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:12.698581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb92e11-5fc1-4cd8-ae55-1f344e97d543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:12.700752 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bdb92e11-5fc1-4cd8-ae55-1f344e97d543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:12.806346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb92e11-5fc1-4cd8-ae55-1f344e97d543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:12.807783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb92e11-5fc1-4cd8-ae55-1f344e97d543 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:12.825927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 665/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:15.496346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594fcc9-58dc-4a79-9829-3a3be1d29194 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:15.497440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594fcc9-58dc-4a79-9829-3a3be1d29194 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:15.497440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594fcc9-58dc-4a79-9829-3a3be1d29194 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:15.498823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 673/1338] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:15.503946 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131d5a6-261a-42d4-b126-2d7f623110f0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:15.504367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131d5a6-261a-42d4-b126-2d7f623110f0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:15.504501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131d5a6-261a-42d4-b126-2d7f623110f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:15.567674 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1131d5a6-261a-42d4-b126-2d7f623110f0 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:15.568904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1131d5a6-261a-42d4-b126-2d7f623110f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:15.577450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:15.665737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 666/1339] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:15.701681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594fcc9-58dc-4a79-9829-3a3be1d29194 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:15.703244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7594fcc9-58dc-4a79-9829-3a3be1d29194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:15.803530 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594fcc9-58dc-4a79-9829-3a3be1d29194 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:15.873607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b552d8-d608-4038-921e-7ce235b6492c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:15.874248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b552d8-d608-4038-921e-7ce235b6492c service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:15.874533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b552d8-d608-4038-921e-7ce235b6492c service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:15.874811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b552d8-d608-4038-921e-7ce235b6492c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:15.876423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a3b552d8-d608-4038-921e-7ce235b6492c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:15.911592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:15.983653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b552d8-d608-4038-921e-7ce235b6492c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:15.985098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b552d8-d608-4038-921e-7ce235b6492c service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:16.004754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 674/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:20.568476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0ecf8-2f00-4f69-9cb2-e35cc8213ed8 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:20.568938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0ecf8-2f00-4f69-9cb2-e35cc8213ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:20.569089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0ecf8-2f00-4f69-9cb2-e35cc8213ed8 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:20.570488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 667/1341] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:20.576486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d49ae-cc8c-4cbd-8a74-190cd21e27b8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:20.576975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d49ae-cc8c-4cbd-8a74-190cd21e27b8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:20.577072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d49ae-cc8c-4cbd-8a74-190cd21e27b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:20.649987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c08d49ae-cc8c-4cbd-8a74-190cd21e27b8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:20.651311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c08d49ae-cc8c-4cbd-8a74-190cd21e27b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:20.748895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:20.761062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 675/1342] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:20.800450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0ecf8-2f00-4f69-9cb2-e35cc8213ed8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:20.802676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0be0ecf8-2f00-4f69-9cb2-e35cc8213ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:20.896933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0ecf8-2f00-4f69-9cb2-e35cc8213ed8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:20.900801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cde7a-db5b-4a25-926e-dea7b1325fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:20.901457 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cde7a-db5b-4a25-926e-dea7b1325fef service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:20.901742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cde7a-db5b-4a25-926e-dea7b1325fef service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:20.902020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cde7a-db5b-4a25-926e-dea7b1325fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:20.911126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cde7a-db5b-4a25-926e-dea7b1325fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:20.912551 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cde7a-db5b-4a25-926e-dea7b1325fef service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:20.922645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 668/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:23.864147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dda373-b842-4d38-a51a-2f222d738e0b None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:23.864742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dda373-b842-4d38-a51a-2f222d738e0b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:23.864742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dda373-b842-4d38-a51a-2f222d738e0b None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:23.866134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 676/1344] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:23.872428 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30445662-5b4c-435b-a2ee-398252764ead None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:23.872954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30445662-5b4c-435b-a2ee-398252764ead None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:23.873164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30445662-5b4c-435b-a2ee-398252764ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:23.903096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-30445662-5b4c-435b-a2ee-398252764ead None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:23.904306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-30445662-5b4c-435b-a2ee-398252764ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:23.933715 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:23.981880 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 669/1345] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:24.018988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dda373-b842-4d38-a51a-2f222d738e0b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:24.030299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dda373-b842-4d38-a51a-2f222d738e0b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:24.033751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2e937-67e0-4232-b85a-0a2a17f02207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:24.034384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2e937-67e0-4232-b85a-0a2a17f02207 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:24.034685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2e937-67e0-4232-b85a-0a2a17f02207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:24.034958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2e937-67e0-4232-b85a-0a2a17f02207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:24.043614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2e937-67e0-4232-b85a-0a2a17f02207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:24.045071 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2e937-67e0-4232-b85a-0a2a17f02207 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:24.055520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 677/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:28.357011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cd014-669c-44a9-8ad7-8e24109b8fe5 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:28.357508 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cd014-669c-44a9-8ad7-8e24109b8fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:28.357633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cd014-669c-44a9-8ad7-8e24109b8fe5 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:28.358942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 670/1347] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:28.364079 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240211f-7cca-4594-a1f6-bd7ecd1a79a8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:28.364484 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240211f-7cca-4594-a1f6-bd7ecd1a79a8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:28.364654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240211f-7cca-4594-a1f6-bd7ecd1a79a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:28.382739 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8240211f-7cca-4594-a1f6-bd7ecd1a79a8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:28.383935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8240211f-7cca-4594-a1f6-bd7ecd1a79a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:28.391696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 678/1348] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:28.429841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cd014-669c-44a9-8ad7-8e24109b8fe5 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:28.440908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cd014-669c-44a9-8ad7-8e24109b8fe5 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:28.444234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2dcca-1f1a-4790-a7e8-9986a8a8b839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:28.444917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2dcca-1f1a-4790-a7e8-9986a8a8b839 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:28.445199 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2dcca-1f1a-4790-a7e8-9986a8a8b839 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:28.445473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2dcca-1f1a-4790-a7e8-9986a8a8b839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:28.454660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2dcca-1f1a-4790-a7e8-9986a8a8b839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:28.459901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2dcca-1f1a-4790-a7e8-9986a8a8b839 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:28.465875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 671/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:33.379997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20b1de-973b-488e-a128-2e3b9fa078bf None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:33.380491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20b1de-973b-488e-a128-2e3b9fa078bf None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:33.380491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20b1de-973b-488e-a128-2e3b9fa078bf None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:33.381864 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 679/1350] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 23 13:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:33.392082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a8ada-403a-48b4-b69c-7be70487790f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:33.392562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a8ada-403a-48b4-b69c-7be70487790f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:33.392683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a8ada-403a-48b4-b69c-7be70487790f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:33.502130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5a1a8ada-403a-48b4-b69c-7be70487790f None None] MFA Rules not processed for user `8644754798b5439c954c86dc9aa9e7af`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:33.503513 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5a1a8ada-403a-48b4-b69c-7be70487790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:33.583427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 672/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 23 13:05:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:37.754402 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929edc5-2697-4477-bfef-b81cc5e43a6a None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:37.755288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929edc5-2697-4477-bfef-b81cc5e43a6a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:37.755554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929edc5-2697-4477-bfef-b81cc5e43a6a None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:37.757132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 680/1352] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 23 13:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:37.762879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b78636-0730-49a9-8d47-590df3bf6fb2 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:37.763317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b78636-0730-49a9-8d47-590df3bf6fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:37.763424 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b78636-0730-49a9-8d47-590df3bf6fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:37.781484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-38b78636-0730-49a9-8d47-590df3bf6fb2 None None] MFA Rules not processed for user `8644754798b5439c954c86dc9aa9e7af`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:37.782959 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-38b78636-0730-49a9-8d47-590df3bf6fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:37.791528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 673/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 23 13:05:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:38.377699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=13 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:39.392351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b311ef0-160a-485e-8595-d406d51c6468 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:39.392990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b311ef0-160a-485e-8595-d406d51c6468 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:39.392990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b311ef0-160a-485e-8595-d406d51c6468 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:39.394389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 681/1354] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 23 13:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:39.399951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b58f3-3d04-4003-83b1-0f2c2e82e98d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:39.400369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b58f3-3d04-4003-83b1-0f2c2e82e98d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:39.400507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b58f3-3d04-4003-83b1-0f2c2e82e98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:39.420427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-fc4b58f3-3d04-4003-83b1-0f2c2e82e98d None None] MFA Rules not processed for user `8644754798b5439c954c86dc9aa9e7af`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:39.421668 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fc4b58f3-3d04-4003-83b1-0f2c2e82e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:39.430251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 674/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 23 13:05:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:05:43.034365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074fb1d-3504-43a0-8ef8-2d6801a54f70 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:43.034365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074fb1d-3504-43a0-8ef8-2d6801a54f70 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:43.035034 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074fb1d-3504-43a0-8ef8-2d6801a54f70 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:43.037957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 682/1356] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:43.042361 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aa4fa-9566-4c4c-ad4a-3010fb57817f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:43.042879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aa4fa-9566-4c4c-ad4a-3010fb57817f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:43.042993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aa4fa-9566-4c4c-ad4a-3010fb57817f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:43.072166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-949aa4fa-9566-4c4c-ad4a-3010fb57817f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:43.074375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-949aa4fa-9566-4c4c-ad4a-3010fb57817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:43.087170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 675/1357] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:05:43.148046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf908044-90da-43a0-be2b-1a5a41dc90c9 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:43.148547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf908044-90da-43a0-be2b-1a5a41dc90c9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:43.149265 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf908044-90da-43a0-be2b-1a5a41dc90c9 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:43.151064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 683/1358] 10.222.0.33 () {54 vars in 961 bytes} [Thu Jun 23 13:05:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:43.159890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6944f1-c3a1-4996-9d41-bef58ffe188d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:43.160182 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6944f1-c3a1-4996-9d41-bef58ffe188d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:43.160466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6944f1-c3a1-4996-9d41-bef58ffe188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:43.206942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:43.215152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4b6944f1-c3a1-4996-9d41-bef58ffe188d None None] MFA Rules not processed for user `5874e98df57242028c0f9983dee3b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:43.216365 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4b6944f1-c3a1-4996-9d41-bef58ffe188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:43.300724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 676/1359] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Jun 23 13:05:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:43.308892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf908044-90da-43a0-be2b-1a5a41dc90c9 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:43.324003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf908044-90da-43a0-be2b-1a5a41dc90c9 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:43.330102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1821f-f184-4290-9bee-6697c7a27a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:43.330750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1821f-f184-4290-9bee-6697c7a27a6e service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:43.331037 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1821f-f184-4290-9bee-6697c7a27a6e service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:43.331316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1821f-f184-4290-9bee-6697c7a27a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:43.340295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1821f-f184-4290-9bee-6697c7a27a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:43.341917 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1821f-f184-4290-9bee-6697c7a27a6e service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:43.352003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 684/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:45.592424 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ae6b5-7dfa-40ce-9976-25437c319ef8 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:45.593051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ae6b5-7dfa-40ce-9976-25437c319ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:45.593051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ae6b5-7dfa-40ce-9976-25437c319ef8 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:45.594399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 677/1361] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:45.599564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8751a-b002-4783-a3f1-aa9e92f3c5e4 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:45.599964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8751a-b002-4783-a3f1-aa9e92f3c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:45.600122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8751a-b002-4783-a3f1-aa9e92f3c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:45.619638 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4aa8751a-b002-4783-a3f1-aa9e92f3c5e4 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:45.620878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4aa8751a-b002-4783-a3f1-aa9e92f3c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:45.629223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 685/1362] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:45.673872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ae6b5-7dfa-40ce-9976-25437c319ef8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:45.688616 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ae6b5-7dfa-40ce-9976-25437c319ef8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:45.694046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe148bb5-4299-47c2-9a9d-bbb9e3fa5ed3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:45.694816 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe148bb5-4299-47c2-9a9d-bbb9e3fa5ed3 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:45.695201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe148bb5-4299-47c2-9a9d-bbb9e3fa5ed3 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:45.695550 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe148bb5-4299-47c2-9a9d-bbb9e3fa5ed3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:45.704432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe148bb5-4299-47c2-9a9d-bbb9e3fa5ed3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:45.706157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe148bb5-4299-47c2-9a9d-bbb9e3fa5ed3 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:45.716117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 678/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:48.144371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ae09c-2cba-41b2-baf6-74eb9bef8e7e None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:48.144895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ae09c-2cba-41b2-baf6-74eb9bef8e7e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:48.144994 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ae09c-2cba-41b2-baf6-74eb9bef8e7e None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:48.146324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 686/1364] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:48.151847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f0c27-bfa2-46e0-ba7c-0e4361192c86 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:48.152294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f0c27-bfa2-46e0-ba7c-0e4361192c86 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:48.152510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f0c27-bfa2-46e0-ba7c-0e4361192c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:48.173499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4a9f0c27-bfa2-46e0-ba7c-0e4361192c86 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:48.174722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4a9f0c27-bfa2-46e0-ba7c-0e4361192c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:48.188973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 679/1365] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:48.239409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539826f-67fe-40aa-9945-caa22087b968 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:48.239959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539826f-67fe-40aa-9945-caa22087b968 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:48.241020 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539826f-67fe-40aa-9945-caa22087b968 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:48.242387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 687/1366] 10.222.0.33 () {54 vars in 961 bytes} [Thu Jun 23 13:05:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:48.248132 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a3d7-d45c-424f-b1a5-a20d79cc6d31 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:48.248425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a3d7-d45c-424f-b1a5-a20d79cc6d31 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:48.249174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a3d7-d45c-424f-b1a5-a20d79cc6d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:48.267178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e7d6a3d7-d45c-424f-b1a5-a20d79cc6d31 None None] MFA Rules not processed for user `5874e98df57242028c0f9983dee3b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:48.268370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e7d6a3d7-d45c-424f-b1a5-a20d79cc6d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:48.278392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 680/1367] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Jun 23 13:05:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:48.286235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539826f-67fe-40aa-9945-caa22087b968 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:48.300781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539826f-67fe-40aa-9945-caa22087b968 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:48.306112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a960947-d19e-47eb-b74b-9a72005d556f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:48.306746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a960947-d19e-47eb-b74b-9a72005d556f service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:48.307028 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a960947-d19e-47eb-b74b-9a72005d556f service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:48.307334 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a960947-d19e-47eb-b74b-9a72005d556f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:48.315426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a960947-d19e-47eb-b74b-9a72005d556f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:48.317061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a960947-d19e-47eb-b74b-9a72005d556f service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:48.326445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 688/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:50.539759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4d1be-d9b3-4b59-93ae-71874c3fba36 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:50.540298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4d1be-d9b3-4b59-93ae-71874c3fba36 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:50.540410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4d1be-d9b3-4b59-93ae-71874c3fba36 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:50.542322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 681/1369] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:50.547730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa33c43-8931-4bc0-8433-d937bb93af2b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:50.548711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa33c43-8931-4bc0-8433-d937bb93af2b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:50.549281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa33c43-8931-4bc0-8433-d937bb93af2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:50.567335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-baa33c43-8931-4bc0-8433-d937bb93af2b None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:50.568534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-baa33c43-8931-4bc0-8433-d937bb93af2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:50.577309 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 689/1370] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:50.622239 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4d1be-d9b3-4b59-93ae-71874c3fba36 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:50.638049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4d1be-d9b3-4b59-93ae-71874c3fba36 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:50.643621 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04e958-4184-4cc8-be49-1147303ac393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:50.644377 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04e958-4184-4cc8-be49-1147303ac393 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:50.644816 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04e958-4184-4cc8-be49-1147303ac393 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:50.645201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04e958-4184-4cc8-be49-1147303ac393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:50.654459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04e958-4184-4cc8-be49-1147303ac393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:50.656195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04e958-4184-4cc8-be49-1147303ac393 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:50.666384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 682/1371] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:51.167868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b616570-0d11-4cdf-a152-5ffc090a1a48 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:51.168181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b616570-0d11-4cdf-a152-5ffc090a1a48 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:51.168369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b616570-0d11-4cdf-a152-5ffc090a1a48 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:51.169835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 690/1372] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:51.175047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cf5db-974e-4654-a517-fa25810cef59 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:51.175344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cf5db-974e-4654-a517-fa25810cef59 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:51.175631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cf5db-974e-4654-a517-fa25810cef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:51.194285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-649cf5db-974e-4654-a517-fa25810cef59 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:51.195631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-649cf5db-974e-4654-a517-fa25810cef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:51.204367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 683/1373] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:05:51.550097 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c7310-3fec-4066-92ec-62e3b184f5a1 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:51.550097 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c7310-3fec-4066-92ec-62e3b184f5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:51.550097 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c7310-3fec-4066-92ec-62e3b184f5a1 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:51.554099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 691/1374] 10.222.0.33 () {54 vars in 963 bytes} [Thu Jun 23 13:05:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:51.558852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fe122-e85e-474b-ad17-de485070df05 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:51.559385 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fe122-e85e-474b-ad17-de485070df05 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:51.559555 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fe122-e85e-474b-ad17-de485070df05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:51.611043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-685fe122-e85e-474b-ad17-de485070df05 None None] MFA Rules not processed for user `c1c0a73d629a47e4bdbd67da236240af`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:51.612322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-685fe122-e85e-474b-ad17-de485070df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:51.674284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 684/1375] 10.222.0.33 () {58 vars in 1060 bytes} [Thu Jun 23 13:05:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:51.681647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c7310-3fec-4066-92ec-62e3b184f5a1 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:51.693134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c7310-3fec-4066-92ec-62e3b184f5a1 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:51.696791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b811f1-9de3-4f79-b640-ccdf4587061b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:51.697523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b811f1-9de3-4f79-b640-ccdf4587061b service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:51.698483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b811f1-9de3-4f79-b640-ccdf4587061b service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:51.698830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b811f1-9de3-4f79-b640-ccdf4587061b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:51.708076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b811f1-9de3-4f79-b640-ccdf4587061b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:51.709721 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b811f1-9de3-4f79-b640-ccdf4587061b service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:51.720065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 692/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:52.905037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562f4e0-22c3-42fc-b452-0cb92d286007 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:52.905612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562f4e0-22c3-42fc-b452-0cb92d286007 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:52.905612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562f4e0-22c3-42fc-b452-0cb92d286007 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:52.906956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 685/1377] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:52.912135 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62362e31-0160-4148-8b25-b9e3ae3b5b2d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:52.912564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62362e31-0160-4148-8b25-b9e3ae3b5b2d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:52.912752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62362e31-0160-4148-8b25-b9e3ae3b5b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:52.930685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-62362e31-0160-4148-8b25-b9e3ae3b5b2d None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:52.931905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-62362e31-0160-4148-8b25-b9e3ae3b5b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:52.939900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 693/1378] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:05:52.983758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562f4e0-22c3-42fc-b452-0cb92d286007 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:52.998142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562f4e0-22c3-42fc-b452-0cb92d286007 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:53.003623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7d443-c8a8-4ed5-9030-a43b008694b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:53.004262 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7d443-c8a8-4ed5-9030-a43b008694b6 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:53.004543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7d443-c8a8-4ed5-9030-a43b008694b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:53.004846 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7d443-c8a8-4ed5-9030-a43b008694b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:53.013030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7d443-c8a8-4ed5-9030-a43b008694b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:53.014723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7d443-c8a8-4ed5-9030-a43b008694b6 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:53.018705 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:53.025055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 686/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:55.165563 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac83cd-14da-4508-9a12-5937f31df061 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:55.166032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac83cd-14da-4508-9a12-5937f31df061 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:55.166143 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac83cd-14da-4508-9a12-5937f31df061 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:55.168104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 694/1380] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:55.173609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434fe48-31d9-49c8-b861-573be6111b2c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:55.174028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434fe48-31d9-49c8-b861-573be6111b2c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:55.174164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434fe48-31d9-49c8-b861-573be6111b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:55.192196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5434fe48-31d9-49c8-b861-573be6111b2c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:55.193322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5434fe48-31d9-49c8-b861-573be6111b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:55.201026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 687/1381] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:55.259073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac83cd-14da-4508-9a12-5937f31df061 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:55.277955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac83cd-14da-4508-9a12-5937f31df061 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:55.285061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822cc01-ed6f-4609-905d-bcb464f56b55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:55.285973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822cc01-ed6f-4609-905d-bcb464f56b55 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:55.286492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822cc01-ed6f-4609-905d-bcb464f56b55 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:55.287550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822cc01-ed6f-4609-905d-bcb464f56b55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:55.297689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822cc01-ed6f-4609-905d-bcb464f56b55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:55.299568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822cc01-ed6f-4609-905d-bcb464f56b55 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:55.323732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 695/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:57.548771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7669e-0774-4558-a74d-b016b505cf3c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:57.549251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7669e-0774-4558-a74d-b016b505cf3c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:57.549344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7669e-0774-4558-a74d-b016b505cf3c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:57.550644 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 688/1383] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:57.555822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e313a-15cc-4101-870d-2a5735498295 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:57.556244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e313a-15cc-4101-870d-2a5735498295 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:57.556373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e313a-15cc-4101-870d-2a5735498295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:57.576346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-922e313a-15cc-4101-870d-2a5735498295 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:57.577888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-922e313a-15cc-4101-870d-2a5735498295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:57.586593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 696/1384] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:57.629199 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7669e-0774-4558-a74d-b016b505cf3c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:57.647853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7669e-0774-4558-a74d-b016b505cf3c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:57.654914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c4d89-774d-4124-8638-e8814aa44bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:57.655668 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c4d89-774d-4124-8638-e8814aa44bab service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:57.656045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c4d89-774d-4124-8638-e8814aa44bab service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:57.656423 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c4d89-774d-4124-8638-e8814aa44bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:57.665595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c4d89-774d-4124-8638-e8814aa44bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:57.667264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c4d89-774d-4124-8638-e8814aa44bab service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:57.677844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 689/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:59.725078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62d41d-8f54-41e1-88e7-e8b5a5cd8446 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:59.725639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62d41d-8f54-41e1-88e7-e8b5a5cd8446 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:59.725734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62d41d-8f54-41e1-88e7-e8b5a5cd8446 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:59.727037 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 697/1386] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:59.732883 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd6d59-ef7f-4254-b447-b9266a77162a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:59.733327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd6d59-ef7f-4254-b447-b9266a77162a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:59.733643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd6d59-ef7f-4254-b447-b9266a77162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:59.755861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-01dd6d59-ef7f-4254-b447-b9266a77162a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:59.757104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-01dd6d59-ef7f-4254-b447-b9266a77162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:59.765524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 690/1387] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:59.821632 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62d41d-8f54-41e1-88e7-e8b5a5cd8446 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:59.836712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62d41d-8f54-41e1-88e7-e8b5a5cd8446 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:59.843395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17229d-a916-4c20-b873-9369c7e5bb80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:59.844240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17229d-a916-4c20-b873-9369c7e5bb80 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:59.844601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17229d-a916-4c20-b873-9369c7e5bb80 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:59.845429 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17229d-a916-4c20-b873-9369c7e5bb80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:59.856592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17229d-a916-4c20-b873-9369c7e5bb80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:59.858679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17229d-a916-4c20-b873-9369c7e5bb80 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:59.871259 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 698/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:06:02.339332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125331c-2401-4b72-85a1-ace496ce8344 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:02.339879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125331c-2401-4b72-85a1-ace496ce8344 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:02.339879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125331c-2401-4b72-85a1-ace496ce8344 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:02.341228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 691/1389] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:02.347561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cb748-0daa-4aa4-a38b-e9e4d3b48a46 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:02.347991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cb748-0daa-4aa4-a38b-e9e4d3b48a46 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:02.348137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cb748-0daa-4aa4-a38b-e9e4d3b48a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:02.366159 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-951cb748-0daa-4aa4-a38b-e9e4d3b48a46 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:02.367318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-951cb748-0daa-4aa4-a38b-e9e4d3b48a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:02.375106 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 699/1390] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:02.430021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125331c-2401-4b72-85a1-ace496ce8344 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:02.445629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125331c-2401-4b72-85a1-ace496ce8344 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:02.451713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041084c-7426-42c1-9bcf-c53d2462060b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:02.452357 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041084c-7426-42c1-9bcf-c53d2462060b service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:02.452644 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041084c-7426-42c1-9bcf-c53d2462060b service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:02.452962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041084c-7426-42c1-9bcf-c53d2462060b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:02.461659 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041084c-7426-42c1-9bcf-c53d2462060b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:02.463334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041084c-7426-42c1-9bcf-c53d2462060b service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:02.473149 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 692/1391] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:04.776753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f89cb-0fb3-4ba0-b2a0-4db9ffaa6082 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:04.777393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f89cb-0fb3-4ba0-b2a0-4db9ffaa6082 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:04.777393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f89cb-0fb3-4ba0-b2a0-4db9ffaa6082 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:04.778648 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 700/1392] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:06:04.783803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a26f7-1f4f-44d4-9d4a-c7e91a4f8b38 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:04.784229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a26f7-1f4f-44d4-9d4a-c7e91a4f8b38 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:04.784394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a26f7-1f4f-44d4-9d4a-c7e91a4f8b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:04.802760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-026a26f7-1f4f-44d4-9d4a-c7e91a4f8b38 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:04.803954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-026a26f7-1f4f-44d4-9d4a-c7e91a4f8b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:04.811642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 693/1393] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:04.870038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f89cb-0fb3-4ba0-b2a0-4db9ffaa6082 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:04.890103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f89cb-0fb3-4ba0-b2a0-4db9ffaa6082 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:04.896136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad8473-7817-4ebf-a568-535791e301b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:04.896832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad8473-7817-4ebf-a568-535791e301b7 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:04.897132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad8473-7817-4ebf-a568-535791e301b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:04.897409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad8473-7817-4ebf-a568-535791e301b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:04.906454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad8473-7817-4ebf-a568-535791e301b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:04.908061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad8473-7817-4ebf-a568-535791e301b7 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:04.917812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 701/1394] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:07.112141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77c181-ac23-4657-ad88-e5cfb68db27a None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:07.112783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77c181-ac23-4657-ad88-e5cfb68db27a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:07.112783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77c181-ac23-4657-ad88-e5cfb68db27a None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:07.114278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 694/1395] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:07.119380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b5c3-0d0a-4271-b030-da38b11e820d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:07.119835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b5c3-0d0a-4271-b030-da38b11e820d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:07.119933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b5c3-0d0a-4271-b030-da38b11e820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:07.137314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a636b5c3-0d0a-4271-b030-da38b11e820d None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:07.138486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a636b5c3-0d0a-4271-b030-da38b11e820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:07.146232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 702/1396] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:06:07.164760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9e4d3-e833-440d-b4fc-1ee159f233da None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:07.165050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9e4d3-e833-440d-b4fc-1ee159f233da None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:07.165332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9e4d3-e833-440d-b4fc-1ee159f233da None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:07.167278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 695/1397] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:07.172334 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5a694-a47a-48d0-99d0-be1dd820e875 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:07.172624 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5a694-a47a-48d0-99d0-be1dd820e875 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:07.172938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5a694-a47a-48d0-99d0-be1dd820e875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:07.190877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9e4d3-e833-440d-b4fc-1ee159f233da None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:07.191467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1ef5a694-a47a-48d0-99d0-be1dd820e875 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:07.192684 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1ef5a694-a47a-48d0-99d0-be1dd820e875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:07.200511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 703/1398] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:07.205140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9e4d3-e833-440d-b4fc-1ee159f233da None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:07.212235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f12a8-4eff-47ca-87bb-040c49383a13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:07.213405 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f12a8-4eff-47ca-87bb-040c49383a13 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:07.213685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f12a8-4eff-47ca-87bb-040c49383a13 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:07.213963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f12a8-4eff-47ca-87bb-040c49383a13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:07.223347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f12a8-4eff-47ca-87bb-040c49383a13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:07.224995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f12a8-4eff-47ca-87bb-040c49383a13 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:07.240260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 696/1399] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:06:07.260412 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13439-188c-41dd-a9af-f68f21ac17f6 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:07.260774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13439-188c-41dd-a9af-f68f21ac17f6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:07.261055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13439-188c-41dd-a9af-f68f21ac17f6 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:07.262430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 704/1400] 10.222.0.33 () {54 vars in 962 bytes} [Thu Jun 23 13:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:06:07.268959 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0ef66-aee3-468f-81cf-7397fe28fa91 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:07.324349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0ef66-aee3-468f-81cf-7397fe28fa91 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:07.324349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0ef66-aee3-468f-81cf-7397fe28fa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:07.324349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-28d0ef66-aee3-468f-81cf-7397fe28fa91 None None] MFA Rules not processed for user `711d53a7deb94849b577c08dc9165ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:07.324712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-28d0ef66-aee3-468f-81cf-7397fe28fa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:07.383333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 697/1401] 10.222.0.33 () {58 vars in 1059 bytes} [Thu Jun 23 13:06:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:07.392178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d13439-188c-41dd-a9af-f68f21ac17f6 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:07.403497 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d13439-188c-41dd-a9af-f68f21ac17f6 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:07.407014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7a3e0-66ee-4eac-ab23-c9d95cd712b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '711d53a7deb94849b577c08dc9165ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:07.407638 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7a3e0-66ee-4eac-ab23-c9d95cd712b5 service glance] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:07.407916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7a3e0-66ee-4eac-ab23-c9d95cd712b5 service glance] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:07.408188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7a3e0-66ee-4eac-ab23-c9d95cd712b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:07.417009 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7a3e0-66ee-4eac-ab23-c9d95cd712b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:07.418507 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7a3e0-66ee-4eac-ab23-c9d95cd712b5 service glance] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:07.427972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 705/1402] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:08.278799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae840542-38cf-4d32-a52d-e44cd7a79be3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:08.279243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae840542-38cf-4d32-a52d-e44cd7a79be3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:08.279351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae840542-38cf-4d32-a52d-e44cd7a79be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:08.327001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ae840542-38cf-4d32-a52d-e44cd7a79be3 None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:08.328252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ae840542-38cf-4d32-a52d-e44cd7a79be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:08.372032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:06:08.392697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 698/1403] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:08.433407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b0f39-dee9-4232-8019-8915a35efc37 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:08.433911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b0f39-dee9-4232-8019-8915a35efc37 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:08.434237 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b0f39-dee9-4232-8019-8915a35efc37 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:08.435668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 706/1404] 10.222.0.33 () {54 vars in 942 bytes} [Thu Jun 23 13:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:08.442187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbc33d-157a-485d-8117-8ed88ce54bb4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:08.442487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbc33d-157a-485d-8117-8ed88ce54bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:08.442773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbc33d-157a-485d-8117-8ed88ce54bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:08.491898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-77dbc33d-157a-485d-8117-8ed88ce54bb4 None None] MFA Rules not processed for user `79d23f1644b94d51a4d0efe47f7aab3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:08.493150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-77dbc33d-157a-485d-8117-8ed88ce54bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:08.564596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 699/1405] 10.222.0.33 () {58 vars in 1039 bytes} [Thu Jun 23 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:08.574384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b0f39-dee9-4232-8019-8915a35efc37 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:08.581763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=64 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:06:08.588065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b0f39-dee9-4232-8019-8915a35efc37 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:08.593191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c75cd0-ce6d-43d9-9a45-c873e3457a36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:08.595793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c75cd0-ce6d-43d9-9a45-c873e3457a36 service swift] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:08.595793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c75cd0-ce6d-43d9-9a45-c873e3457a36 service swift] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:08.595793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c75cd0-ce6d-43d9-9a45-c873e3457a36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:08.602479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c75cd0-ce6d-43d9-9a45-c873e3457a36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:08.604110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c75cd0-ce6d-43d9-9a45-c873e3457a36 service swift] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:08.612395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 707/1406] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:06:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:06:09.672598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850db29-b5f0-409b-9d24-31c3f3d3847d None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:09.673180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850db29-b5f0-409b-9d24-31c3f3d3847d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:09.673180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850db29-b5f0-409b-9d24-31c3f3d3847d None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:09.674563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 700/1407] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:09.679794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d208f-5014-46fb-9a31-c109e2c83a51 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:09.680218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d208f-5014-46fb-9a31-c109e2c83a51 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:09.680360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d208f-5014-46fb-9a31-c109e2c83a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:09.699241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-520d208f-5014-46fb-9a31-c109e2c83a51 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:09.700468 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-520d208f-5014-46fb-9a31-c109e2c83a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:09.708452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 708/1408] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:09.752964 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850db29-b5f0-409b-9d24-31c3f3d3847d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:09.767637 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850db29-b5f0-409b-9d24-31c3f3d3847d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:09.773362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4095ca-a758-4e15-8d1f-27a08205fb56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:09.774321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4095ca-a758-4e15-8d1f-27a08205fb56 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:09.774682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4095ca-a758-4e15-8d1f-27a08205fb56 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:09.775056 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4095ca-a758-4e15-8d1f-27a08205fb56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:09.783745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4095ca-a758-4e15-8d1f-27a08205fb56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:09.785378 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4095ca-a758-4e15-8d1f-27a08205fb56 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:09.796545 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 701/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:19.693964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=8 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:06:19.791825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=56 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:06:32.458939 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdbdde-5edf-43db-8234-f05984f98e08 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:32.459486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdbdde-5edf-43db-8234-f05984f98e08 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:32.459486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdbdde-5edf-43db-8234-f05984f98e08 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:32.460887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 709/1410] 10.222.0.33 () {54 vars in 918 bytes} [Thu Jun 23 13:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:32.466134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ede3f-b687-444f-b6fe-2a56a0bb7d05 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:32.466553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ede3f-b687-444f-b6fe-2a56a0bb7d05 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:32.466764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ede3f-b687-444f-b6fe-2a56a0bb7d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:32.484933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ae6ede3f-b687-444f-b6fe-2a56a0bb7d05 None None] MFA Rules not processed for user `8644754798b5439c954c86dc9aa9e7af`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:32.486135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ae6ede3f-b687-444f-b6fe-2a56a0bb7d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:32.495082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 702/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Jun 23 13:06:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:06:32.509401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582703-88be-4391-bb9e-e8031d953bf4 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:32.509690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582703-88be-4391-bb9e-e8031d953bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:32.509963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582703-88be-4391-bb9e-e8031d953bf4 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:32.511292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 710/1412] 10.222.0.33 () {54 vars in 918 bytes} [Thu Jun 23 13:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:32.515585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58ca6e-8b08-4fa4-904e-0d86c3216741 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:32.515871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58ca6e-8b08-4fa4-904e-0d86c3216741 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:32.516150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58ca6e-8b08-4fa4-904e-0d86c3216741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:32.534438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-fc58ca6e-8b08-4fa4-904e-0d86c3216741 None None] MFA Rules not processed for user `5874e98df57242028c0f9983dee3b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:32.535610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fc58ca6e-8b08-4fa4-904e-0d86c3216741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:32.544584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 703/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Jun 23 13:06:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:35.019575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef9869-13bf-4b5c-8f8d-9aa4c75470ca None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:35.020067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef9869-13bf-4b5c-8f8d-9aa4c75470ca None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:35.020165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef9869-13bf-4b5c-8f8d-9aa4c75470ca None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:35.021574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:35.027324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bbb99-db7c-474a-84de-08f4e8299070 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:35.027760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bbb99-db7c-474a-84de-08f4e8299070 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:35.027921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bbb99-db7c-474a-84de-08f4e8299070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:35.046029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d27bbb99-db7c-474a-84de-08f4e8299070 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:35.047249 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d27bbb99-db7c-474a-84de-08f4e8299070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:35.055279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:35.098099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef9869-13bf-4b5c-8f8d-9aa4c75470ca None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:35.112186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef9869-13bf-4b5c-8f8d-9aa4c75470ca None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:35.117609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f878e3-1f65-47ab-bfb2-df09b4b329d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:35.118246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f878e3-1f65-47ab-bfb2-df09b4b329d4 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:35.118532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f878e3-1f65-47ab-bfb2-df09b4b329d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:35.118808 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f878e3-1f65-47ab-bfb2-df09b4b329d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:35.126925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f878e3-1f65-47ab-bfb2-df09b4b329d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:35.128495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f878e3-1f65-47ab-bfb2-df09b4b329d4 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:35.138339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 712/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:36.027206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520552cd-6960-4ad2-867c-1686647f3b3e None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:36.027498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520552cd-6960-4ad2-867c-1686647f3b3e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:36.028096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520552cd-6960-4ad2-867c-1686647f3b3e None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:36.029183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:36.034201 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974050bd-1b1d-402a-a16f-4556f14e73f3 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:36.034644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974050bd-1b1d-402a-a16f-4556f14e73f3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:36.034754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974050bd-1b1d-402a-a16f-4556f14e73f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:36.052607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-974050bd-1b1d-402a-a16f-4556f14e73f3 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:36.053815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-974050bd-1b1d-402a-a16f-4556f14e73f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:36.062197 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:36.212438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520552cd-6960-4ad2-867c-1686647f3b3e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:36.227065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520552cd-6960-4ad2-867c-1686647f3b3e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:36.234666 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc04c60-23ad-4842-b592-a3da73947ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:36.234666 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc04c60-23ad-4842-b592-a3da73947ef5 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:36.234666 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc04c60-23ad-4842-b592-a3da73947ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:36.234666 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc04c60-23ad-4842-b592-a3da73947ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:36.241733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc04c60-23ad-4842-b592-a3da73947ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:36.243344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc04c60-23ad-4842-b592-a3da73947ef5 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:36.252836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 706/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:37.124320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1723d-f158-4372-aff2-00a55a016801 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:37.124816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1723d-f158-4372-aff2-00a55a016801 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:37.124923 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1723d-f158-4372-aff2-00a55a016801 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:37.126258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:37.131049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21083-d227-4cfc-b84c-340d09f09ca6 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:37.131475 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21083-d227-4cfc-b84c-340d09f09ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:37.131613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21083-d227-4cfc-b84c-340d09f09ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:37.150102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5bd21083-d227-4cfc-b84c-340d09f09ca6 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:37.151293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5bd21083-d227-4cfc-b84c-340d09f09ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:37.159035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:37.308727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1723d-f158-4372-aff2-00a55a016801 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:37.323186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1723d-f158-4372-aff2-00a55a016801 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:37.328610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddbcaf-5691-412c-b8a1-795c3467a99f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:37.329265 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddbcaf-5691-412c-b8a1-795c3467a99f service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:37.329545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddbcaf-5691-412c-b8a1-795c3467a99f service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:37.329868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddbcaf-5691-412c-b8a1-795c3467a99f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:37.337688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddbcaf-5691-412c-b8a1-795c3467a99f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:37.339247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddbcaf-5691-412c-b8a1-795c3467a99f service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:37.348388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 715/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:38.205925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe704e-d985-465a-abfe-88eb970e6fe6 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:38.206488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe704e-d985-465a-abfe-88eb970e6fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:38.206488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe704e-d985-465a-abfe-88eb970e6fe6 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:38.207898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:38.213301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3649b1-e1f7-4a93-a07f-066dbb1b85b8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:38.213717 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3649b1-e1f7-4a93-a07f-066dbb1b85b8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:38.213869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3649b1-e1f7-4a93-a07f-066dbb1b85b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:38.231312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8a3649b1-e1f7-4a93-a07f-066dbb1b85b8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:38.232609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8a3649b1-e1f7-4a93-a07f-066dbb1b85b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:38.240292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:38.391301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe704e-d985-465a-abfe-88eb970e6fe6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:38.405663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe704e-d985-465a-abfe-88eb970e6fe6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:38.410912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c4221-ba1d-4ac9-b4d4-ba97e641a3bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:38.418102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c4221-ba1d-4ac9-b4d4-ba97e641a3bf service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:38.418102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c4221-ba1d-4ac9-b4d4-ba97e641a3bf service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:38.418102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c4221-ba1d-4ac9-b4d4-ba97e641a3bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:38.420588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c4221-ba1d-4ac9-b4d4-ba97e641a3bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:38.422184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c4221-ba1d-4ac9-b4d4-ba97e641a3bf service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:38.431996 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 709/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:39.282795 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb769f9b-df58-40cb-bfd9-e36a1e6df83a None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:39.283349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb769f9b-df58-40cb-bfd9-e36a1e6df83a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:39.283349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb769f9b-df58-40cb-bfd9-e36a1e6df83a None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:39.284766 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:39.289675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912017-89ef-4427-9ce3-ce7d346f7cdd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:39.290112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912017-89ef-4427-9ce3-ce7d346f7cdd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:39.290228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912017-89ef-4427-9ce3-ce7d346f7cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:39.308246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7f912017-89ef-4427-9ce3-ce7d346f7cdd None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:39.309472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7f912017-89ef-4427-9ce3-ce7d346f7cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:39.317198 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:39.468168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb769f9b-df58-40cb-bfd9-e36a1e6df83a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:39.483229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb769f9b-df58-40cb-bfd9-e36a1e6df83a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:39.488675 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8194d84-3d53-4498-96b6-d55401303c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:39.489322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8194d84-3d53-4498-96b6-d55401303c82 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:39.489611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8194d84-3d53-4498-96b6-d55401303c82 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:39.489887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8194d84-3d53-4498-96b6-d55401303c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:39.497825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8194d84-3d53-4498-96b6-d55401303c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:39.501716 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8194d84-3d53-4498-96b6-d55401303c82 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:39.508800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 718/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:40.370063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd922b20-5bcc-410c-891b-374b843cc775 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:40.370579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd922b20-5bcc-410c-891b-374b843cc775 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:40.370579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd922b20-5bcc-410c-891b-374b843cc775 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:40.371923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:40.376871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0a338-2e2a-42a5-b0e9-c8e6063dab10 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:40.377304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0a338-2e2a-42a5-b0e9-c8e6063dab10 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:40.377439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0a338-2e2a-42a5-b0e9-c8e6063dab10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:40.395396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8fe0a338-2e2a-42a5-b0e9-c8e6063dab10 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:40.396848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8fe0a338-2e2a-42a5-b0e9-c8e6063dab10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:40.405182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:40.556528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd922b20-5bcc-410c-891b-374b843cc775 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:40.571425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd922b20-5bcc-410c-891b-374b843cc775 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:40.576703 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae153b90-3f6e-4100-b54c-11f73683fe59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:40.577336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae153b90-3f6e-4100-b54c-11f73683fe59 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:40.577620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae153b90-3f6e-4100-b54c-11f73683fe59 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:40.577893 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae153b90-3f6e-4100-b54c-11f73683fe59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:40.585876 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae153b90-3f6e-4100-b54c-11f73683fe59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:40.587441 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae153b90-3f6e-4100-b54c-11f73683fe59 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:40.596683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 712/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:41.468919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aa846-765a-42fc-97f6-027b2d43fa02 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:41.469471 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aa846-765a-42fc-97f6-027b2d43fa02 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:41.469471 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aa846-765a-42fc-97f6-027b2d43fa02 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:41.470847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:41.475694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53f7a3-b021-428a-8bd4-0c675b433499 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:41.476155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53f7a3-b021-428a-8bd4-0c675b433499 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:41.476268 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53f7a3-b021-428a-8bd4-0c675b433499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:41.494175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6f53f7a3-b021-428a-8bd4-0c675b433499 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:41.495969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6f53f7a3-b021-428a-8bd4-0c675b433499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:41.503156 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:41.650544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4aa846-765a-42fc-97f6-027b2d43fa02 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:41.664819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4aa846-765a-42fc-97f6-027b2d43fa02 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:41.670066 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbb56c-b3d4-4bea-adcf-fe13dd975553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:41.670699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbb56c-b3d4-4bea-adcf-fe13dd975553 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:41.670980 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbb56c-b3d4-4bea-adcf-fe13dd975553 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:41.671254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbb56c-b3d4-4bea-adcf-fe13dd975553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:41.679154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbb56c-b3d4-4bea-adcf-fe13dd975553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:41.681375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbb56c-b3d4-4bea-adcf-fe13dd975553 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:41.690535 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 721/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:42.583596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40d16-77ed-46f0-9bc6-32c0e225805a None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:42.584143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40d16-77ed-46f0-9bc6-32c0e225805a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:42.584143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40d16-77ed-46f0-9bc6-32c0e225805a None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:42.586187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:42.591200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f135c-75b6-471a-b66e-e0a91456f7c8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:42.591626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f135c-75b6-471a-b66e-e0a91456f7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:42.591755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f135c-75b6-471a-b66e-e0a91456f7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:42.609631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-195f135c-75b6-471a-b66e-e0a91456f7c8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:42.610848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-195f135c-75b6-471a-b66e-e0a91456f7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:42.618668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:42.767872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf40d16-77ed-46f0-9bc6-32c0e225805a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:42.782451 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf40d16-77ed-46f0-9bc6-32c0e225805a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:42.787818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86503ac2-9e60-4235-8ee6-d601ee28e6b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:42.788999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86503ac2-9e60-4235-8ee6-d601ee28e6b8 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:42.789306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86503ac2-9e60-4235-8ee6-d601ee28e6b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:42.789584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86503ac2-9e60-4235-8ee6-d601ee28e6b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:42.797719 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86503ac2-9e60-4235-8ee6-d601ee28e6b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:42.799320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86503ac2-9e60-4235-8ee6-d601ee28e6b8 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:42.809338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 715/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:43.692747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0258ccf-009e-4f1f-8566-04d77ee0f675 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:43.693338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0258ccf-009e-4f1f-8566-04d77ee0f675 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:43.693338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0258ccf-009e-4f1f-8566-04d77ee0f675 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:43.694652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:43.700206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5582b8-1113-4b93-a22d-1a8d8a9724e4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:43.700639 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5582b8-1113-4b93-a22d-1a8d8a9724e4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:43.700773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5582b8-1113-4b93-a22d-1a8d8a9724e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:43.718315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-dd5582b8-1113-4b93-a22d-1a8d8a9724e4 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:43.719494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dd5582b8-1113-4b93-a22d-1a8d8a9724e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:43.727305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:06:43.874780 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0258ccf-009e-4f1f-8566-04d77ee0f675 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:43.889546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0258ccf-009e-4f1f-8566-04d77ee0f675 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:43.894814 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8069878-5584-456f-a7a0-079d541bf15f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:43.895445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8069878-5584-456f-a7a0-079d541bf15f service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:43.895726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8069878-5584-456f-a7a0-079d541bf15f service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:43.896002 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8069878-5584-456f-a7a0-079d541bf15f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:43.904160 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8069878-5584-456f-a7a0-079d541bf15f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:43.905758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8069878-5584-456f-a7a0-079d541bf15f service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:43.914847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 724/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:45.838380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60921390-6f8c-46d8-8e9d-aabe97e33209 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:45.838960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60921390-6f8c-46d8-8e9d-aabe97e33209 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:45.838960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60921390-6f8c-46d8-8e9d-aabe97e33209 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:45.840363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:45.845573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e770974-fa24-4b0f-b49d-4b0ca6bf0bf6 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:45.846027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e770974-fa24-4b0f-b49d-4b0ca6bf0bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:45.846215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e770974-fa24-4b0f-b49d-4b0ca6bf0bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:45.864250 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3e770974-fa24-4b0f-b49d-4b0ca6bf0bf6 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:45.865472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3e770974-fa24-4b0f-b49d-4b0ca6bf0bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:45.873974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:45.912111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60921390-6f8c-46d8-8e9d-aabe97e33209 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:45.914369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-60921390-6f8c-46d8-8e9d-aabe97e33209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:45.927136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60921390-6f8c-46d8-8e9d-aabe97e33209 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:45.931266 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6b9e4-9835-44e0-b085-58e9750680fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:45.931901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6b9e4-9835-44e0-b085-58e9750680fa service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:45.932189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6b9e4-9835-44e0-b085-58e9750680fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:45.932470 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6b9e4-9835-44e0-b085-58e9750680fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:45.941336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6b9e4-9835-44e0-b085-58e9750680fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:45.942750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6b9e4-9835-44e0-b085-58e9750680fa service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:45.952114 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 718/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:48.118989 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde53e28-49f3-4418-9045-56071266d47b None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:48.119579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde53e28-49f3-4418-9045-56071266d47b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:48.119579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde53e28-49f3-4418-9045-56071266d47b None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:48.120950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:48.126249 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a5b94-096b-4b5d-ba7f-304d7d022a5a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:48.128862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a5b94-096b-4b5d-ba7f-304d7d022a5a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:48.128862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a5b94-096b-4b5d-ba7f-304d7d022a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:48.144279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-207a5b94-096b-4b5d-ba7f-304d7d022a5a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:48.145505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-207a5b94-096b-4b5d-ba7f-304d7d022a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:48.153865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:06:48.192118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde53e28-49f3-4418-9045-56071266d47b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:48.202995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde53e28-49f3-4418-9045-56071266d47b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:48.206759 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867b360-9b6b-42bc-9d03-b2aa72ddcc36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:48.207395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867b360-9b6b-42bc-9d03-b2aa72ddcc36 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:48.207703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867b360-9b6b-42bc-9d03-b2aa72ddcc36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:48.207978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867b360-9b6b-42bc-9d03-b2aa72ddcc36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:48.217368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867b360-9b6b-42bc-9d03-b2aa72ddcc36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:48.218793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867b360-9b6b-42bc-9d03-b2aa72ddcc36 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:48.227998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 727/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:50.574298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8dae-0442-4955-a809-fb4a53bccba1 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:50.574868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8dae-0442-4955-a809-fb4a53bccba1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:50.574868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8dae-0442-4955-a809-fb4a53bccba1 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:50.576209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:06:50.581476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c1f4c-4cab-48c8-9a6b-ac83c293f72a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:50.581925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c1f4c-4cab-48c8-9a6b-ac83c293f72a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:50.582030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c1f4c-4cab-48c8-9a6b-ac83c293f72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:50.599734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-401c1f4c-4cab-48c8-9a6b-ac83c293f72a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:50.601532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-401c1f4c-4cab-48c8-9a6b-ac83c293f72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:50.609209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:50.646573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe8dae-0442-4955-a809-fb4a53bccba1 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:50.657787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe8dae-0442-4955-a809-fb4a53bccba1 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:50.661313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e032a1-e00a-4a0f-afbd-5ba0e55350f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:50.661988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e032a1-e00a-4a0f-afbd-5ba0e55350f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:50.662279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e032a1-e00a-4a0f-afbd-5ba0e55350f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:50.662563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e032a1-e00a-4a0f-afbd-5ba0e55350f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:50.672169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e032a1-e00a-4a0f-afbd-5ba0e55350f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:50.673633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e032a1-e00a-4a0f-afbd-5ba0e55350f4 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:50.683027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 721/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:52.814109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15dc7c-a404-43e3-a927-f68a3d4ee443 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:52.814693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15dc7c-a404-43e3-a927-f68a3d4ee443 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:52.814693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15dc7c-a404-43e3-a927-f68a3d4ee443 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:52.816288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:52.821739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e6036-cbff-45fc-a359-deefdfe24e64 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:52.822149 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e6036-cbff-45fc-a359-deefdfe24e64 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:52.822303 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e6036-cbff-45fc-a359-deefdfe24e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:52.840073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f27e6036-cbff-45fc-a359-deefdfe24e64 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:52.841309 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f27e6036-cbff-45fc-a359-deefdfe24e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:52.849050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:52.887330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15dc7c-a404-43e3-a927-f68a3d4ee443 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:52.898572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15dc7c-a404-43e3-a927-f68a3d4ee443 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:52.902085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4632cb1-a3dd-4deb-beec-5ba137d6b937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:52.902705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4632cb1-a3dd-4deb-beec-5ba137d6b937 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:52.902986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4632cb1-a3dd-4deb-beec-5ba137d6b937 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:52.903258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4632cb1-a3dd-4deb-beec-5ba137d6b937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:52.912013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4632cb1-a3dd-4deb-beec-5ba137d6b937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:52.914122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4632cb1-a3dd-4deb-beec-5ba137d6b937 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:52.923425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 730/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:54.999403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907f23-0383-4a52-8ee2-3f51453bd802 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:54.999956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907f23-0383-4a52-8ee2-3f51453bd802 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:54.999956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907f23-0383-4a52-8ee2-3f51453bd802 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:55.001345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:55.006492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30045dc-702c-4699-8ae9-d9925fb6b722 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:55.006899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30045dc-702c-4699-8ae9-d9925fb6b722 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:55.007050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30045dc-702c-4699-8ae9-d9925fb6b722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:55.024926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f30045dc-702c-4699-8ae9-d9925fb6b722 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:55.026101 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f30045dc-702c-4699-8ae9-d9925fb6b722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:55.034184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:55.071515 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16907f23-0383-4a52-8ee2-3f51453bd802 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:55.082169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16907f23-0383-4a52-8ee2-3f51453bd802 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:55.086110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d1d70-7d87-48bf-825c-e8fbb19d5bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:55.086741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d1d70-7d87-48bf-825c-e8fbb19d5bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:55.087049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d1d70-7d87-48bf-825c-e8fbb19d5bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:55.087324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d1d70-7d87-48bf-825c-e8fbb19d5bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:55.096046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d1d70-7d87-48bf-825c-e8fbb19d5bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:55.097486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d1d70-7d87-48bf-825c-e8fbb19d5bb4 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:55.107179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 724/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:57.194832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc975f-d005-4882-97b4-22d9956f2d64 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:57.195357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc975f-d005-4882-97b4-22d9956f2d64 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:57.195474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc975f-d005-4882-97b4-22d9956f2d64 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:57.196772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:57.202011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac060a-735b-4d85-8c08-baf4f1853e7e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:57.202440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac060a-735b-4d85-8c08-baf4f1853e7e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:57.202578 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac060a-735b-4d85-8c08-baf4f1853e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:57.220447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8cac060a-735b-4d85-8c08-baf4f1853e7e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:57.221665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8cac060a-735b-4d85-8c08-baf4f1853e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:57.230139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:57.267185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc975f-d005-4882-97b4-22d9956f2d64 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:57.278494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc975f-d005-4882-97b4-22d9956f2d64 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:57.282015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e79296-5126-467e-92db-957f9080173d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:57.282676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e79296-5126-467e-92db-957f9080173d service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:57.282964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e79296-5126-467e-92db-957f9080173d service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:57.283245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e79296-5126-467e-92db-957f9080173d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:57.292617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e79296-5126-467e-92db-957f9080173d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:57.294060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e79296-5126-467e-92db-957f9080173d service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:57.303338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 733/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:59.359097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd7109-95fd-4d5a-be71-595aee3f08c6 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:59.359631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd7109-95fd-4d5a-be71-595aee3f08c6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:59.359631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd7109-95fd-4d5a-be71-595aee3f08c6 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:59.361065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:59.366715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684bd1c-5709-4fdc-b17c-c090d7535b7c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:59.367122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684bd1c-5709-4fdc-b17c-c090d7535b7c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:59.367272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684bd1c-5709-4fdc-b17c-c090d7535b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:59.384798 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0684bd1c-5709-4fdc-b17c-c090d7535b7c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:59.385968 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0684bd1c-5709-4fdc-b17c-c090d7535b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:59.393592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:59.431010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd7109-95fd-4d5a-be71-595aee3f08c6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:59.441390 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd7109-95fd-4d5a-be71-595aee3f08c6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:59.444800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd10468-2a46-4889-a9e6-31f25733d05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:59.445427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd10468-2a46-4889-a9e6-31f25733d05f service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:59.445703 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd10468-2a46-4889-a9e6-31f25733d05f service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:59.445983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd10468-2a46-4889-a9e6-31f25733d05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:59.454585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd10468-2a46-4889-a9e6-31f25733d05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:59.455989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd10468-2a46-4889-a9e6-31f25733d05f service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:59.465822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 727/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:07:01.610421 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7565125-77de-4fc7-82dc-771e91c027a4 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:01.610986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7565125-77de-4fc7-82dc-771e91c027a4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:01.610986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7565125-77de-4fc7-82dc-771e91c027a4 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:01.612346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:07:01.617702 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646816d6-faed-40c1-bf2e-9733517afe7a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:01.618099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646816d6-faed-40c1-bf2e-9733517afe7a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:01.618204 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646816d6-faed-40c1-bf2e-9733517afe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:01.624114 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=79 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:07:01.636166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-646816d6-faed-40c1-bf2e-9733517afe7a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:07:01.638117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-646816d6-faed-40c1-bf2e-9733517afe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:07:01.645393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:07:01.683117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7565125-77de-4fc7-82dc-771e91c027a4 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:07:01.688430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=73 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:07:01.694689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7565125-77de-4fc7-82dc-771e91c027a4 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:07:01.698147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6978d22-f36a-412d-b7a6-015defdee4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:07:01.698786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6978d22-f36a-412d-b7a6-015defdee4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:01.699098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6978d22-f36a-412d-b7a6-015defdee4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:01.699378 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6978d22-f36a-412d-b7a6-015defdee4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:01.708068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6978d22-f36a-412d-b7a6-015defdee4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:07:01.709576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6978d22-f36a-412d-b7a6-015defdee4b8 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:07:01.718716 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 736/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:07:03.766650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cec2e8-5481-4166-b6d7-2b80be73d46c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:03.767183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cec2e8-5481-4166-b6d7-2b80be73d46c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:03.767308 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cec2e8-5481-4166-b6d7-2b80be73d46c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:03.768680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:07:03.774186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512188d9-f35c-4aee-8165-2c384f58a6da None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:03.774585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512188d9-f35c-4aee-8165-2c384f58a6da None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:03.774742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512188d9-f35c-4aee-8165-2c384f58a6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:03.792301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-512188d9-f35c-4aee-8165-2c384f58a6da None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:07:03.793505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-512188d9-f35c-4aee-8165-2c384f58a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:07:03.801144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:07:03.836752 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cec2e8-5481-4166-b6d7-2b80be73d46c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:07:03.847242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cec2e8-5481-4166-b6d7-2b80be73d46c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:07:03.851231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c5bcc-6924-457c-b726-f5cc1c5c7f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:07:03.851858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c5bcc-6924-457c-b726-f5cc1c5c7f08 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:03.852141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c5bcc-6924-457c-b726-f5cc1c5c7f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:03.852419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c5bcc-6924-457c-b726-f5cc1c5c7f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:03.861270 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c5bcc-6924-457c-b726-f5cc1c5c7f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:07:03.862701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c5bcc-6924-457c-b726-f5cc1c5c7f08 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:07:03.872772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 730/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:07:05.890516 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ec66-c052-41e9-8344-f8d8e90e3a5e None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:05.891086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ec66-c052-41e9-8344-f8d8e90e3a5e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:05.891086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ec66-c052-41e9-8344-f8d8e90e3a5e None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:05.892516 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:07:05.898654 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7063b-8950-4b11-be53-7730f3f3e294 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:05.899043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7063b-8950-4b11-be53-7730f3f3e294 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:05.899213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7063b-8950-4b11-be53-7730f3f3e294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:05.917367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4ee7063b-8950-4b11-be53-7730f3f3e294 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:07:05.918590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4ee7063b-8950-4b11-be53-7730f3f3e294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:07:05.926350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:07:05.962775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649ec66-c052-41e9-8344-f8d8e90e3a5e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:07:05.973515 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649ec66-c052-41e9-8344-f8d8e90e3a5e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:07:05.976956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f3d7-c148-46e6-aef7-4a70848193f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:07:05.977582 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f3d7-c148-46e6-aef7-4a70848193f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:05.977861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f3d7-c148-46e6-aef7-4a70848193f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:05.978130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f3d7-c148-46e6-aef7-4a70848193f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:05.986784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4f3d7-c148-46e6-aef7-4a70848193f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:07:05.988191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4f3d7-c148-46e6-aef7-4a70848193f5 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:07:05.997355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 739/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:07:15.911504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=11 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:07:15.993251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=14 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:07:25.731261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb95a65-7874-41b6-a518-3034a64243c2 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:25.731858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb95a65-7874-41b6-a518-3034a64243c2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:25.731858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb95a65-7874-41b6-a518-3034a64243c2 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:25.733220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 732/1471] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:07:25.738705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb609a4e-7c37-41f9-ab37-09a231a1df74 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:25.739668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb609a4e-7c37-41f9-ab37-09a231a1df74 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:25.739796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb609a4e-7c37-41f9-ab37-09a231a1df74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:25.757701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-bb609a4e-7c37-41f9-ab37-09a231a1df74 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:07:25.759179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bb609a4e-7c37-41f9-ab37-09a231a1df74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:07:25.766985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 740/1472] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:07:25.813681 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce80ea-8aa7-452f-8ac5-39c1b8e97a64 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:25.813967 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce80ea-8aa7-452f-8ac5-39c1b8e97a64 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:25.814244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce80ea-8aa7-452f-8ac5-39c1b8e97a64 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:25.815597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 733/1473] 10.222.0.33 () {54 vars in 962 bytes} [Thu Jun 23 13:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:07:25.820979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d0a08-62ae-42a5-a7d6-7fd6f7820a24 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:25.821274 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d0a08-62ae-42a5-a7d6-7fd6f7820a24 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:25.821559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d0a08-62ae-42a5-a7d6-7fd6f7820a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:25.839738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-193d0a08-62ae-42a5-a7d6-7fd6f7820a24 None None] MFA Rules not processed for user `711d53a7deb94849b577c08dc9165ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:07:25.840956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-193d0a08-62ae-42a5-a7d6-7fd6f7820a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:07:25.847475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 741/1474] 10.222.0.33 () {58 vars in 1059 bytes} [Thu Jun 23 13:07:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:07:25.854335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce80ea-8aa7-452f-8ac5-39c1b8e97a64 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:07:25.865146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce80ea-8aa7-452f-8ac5-39c1b8e97a64 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:07:25.868525 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d723cd-abe5-403e-8d9c-316774eda9df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '711d53a7deb94849b577c08dc9165ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:07:25.869177 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d723cd-abe5-403e-8d9c-316774eda9df service glance] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:25.869458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d723cd-abe5-403e-8d9c-316774eda9df service glance] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:25.869732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d723cd-abe5-403e-8d9c-316774eda9df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:25.878341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d723cd-abe5-403e-8d9c-316774eda9df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:07:25.879763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d723cd-abe5-403e-8d9c-316774eda9df service glance] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:07:25.889584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 734/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:07:27.985934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7a6fb-2078-4d87-b117-0d800df1dbab None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:27.986513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7a6fb-2078-4d87-b117-0d800df1dbab None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:27.986513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7a6fb-2078-4d87-b117-0d800df1dbab None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:27.987849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 742/1476] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:07:27.993709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022605-0127-4594-abdb-9d431e1c01a1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:27.994131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022605-0127-4594-abdb-9d431e1c01a1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:27.994299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022605-0127-4594-abdb-9d431e1c01a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:28.012081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9a022605-0127-4594-abdb-9d431e1c01a1 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:07:28.013289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9a022605-0127-4594-abdb-9d431e1c01a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:07:28.020896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 735/1477] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:07:28.044092 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7a6fb-2078-4d87-b117-0d800df1dbab None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:07:28.056935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7a6fb-2078-4d87-b117-0d800df1dbab None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:07:28.061337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0e009-9a48-461f-8c99-4ef0dc2dece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:07:28.061978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0e009-9a48-461f-8c99-4ef0dc2dece6 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:28.062261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0e009-9a48-461f-8c99-4ef0dc2dece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:28.062536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0e009-9a48-461f-8c99-4ef0dc2dece6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:28.063268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0e009-9a48-461f-8c99-4ef0dc2dece6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:07:28.065075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-99a0e009-9a48-461f-8c99-4ef0dc2dece6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:07:28.065075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 23 13:07:28.065075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: Jun 23 13:07:28.066201 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0e009-9a48-461f-8c99-4ef0dc2dece6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:07:28.085711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 743/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 23 13:07:28 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:07:30.134239 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880fc4c-499a-4dc9-8816-0ea680e3245b None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:30.134796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880fc4c-499a-4dc9-8816-0ea680e3245b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:30.134904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880fc4c-499a-4dc9-8816-0ea680e3245b None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:30.136242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 736/1479] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:07:30.141381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801348c-f064-46ea-b930-9fd744f565ad None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:30.141828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801348c-f064-46ea-b930-9fd744f565ad None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:30.141950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801348c-f064-46ea-b930-9fd744f565ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:30.160471 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7801348c-f064-46ea-b930-9fd744f565ad None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:07:30.161743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7801348c-f064-46ea-b930-9fd744f565ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:07:30.169646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 744/1480] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:07:30.212898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880fc4c-499a-4dc9-8816-0ea680e3245b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:07:30.226917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880fc4c-499a-4dc9-8816-0ea680e3245b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:07:30.232543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd8e2d-2aca-4231-a3c4-ae4050eec8d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:07:30.233209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd8e2d-2aca-4231-a3c4-ae4050eec8d7 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:30.233498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd8e2d-2aca-4231-a3c4-ae4050eec8d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:30.233779 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd8e2d-2aca-4231-a3c4-ae4050eec8d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:30.242272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd8e2d-2aca-4231-a3c4-ae4050eec8d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:07:30.243903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd8e2d-2aca-4231-a3c4-ae4050eec8d7 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:07:30.253286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 737/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:07:32.463406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17686d77-0621-40bc-87b7-5b9876966a14 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:32.464021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17686d77-0621-40bc-87b7-5b9876966a14 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:32.464021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17686d77-0621-40bc-87b7-5b9876966a14 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:32.465385 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 745/1482] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:07:32.470500 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454b121-a79f-4ced-bb2e-5100ce41a668 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:32.475802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454b121-a79f-4ced-bb2e-5100ce41a668 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:32.475802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454b121-a79f-4ced-bb2e-5100ce41a668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:32.489660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c454b121-a79f-4ced-bb2e-5100ce41a668 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:07:32.490972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c454b121-a79f-4ced-bb2e-5100ce41a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:07:32.498920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 738/1483] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:07:32.535154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17686d77-0621-40bc-87b7-5b9876966a14 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:07:32.546386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17686d77-0621-40bc-87b7-5b9876966a14 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:07:32.549807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a34b-b19c-4439-ada3-458d348ae453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:07:32.550429 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a34b-b19c-4439-ada3-458d348ae453 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:32.550705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a34b-b19c-4439-ada3-458d348ae453 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:32.550975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a34b-b19c-4439-ada3-458d348ae453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:32.559473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29a34b-b19c-4439-ada3-458d348ae453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:07:32.560916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29a34b-b19c-4439-ada3-458d348ae453 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:07:32.569970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 746/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:07:34.623988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1212b2-8594-4fff-8f4e-ac20d2b417fb None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:34.624562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1212b2-8594-4fff-8f4e-ac20d2b417fb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:34.624562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1212b2-8594-4fff-8f4e-ac20d2b417fb None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:34.625928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 739/1485] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:07:34.631047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d45c1c-100d-44f2-b968-7708f0dcae42 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:34.631493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d45c1c-100d-44f2-b968-7708f0dcae42 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:34.631606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d45c1c-100d-44f2-b968-7708f0dcae42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:34.649249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-75d45c1c-100d-44f2-b968-7708f0dcae42 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:07:34.650425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-75d45c1c-100d-44f2-b968-7708f0dcae42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:07:34.658271 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 747/1486] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:07:34.695496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1212b2-8594-4fff-8f4e-ac20d2b417fb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:07:34.706000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1212b2-8594-4fff-8f4e-ac20d2b417fb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:07:34.709960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfd95d-8693-4942-92fd-a93f6dc7df73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:07:34.710612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfd95d-8693-4942-92fd-a93f6dc7df73 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:34.710898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfd95d-8693-4942-92fd-a93f6dc7df73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:34.711172 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfd95d-8693-4942-92fd-a93f6dc7df73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:34.720090 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfd95d-8693-4942-92fd-a93f6dc7df73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:07:34.721532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfd95d-8693-4942-92fd-a93f6dc7df73 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:07:34.731979 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 740/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:07:36.896693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72390010-bf19-4cf4-9e6d-895d15cc960e None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:36.897240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72390010-bf19-4cf4-9e6d-895d15cc960e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:36.897240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72390010-bf19-4cf4-9e6d-895d15cc960e None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:36.898982 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 748/1488] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:07:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:07:36.904029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638851c3-4654-4763-9bf2-3a10b6d2b984 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:36.904446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638851c3-4654-4763-9bf2-3a10b6d2b984 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:36.904613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638851c3-4654-4763-9bf2-3a10b6d2b984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:36.922106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-638851c3-4654-4763-9bf2-3a10b6d2b984 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:07:36.923281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-638851c3-4654-4763-9bf2-3a10b6d2b984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:07:36.931444 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 741/1489] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:07:36.971270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72390010-bf19-4cf4-9e6d-895d15cc960e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:07:36.982013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72390010-bf19-4cf4-9e6d-895d15cc960e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:07:36.985544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74914a2-c3e0-4863-9504-4911859ccc5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:07:36.986177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74914a2-c3e0-4863-9504-4911859ccc5d service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:36.986462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74914a2-c3e0-4863-9504-4911859ccc5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:36.986737 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74914a2-c3e0-4863-9504-4911859ccc5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:36.995952 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74914a2-c3e0-4863-9504-4911859ccc5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:07:36.997399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74914a2-c3e0-4863-9504-4911859ccc5d service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:07:37.007202 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 749/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:07:39.409252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c5a74-9612-441a-8a54-9dd2e147e0f5 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:39.409752 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c5a74-9612-441a-8a54-9dd2e147e0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:39.409857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c5a74-9612-441a-8a54-9dd2e147e0f5 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:39.411805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 742/1491] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 23 13:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:07:39.416896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef28530-2d56-4523-929d-57f645a5ae8e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:39.417335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef28530-2d56-4523-929d-57f645a5ae8e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:39.417475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef28530-2d56-4523-929d-57f645a5ae8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:39.434752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-cef28530-2d56-4523-929d-57f645a5ae8e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:07:39.435941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-cef28530-2d56-4523-929d-57f645a5ae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:07:39.443870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 750/1492] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 23 13:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:07:39.483192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c5a74-9612-441a-8a54-9dd2e147e0f5 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:07:39.493955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c5a74-9612-441a-8a54-9dd2e147e0f5 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:07:39.497484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43b63-4cbf-45f4-80da-073f1720d6f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:07:39.498205 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43b63-4cbf-45f4-80da-073f1720d6f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:07:39.498493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43b63-4cbf-45f4-80da-073f1720d6f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:07:39.498800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43b63-4cbf-45f4-80da-073f1720d6f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:07:39.507893 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc43b63-4cbf-45f4-80da-073f1720d6f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:07:39.509359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc43b63-4cbf-45f4-80da-073f1720d6f8 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:07:39.518886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 743/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:07:49.429874 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=33 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:07:49.514631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=33 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:09:12.170569 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8c8d4-0232-4f84-8704-09f79710cbdf None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:12.171165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8c8d4-0232-4f84-8704-09f79710cbdf None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:12.171165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8c8d4-0232-4f84-8704-09f79710cbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:12.188801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-91c8c8d4-0232-4f84-8704-09f79710cbdf None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:09:12.190016 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-91c8c8d4-0232-4f84-8704-09f79710cbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:09:12.197762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 751/1494] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:09:12.207278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152ebdb-374e-4c83-9cef-17cde3066723 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:12.207758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152ebdb-374e-4c83-9cef-17cde3066723 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:12.207862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152ebdb-374e-4c83-9cef-17cde3066723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:12.225985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f152ebdb-374e-4c83-9cef-17cde3066723 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:09:12.227186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f152ebdb-374e-4c83-9cef-17cde3066723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:09:12.234976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 744/1495] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:09:12.239287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8c8d4-0232-4f84-8704-09f79710cbdf None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:12.248708 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8c8d4-0232-4f84-8704-09f79710cbdf None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:12.253174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a81dac-021f-40a1-ac97-9fb4d2058097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:12.253820 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a81dac-021f-40a1-ac97-9fb4d2058097 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:12.254108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a81dac-021f-40a1-ac97-9fb4d2058097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:12.254389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a81dac-021f-40a1-ac97-9fb4d2058097 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:12.255125 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a81dac-021f-40a1-ac97-9fb4d2058097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:09:12.255433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a81dac-021f-40a1-ac97-9fb4d2058097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:12.256439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-53a81dac-021f-40a1-ac97-9fb4d2058097 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:09:12.256439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 23 13:09:12.256439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: Jun 23 13:09:12.257346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a81dac-021f-40a1-ac97-9fb4d2058097 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:12.269290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 752/1496] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:09:12.277160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152ebdb-374e-4c83-9cef-17cde3066723 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:12.286738 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152ebdb-374e-4c83-9cef-17cde3066723 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:12.291203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82972c4b-2765-4384-81a8-4bfd3bf00a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:12.291847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82972c4b-2765-4384-81a8-4bfd3bf00a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:12.292137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82972c4b-2765-4384-81a8-4bfd3bf00a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:12.292426 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82972c4b-2765-4384-81a8-4bfd3bf00a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:12.293154 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82972c4b-2765-4384-81a8-4bfd3bf00a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:12.294940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-82972c4b-2765-4384-81a8-4bfd3bf00a3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:09:12.294940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 23 13:09:12.294940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: Jun 23 13:09:12.296211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82972c4b-2765-4384-81a8-4bfd3bf00a3f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:12.426208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 745/1497] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:09:12 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:09:12.430508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a81dac-021f-40a1-ac97-9fb4d2058097 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:12.440492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a81dac-021f-40a1-ac97-9fb4d2058097 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:12.498268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25243963-3e12-4079-af69-8b2614745591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:12.498932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25243963-3e12-4079-af69-8b2614745591 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:12.499220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25243963-3e12-4079-af69-8b2614745591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:12.499498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25243963-3e12-4079-af69-8b2614745591 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:12.500205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25243963-3e12-4079-af69-8b2614745591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:12.501223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-25243963-3e12-4079-af69-8b2614745591 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:09:12.501223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 23 13:09:12.501223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: Jun 23 13:09:12.502434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25243963-3e12-4079-af69-8b2614745591 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:12.605860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 753/1498] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:09:12 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:09:12.610117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82972c4b-2765-4384-81a8-4bfd3bf00a3f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:12.620332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82972c4b-2765-4384-81a8-4bfd3bf00a3f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:12.625477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4cec6-9664-4d59-880d-e456c5857006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:12.626131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4cec6-9664-4d59-880d-e456c5857006 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:12.626417 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4cec6-9664-4d59-880d-e456c5857006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:12.626693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4cec6-9664-4d59-880d-e456c5857006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:12.627406 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4cec6-9664-4d59-880d-e456c5857006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:12.628403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-27a4cec6-9664-4d59-880d-e456c5857006 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:09:12.628403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 23 13:09:12.628403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: Jun 23 13:09:12.629315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4cec6-9664-4d59-880d-e456c5857006 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:12.642344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 746/1499] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:09:12.646260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25243963-3e12-4079-af69-8b2614745591 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:12.656319 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25243963-3e12-4079-af69-8b2614745591 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:12.660856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db17bb-e670-4421-a21b-3e6ba19cb4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:12.661502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db17bb-e670-4421-a21b-3e6ba19cb4db admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:12.661786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db17bb-e670-4421-a21b-3e6ba19cb4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:12.662064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db17bb-e670-4421-a21b-3e6ba19cb4db admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:12.662784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db17bb-e670-4421-a21b-3e6ba19cb4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:12.663779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-d8db17bb-e670-4421-a21b-3e6ba19cb4db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:09:12.663779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 23 13:09:12.663779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: Jun 23 13:09:12.664681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db17bb-e670-4421-a21b-3e6ba19cb4db admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:12.677468 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 754/1500] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:09:12.681345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4cec6-9664-4d59-880d-e456c5857006 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:12.691337 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4cec6-9664-4d59-880d-e456c5857006 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:12.695764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca71a9-5e91-43ea-92f0-a7a4137d04b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:12.696621 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca71a9-5e91-43ea-92f0-a7a4137d04b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:12.696929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca71a9-5e91-43ea-92f0-a7a4137d04b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:12.697207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca71a9-5e91-43ea-92f0-a7a4137d04b9 admin admin] PATH_INFO: `/v3/projects/1a14f04c16e3460fb096f2f85ad9ab37/users/9d2198976dc94c658e048edc96ae36bb/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:12.712174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca71a9-5e91-43ea-92f0-a7a4137d04b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a14f04c16e3460fb096f2f85ad9ab37, user_id=9d2198976dc94c658e048edc96ae36bb, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:12.713219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-75ca71a9-5e91-43ea-92f0-a7a4137d04b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:09:12.713219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 23 13:09:12.713219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: Jun 23 13:09:12.715137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca71a9-5e91-43ea-92f0-a7a4137d04b9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:12.806648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 747/1501] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:09:12 2022] PUT /identity/v3/projects/1a14f04c16e3460fb096f2f85ad9ab37/users/9d2198976dc94c658e048edc96ae36bb/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:09:12.818825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56530b88-aa7f-4f8c-a3bf-fa6fe68b4f12 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:12.819118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56530b88-aa7f-4f8c-a3bf-fa6fe68b4f12 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:12.819400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56530b88-aa7f-4f8c-a3bf-fa6fe68b4f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:12.848559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-56530b88-aa7f-4f8c-a3bf-fa6fe68b4f12 None None] MFA Rules not processed for user `9d2198976dc94c658e048edc96ae36bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:09:12.849835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-56530b88-aa7f-4f8c-a3bf-fa6fe68b4f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:09:12.917253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 755/1502] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:09:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:09:12.931199 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ada84-8655-4ca4-bcb8-93088c3fb031 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:12.931434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ada84-8655-4ca4-bcb8-93088c3fb031 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:12.931716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ada84-8655-4ca4-bcb8-93088c3fb031 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:12.933151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 748/1503] 10.222.0.33 () {54 vars in 963 bytes} [Thu Jun 23 13:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:09:12.938902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1f2b4-5f9d-41dc-be93-2e89a842c44a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:12.939197 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1f2b4-5f9d-41dc-be93-2e89a842c44a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:12.939482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1f2b4-5f9d-41dc-be93-2e89a842c44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:12.956750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-66f1f2b4-5f9d-41dc-be93-2e89a842c44a None None] MFA Rules not processed for user `c1c0a73d629a47e4bdbd67da236240af`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:09:12.957948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-66f1f2b4-5f9d-41dc-be93-2e89a842c44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:09:13.001990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:09:13.008965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 756/1504] 10.222.0.33 () {58 vars in 1060 bytes} [Thu Jun 23 13:09:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:09:13.016798 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ada84-8655-4ca4-bcb8-93088c3fb031 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:13.027815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ada84-8655-4ca4-bcb8-93088c3fb031 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:13.031440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4281e3-d1ee-4775-a1c1-74d92859b0cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:13.032076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4281e3-d1ee-4775-a1c1-74d92859b0cd service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:13.032363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4281e3-d1ee-4775-a1c1-74d92859b0cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:13.032642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4281e3-d1ee-4775-a1c1-74d92859b0cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:13.041170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4281e3-d1ee-4775-a1c1-74d92859b0cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:13.042594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4281e3-d1ee-4775-a1c1-74d92859b0cd service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:13.051867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 749/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:09:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:09:13.098339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39313495-db9b-4259-9475-9fa9edb84547 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:13.098631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39313495-db9b-4259-9475-9fa9edb84547 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:13.098910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39313495-db9b-4259-9475-9fa9edb84547 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:13.100210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 757/1506] 10.222.0.33 () {52 vars in 829 bytes} [Thu Jun 23 13:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:09:13.103735 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4281e3-d1ee-4775-a1c1-74d92859b0cd service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:13.165095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4281e3-d1ee-4775-a1c1-74d92859b0cd service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:13.169582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:13.170446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:13.170724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:13.171990 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] PATH_INFO: `/v3/users/9d2198976dc94c658e048edc96ae36bb` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:13.173188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2198976dc94c658e048edc96ae36bb)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:13.174217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:09:13.174217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 23 13:09:13.174217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: Jun 23 13:09:13.175411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:13.383446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2198976dc94c658e048edc96ae36bb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:09:13.384202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2198976dc94c658e048edc96ae36bb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:09:13.384837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2198976dc94c658e048edc96ae36bb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:09:13.402789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2198976dc94c658e048edc96ae36bb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:09:13.415125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2198976dc94c658e048edc96ae36bb'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:09:13.419038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:09:13.486770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 750/1507] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:09:13 2022] DELETE /identity/v3/users/9d2198976dc94c658e048edc96ae36bb => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:09:13.491152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0f184-1c57-43e9-9b74-f7ea23918b29 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:13.491651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0f184-1c57-43e9-9b74-f7ea23918b29 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:13.491779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0f184-1c57-43e9-9b74-f7ea23918b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:13.508870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a2b0f184-1c57-43e9-9b74-f7ea23918b29 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:09:13.511020 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a2b0f184-1c57-43e9-9b74-f7ea23918b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:09:13.568198 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 758/1508] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:09:13.577675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:13.579087 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:09:13.634877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd7d8e-ec17-48f4-a50c-e1a5a254c5dd admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:13.638366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dd53e-8e55-47ef-b59e-44a302e6ce3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:13.639006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dd53e-8e55-47ef-b59e-44a302e6ce3c service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:13.639289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dd53e-8e55-47ef-b59e-44a302e6ce3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:13.639565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dd53e-8e55-47ef-b59e-44a302e6ce3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:13.649042 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dd53e-8e55-47ef-b59e-44a302e6ce3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:13.650459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dd53e-8e55-47ef-b59e-44a302e6ce3c service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:13.660234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 751/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:09:14.145802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0f184-1c57-43e9-9b74-f7ea23918b29 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:14.147582 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a2b0f184-1c57-43e9-9b74-f7ea23918b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:09:14.159192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0f184-1c57-43e9-9b74-f7ea23918b29 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:14.164085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:14.165019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:14.165308 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:14.165579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] PATH_INFO: `/v3/projects/1a14f04c16e3460fb096f2f85ad9ab37` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:14.166778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a14f04c16e3460fb096f2f85ad9ab37)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:14.167791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:09:14.167791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 23 13:09:14.167791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: Jun 23 13:09:14.169059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:14.301221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a14f04c16e3460fb096f2f85ad9ab37', 'request_id': 'req-3ab41b09-c4e5-4db8-8090-036096a88e31'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:09:14.314692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a14f04c16e3460fb096f2f85ad9ab37', 'request_id': 'req-3ab41b09-c4e5-4db8-8090-036096a88e31'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:09:14.320536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a14f04c16e3460fb096f2f85ad9ab37', 'request_id': 'req-3ab41b09-c4e5-4db8-8090-036096a88e31'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:09:14.417368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] The token cache is being invalidate because project 1a14f04c16e3460fb096f2f85ad9ab37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:09:14.417657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:09:14.418394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3ab41b09-c4e5-4db8-8090-036096a88e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:09:14.420022 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 759/1510] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:09:14 2022] DELETE /identity/v3/projects/1a14f04c16e3460fb096f2f85ad9ab37 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:09:23.655871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:09:24.414100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:10:52.339821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f3da1-5253-4ace-a312-9205e7af629f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:52.340421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f3da1-5253-4ace-a312-9205e7af629f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:52.340421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f3da1-5253-4ace-a312-9205e7af629f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:52.341789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:10:52.347143 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf987f-7f56-428e-8110-7e3208911c16 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:52.347551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf987f-7f56-428e-8110-7e3208911c16 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:52.347701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf987f-7f56-428e-8110-7e3208911c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:52.365917 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a4bf987f-7f56-428e-8110-7e3208911c16 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:10:52.367122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a4bf987f-7f56-428e-8110-7e3208911c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:52.424464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:10:52.578359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f3da1-5253-4ace-a312-9205e7af629f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:10:52.580597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-607f3da1-5253-4ace-a312-9205e7af629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:52.655297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f3da1-5253-4ace-a312-9205e7af629f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:10:52.661178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff290c-84d8-4d4d-ae63-5191629494be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:10:52.661815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff290c-84d8-4d4d-ae63-5191629494be service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:52.662097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff290c-84d8-4d4d-ae63-5191629494be service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:52.662368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff290c-84d8-4d4d-ae63-5191629494be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:52.670284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff290c-84d8-4d4d-ae63-5191629494be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:10:52.671860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff290c-84d8-4d4d-ae63-5191629494be service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:10:52.681098 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 753/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:10:53.519632 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc18a5-6659-46b6-887c-abf0e301a3bd None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:53.520442 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc18a5-6659-46b6-887c-abf0e301a3bd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:53.520550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc18a5-6659-46b6-887c-abf0e301a3bd None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:53.521941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:10:53.527024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f990d-d4ea-48b8-88e8-845e39e1f7d1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:53.527458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f990d-d4ea-48b8-88e8-845e39e1f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:53.527567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f990d-d4ea-48b8-88e8-845e39e1f7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:53.545681 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-bf0f990d-d4ea-48b8-88e8-845e39e1f7d1 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:10:53.546898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bf0f990d-d4ea-48b8-88e8-845e39e1f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:53.555296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:10:53.706861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc18a5-6659-46b6-887c-abf0e301a3bd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:10:53.720815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc18a5-6659-46b6-887c-abf0e301a3bd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:10:53.726371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086878-9788-4e78-84dd-32a388d43478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:10:53.726995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086878-9788-4e78-84dd-32a388d43478 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:53.727275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086878-9788-4e78-84dd-32a388d43478 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:53.727545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086878-9788-4e78-84dd-32a388d43478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:53.735619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0086878-9788-4e78-84dd-32a388d43478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:10:53.737232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0086878-9788-4e78-84dd-32a388d43478 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:10:53.746322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 762/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:10:54.165012 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952e106-64ae-4695-80aa-ecd8d82d68c8 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:54.165324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952e106-64ae-4695-80aa-ecd8d82d68c8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:54.165605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952e106-64ae-4695-80aa-ecd8d82d68c8 None None] PATH_INFO: `/v3` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:54.166926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 755/1517] 10.222.0.39 () {54 vars in 925 bytes} [Thu Jun 23 13:10:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:10:54.173737 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab0ddc-d714-425b-a9e6-813f22283a2f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:54.174030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab0ddc-d714-425b-a9e6-813f22283a2f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:54.174316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab0ddc-d714-425b-a9e6-813f22283a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:54.192720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e8ab0ddc-d714-425b-a9e6-813f22283a2f None None] MFA Rules not processed for user `8644754798b5439c954c86dc9aa9e7af`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:10:54.193950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e8ab0ddc-d714-425b-a9e6-813f22283a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:54.253989 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 763/1518] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jun 23 13:10:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:03.403766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b80ac-856c-4f6b-bb10-f6b569658bbc None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:03.404313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b80ac-856c-4f6b-bb10-f6b569658bbc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:03.404313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b80ac-856c-4f6b-bb10-f6b569658bbc None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:03.405668 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 756/1519] 10.222.0.33 () {54 vars in 960 bytes} [Thu Jun 23 13:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:11:03.411122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04855803-33fd-483b-a442-127ced26baef None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:03.411564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04855803-33fd-483b-a442-127ced26baef None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:03.411678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04855803-33fd-483b-a442-127ced26baef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:03.430059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-04855803-33fd-483b-a442-127ced26baef None None] MFA Rules not processed for user `8644754798b5439c954c86dc9aa9e7af`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:03.431243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-04855803-33fd-483b-a442-127ced26baef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:03.440109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 764/1520] 10.222.0.33 () {58 vars in 1057 bytes} [Thu Jun 23 13:11:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:03.447816 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b80ac-856c-4f6b-bb10-f6b569658bbc None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:03.461354 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b80ac-856c-4f6b-bb10-f6b569658bbc None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:03.466544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0761c-267e-48f9-8c66-5f7058a8179e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:03.467191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0761c-267e-48f9-8c66-5f7058a8179e service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:03.467477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0761c-267e-48f9-8c66-5f7058a8179e service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:03.467758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0761c-267e-48f9-8c66-5f7058a8179e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:03.476940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0761c-267e-48f9-8c66-5f7058a8179e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:03.478511 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0761c-267e-48f9-8c66-5f7058a8179e service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:03.488761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 757/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:11:04.983841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ac42-d3f7-4959-90e9-f7881ac87cd6 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:04.984430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ac42-d3f7-4959-90e9-f7881ac87cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:04.984430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ac42-d3f7-4959-90e9-f7881ac87cd6 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:04.985846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:11:04.990808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56648357-4fdb-4d15-b36a-44b991000106 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:04.991227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56648357-4fdb-4d15-b36a-44b991000106 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:04.991362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56648357-4fdb-4d15-b36a-44b991000106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:05.009588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-56648357-4fdb-4d15-b36a-44b991000106 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:05.010832 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-56648357-4fdb-4d15-b36a-44b991000106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:05.019459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:05.171529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440ac42-d3f7-4959-90e9-f7881ac87cd6 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:05.185959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440ac42-d3f7-4959-90e9-f7881ac87cd6 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:05.191863 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82554df1-d5e4-4bbc-9f3c-5715ddd31555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:05.192501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554df1-d5e4-4bbc-9f3c-5715ddd31555 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:05.192823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554df1-d5e4-4bbc-9f3c-5715ddd31555 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:05.193101 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554df1-d5e4-4bbc-9f3c-5715ddd31555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:05.201221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82554df1-d5e4-4bbc-9f3c-5715ddd31555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:05.202827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82554df1-d5e4-4bbc-9f3c-5715ddd31555 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:05.213921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 766/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:11:06.035073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d2311-c912-4404-964a-8e993604539d None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:06.035620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d2311-c912-4404-964a-8e993604539d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:06.036065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d2311-c912-4404-964a-8e993604539d None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:06.038431 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:11:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:11:06.044477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad3ba6-9298-485a-989f-217dd758756a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:06.044948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad3ba6-9298-485a-989f-217dd758756a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:06.045062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad3ba6-9298-485a-989f-217dd758756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:06.063003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-85ad3ba6-9298-485a-989f-217dd758756a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:06.064229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-85ad3ba6-9298-485a-989f-217dd758756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:06.072082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:06.224468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d2311-c912-4404-964a-8e993604539d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:06.239197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d2311-c912-4404-964a-8e993604539d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:06.244537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6982a1f-1cf3-4a9e-93d8-f26421d8568b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:06.245203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6982a1f-1cf3-4a9e-93d8-f26421d8568b service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:06.245492 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6982a1f-1cf3-4a9e-93d8-f26421d8568b service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:06.245781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6982a1f-1cf3-4a9e-93d8-f26421d8568b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:06.255251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6982a1f-1cf3-4a9e-93d8-f26421d8568b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:06.256871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6982a1f-1cf3-4a9e-93d8-f26421d8568b service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:06.266140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 760/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:11:10.000899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ed61f-be80-40af-a262-a9d389bc72f0 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:10.001487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ed61f-be80-40af-a262-a9d389bc72f0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:10.001487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ed61f-be80-40af-a262-a9d389bc72f0 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:10.002833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:11:10.008307 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df04d35-88e6-4123-a86a-838bcd2b8af1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:10.008721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df04d35-88e6-4123-a86a-838bcd2b8af1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:10.008890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df04d35-88e6-4123-a86a-838bcd2b8af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:10.026602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-0df04d35-88e6-4123-a86a-838bcd2b8af1 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:10.027774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0df04d35-88e6-4123-a86a-838bcd2b8af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:10.035595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:10.072545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ed61f-be80-40af-a262-a9d389bc72f0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:10.074333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b44ed61f-be80-40af-a262-a9d389bc72f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:10.132611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ed61f-be80-40af-a262-a9d389bc72f0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:10.136155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f382a-e128-4175-8c36-d7a8eff0bc59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:10.136828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f382a-e128-4175-8c36-d7a8eff0bc59 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:10.137109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f382a-e128-4175-8c36-d7a8eff0bc59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:10.137418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f382a-e128-4175-8c36-d7a8eff0bc59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:10.146369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f382a-e128-4175-8c36-d7a8eff0bc59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:10.147787 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f382a-e128-4175-8c36-d7a8eff0bc59 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:10.152607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:10.157771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 769/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:11:12.151710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350a7a5-2405-472c-b4e9-f973616a5bed None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:12.152241 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350a7a5-2405-472c-b4e9-f973616a5bed None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:12.152241 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350a7a5-2405-472c-b4e9-f973616a5bed None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:12.153672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:11:12.159424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eea454-d97e-45d2-95d6-3c6a46bbf454 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:12.159829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eea454-d97e-45d2-95d6-3c6a46bbf454 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:12.159989 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eea454-d97e-45d2-95d6-3c6a46bbf454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:12.296048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-52eea454-d97e-45d2-95d6-3c6a46bbf454 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:12.297326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-52eea454-d97e-45d2-95d6-3c6a46bbf454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:12.305139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:12.340933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350a7a5-2405-472c-b4e9-f973616a5bed None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:12.352317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350a7a5-2405-472c-b4e9-f973616a5bed None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:12.355784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a51135-23a2-46f4-a054-d0fcd174088b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:12.356416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a51135-23a2-46f4-a054-d0fcd174088b service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:12.356733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a51135-23a2-46f4-a054-d0fcd174088b service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:12.357009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a51135-23a2-46f4-a054-d0fcd174088b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:12.365681 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a51135-23a2-46f4-a054-d0fcd174088b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:12.367094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a51135-23a2-46f4-a054-d0fcd174088b service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:12.376976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 763/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:11:16.031320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d146a-cc3e-4210-a649-ea73f34fd1c5 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:16.031877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d146a-cc3e-4210-a649-ea73f34fd1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:16.031877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d146a-cc3e-4210-a649-ea73f34fd1c5 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:16.033256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:11:16.038403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ac685-09a3-4048-bb8f-60778772f89a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:16.038836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ac685-09a3-4048-bb8f-60778772f89a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:16.038984 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ac685-09a3-4048-bb8f-60778772f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:16.045210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=62 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:16.057446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-651ac685-09a3-4048-bb8f-60778772f89a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:16.058649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-651ac685-09a3-4048-bb8f-60778772f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:16.067150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:16.373115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d146a-cc3e-4210-a649-ea73f34fd1c5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:16.375428 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-798d146a-cc3e-4210-a649-ea73f34fd1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:16.432273 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d146a-cc3e-4210-a649-ea73f34fd1c5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:16.435809 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5a4ef-e6a5-49fc-a516-b306f02ab2d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:16.436451 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a4ef-e6a5-49fc-a516-b306f02ab2d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:16.437270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a4ef-e6a5-49fc-a516-b306f02ab2d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:16.437546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a4ef-e6a5-49fc-a516-b306f02ab2d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:16.446418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5a4ef-e6a5-49fc-a516-b306f02ab2d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:16.447827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5a4ef-e6a5-49fc-a516-b306f02ab2d6 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:16.457741 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 772/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:11:18.496350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1671c9d-d3c6-4852-b06e-9669b245731f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:18.496924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1671c9d-d3c6-4852-b06e-9669b245731f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:18.496924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1671c9d-d3c6-4852-b06e-9669b245731f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:18.498373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:11:18.503614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7083428-dbaa-47ac-ba89-9a818c5d3878 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:18.504062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7083428-dbaa-47ac-ba89-9a818c5d3878 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:18.504158 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7083428-dbaa-47ac-ba89-9a818c5d3878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:18.522245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a7083428-dbaa-47ac-ba89-9a818c5d3878 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:18.523425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a7083428-dbaa-47ac-ba89-9a818c5d3878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:18.531652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:18.831514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1671c9d-d3c6-4852-b06e-9669b245731f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:18.833220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f1671c9d-d3c6-4852-b06e-9669b245731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:18.846948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1671c9d-d3c6-4852-b06e-9669b245731f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:18.850398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100eb144-63b0-4cc2-aaca-60591a8008fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:18.851030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eb144-63b0-4cc2-aaca-60591a8008fd service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:18.851313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eb144-63b0-4cc2-aaca-60591a8008fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:18.851589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eb144-63b0-4cc2-aaca-60591a8008fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:18.860286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100eb144-63b0-4cc2-aaca-60591a8008fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:18.861727 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100eb144-63b0-4cc2-aaca-60591a8008fd service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:18.870896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 766/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:11:28.517153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=32 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:28.866809 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=8 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:47.516338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98b9b4-bbc1-4689-8f92-dae4d1e5ac8b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.522570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98b9b4-bbc1-4689-8f92-dae4d1e5ac8b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.522570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98b9b4-bbc1-4689-8f92-dae4d1e5ac8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.542480 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8d98b9b4-bbc1-4689-8f92-dae4d1e5ac8b None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:47.544333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8d98b9b4-bbc1-4689-8f92-dae4d1e5ac8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:47.556994 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 774/1540] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:47.566905 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238380-4967-4abc-b15e-082339c06aa2 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.567501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238380-4967-4abc-b15e-082339c06aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.567501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238380-4967-4abc-b15e-082339c06aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.597686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c2238380-4967-4abc-b15e-082339c06aa2 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:47.598908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c2238380-4967-4abc-b15e-082339c06aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:47.612561 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 767/1541] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:47.617355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98b9b4-bbc1-4689-8f92-dae4d1e5ac8b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:47.631723 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98b9b4-bbc1-4689-8f92-dae4d1e5ac8b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:47.638214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34b4ea-0573-4dd5-8f7c-5f02e4226a34 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.638496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34b4ea-0573-4dd5-8f7c-5f02e4226a34 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.638780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34b4ea-0573-4dd5-8f7c-5f02e4226a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.641016 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25212d-2485-4b23-8dd4-ec73c4922e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:47.642068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25212d-2485-4b23-8dd4-ec73c4922e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.642565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25212d-2485-4b23-8dd4-ec73c4922e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.643048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25212d-2485-4b23-8dd4-ec73c4922e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.644231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25212d-2485-4b23-8dd4-ec73c4922e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:47.644782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25212d-2485-4b23-8dd4-ec73c4922e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:47.646942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25212d-2485-4b23-8dd4-ec73c4922e0d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:47.666546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 775/1542] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:47.669824 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ab34b4ea-0573-4dd5-8f7c-5f02e4226a34 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:47.671075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ab34b4ea-0573-4dd5-8f7c-5f02e4226a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:47.677709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25212d-2485-4b23-8dd4-ec73c4922e0d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:47.685836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 768/1543] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:47.697029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25212d-2485-4b23-8dd4-ec73c4922e0d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:47.697242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b927c3-fb44-4923-8db5-6ae11ddf9b51 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.697242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b927c3-fb44-4923-8db5-6ae11ddf9b51 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.697242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b927c3-fb44-4923-8db5-6ae11ddf9b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.703001 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8f78e-9f89-405a-b827-9aff662dc64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:47.703937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8f78e-9f89-405a-b827-9aff662dc64a admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.704436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8f78e-9f89-405a-b827-9aff662dc64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.704946 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8f78e-9f89-405a-b827-9aff662dc64a admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.705868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8f78e-9f89-405a-b827-9aff662dc64a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:47.707100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-79b8f78e-9f89-405a-b827-9aff662dc64a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:12:47.707100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 23 13:12:47.707100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: Jun 23 13:12:47.709124 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8f78e-9f89-405a-b827-9aff662dc64a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:47.733542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-57b927c3-fb44-4923-8db5-6ae11ddf9b51 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:47.734768 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-57b927c3-fb44-4923-8db5-6ae11ddf9b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:47.759708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 769/1544] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:47.764058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b927c3-fb44-4923-8db5-6ae11ddf9b51 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:47.777105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b927c3-fb44-4923-8db5-6ae11ddf9b51 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:47.783427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e358941-dc89-4d9c-9a97-e8b5972bc6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:47.784208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e358941-dc89-4d9c-9a97-e8b5972bc6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.784552 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e358941-dc89-4d9c-9a97-e8b5972bc6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.784865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e358941-dc89-4d9c-9a97-e8b5972bc6a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.785663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e358941-dc89-4d9c-9a97-e8b5972bc6a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:47.785991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e358941-dc89-4d9c-9a97-e8b5972bc6a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:47.787087 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-6e358941-dc89-4d9c-9a97-e8b5972bc6a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:12:47.787087 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 23 13:12:47.787087 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: Jun 23 13:12:47.787977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e358941-dc89-4d9c-9a97-e8b5972bc6a1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:47.804174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 770/1545] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:12:47.804890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 776/1546] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:47 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:47.809541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e358941-dc89-4d9c-9a97-e8b5972bc6a1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:47.822893 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e358941-dc89-4d9c-9a97-e8b5972bc6a1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:47.828223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8f78e-9f89-405a-b827-9aff662dc64a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:47.958601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8f78e-9f89-405a-b827-9aff662dc64a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:47.967075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be47a8f-2fa6-4f69-b313-8530a821a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:47.967761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be47a8f-2fa6-4f69-b313-8530a821a600 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.968051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be47a8f-2fa6-4f69-b313-8530a821a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.968333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be47a8f-2fa6-4f69-b313-8530a821a600 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.969071 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be47a8f-2fa6-4f69-b313-8530a821a600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:47.970096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-8be47a8f-2fa6-4f69-b313-8530a821a600 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:12:47.970096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 23 13:12:47.970096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: Jun 23 13:12:47.971318 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be47a8f-2fa6-4f69-b313-8530a821a600 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:47.973263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ddc54-1144-47ef-bec9-16755bb5c28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:47.973939 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ddc54-1144-47ef-bec9-16755bb5c28c admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.974215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ddc54-1144-47ef-bec9-16755bb5c28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.974487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ddc54-1144-47ef-bec9-16755bb5c28c admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.975192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ddc54-1144-47ef-bec9-16755bb5c28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:47.977115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ddc54-1144-47ef-bec9-16755bb5c28c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.073209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 771/1547] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:47 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:48.079625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be47a8f-2fa6-4f69-b313-8530a821a600 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:48.107168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 777/1548] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:47 2022] POST /identity/v3/projects => generated 371 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:48.113776 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ddc54-1144-47ef-bec9-16755bb5c28c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:48.117360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be47a8f-2fa6-4f69-b313-8530a821a600 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:48.305614 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46eb1d-aa51-4603-a333-2676b8cc0e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:48.306395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46eb1d-aa51-4603-a333-2676b8cc0e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.306686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46eb1d-aa51-4603-a333-2676b8cc0e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.306964 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46eb1d-aa51-4603-a333-2676b8cc0e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.307735 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46eb1d-aa51-4603-a333-2676b8cc0e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:48.309480 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46eb1d-aa51-4603-a333-2676b8cc0e24 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.315148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ddc54-1144-47ef-bec9-16755bb5c28c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:48.335642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 772/1549] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:12:48.335642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46eb1d-aa51-4603-a333-2676b8cc0e24 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:48.335929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd6632-2ba2-42a3-951a-fd090abcde67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:48.335929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd6632-2ba2-42a3-951a-fd090abcde67 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.335929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd6632-2ba2-42a3-951a-fd090abcde67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.336211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd6632-2ba2-42a3-951a-fd090abcde67 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.336692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd6632-2ba2-42a3-951a-fd090abcde67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:48.339298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd6632-2ba2-42a3-951a-fd090abcde67 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.357246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46eb1d-aa51-4603-a333-2676b8cc0e24 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:48.375147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8457-02b0-41e7-b62c-5d34e32993ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:48.376255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8457-02b0-41e7-b62c-5d34e32993ca admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.376255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8457-02b0-41e7-b62c-5d34e32993ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.376462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8457-02b0-41e7-b62c-5d34e32993ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.377188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef8457-02b0-41e7-b62c-5d34e32993ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:48.379273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef8457-02b0-41e7-b62c-5d34e32993ca admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.399385 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 773/1550] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:12:48.403761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8457-02b0-41e7-b62c-5d34e32993ca admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:48.418132 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8457-02b0-41e7-b62c-5d34e32993ca admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:48.428104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17953b4f-76d1-49cb-93d4-b6fcba971e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:48.429105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17953b4f-76d1-49cb-93d4-b6fcba971e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.429395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17953b4f-76d1-49cb-93d4-b6fcba971e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.429931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17953b4f-76d1-49cb-93d4-b6fcba971e5c admin admin] PATH_INFO: `/v3/projects/b486a0d20533487abf8c2ee29aaed8b0/users/3e35ecf64db94d728d8aac2c95536417/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.454773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17953b4f-76d1-49cb-93d4-b6fcba971e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b486a0d20533487abf8c2ee29aaed8b0, user_id=3e35ecf64db94d728d8aac2c95536417, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:48.457563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17953b4f-76d1-49cb-93d4-b6fcba971e5c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.479986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 778/1551] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/users => generated 286 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:48.484915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740e0ac-6a8a-4c85-9126-73e6da2089a6 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.484915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740e0ac-6a8a-4c85-9126-73e6da2089a6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.484915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740e0ac-6a8a-4c85-9126-73e6da2089a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.503209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9740e0ac-6a8a-4c85-9126-73e6da2089a6 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.504575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9740e0ac-6a8a-4c85-9126-73e6da2089a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.513884 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 779/1552] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.517055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3940-4adc-46a2-945c-d40999d1de06 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.517055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3940-4adc-46a2-945c-d40999d1de06 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.517055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3940-4adc-46a2-945c-d40999d1de06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.539357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d0aa3940-4adc-46a2-945c-d40999d1de06 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.540690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d0aa3940-4adc-46a2-945c-d40999d1de06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.544086 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 774/1553] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:48 2022] PUT /identity/v3/projects/b486a0d20533487abf8c2ee29aaed8b0/users/3e35ecf64db94d728d8aac2c95536417/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:48.548784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f7725-c87b-4370-ae7b-c192c3930dfa None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.548784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f7725-c87b-4370-ae7b-c192c3930dfa None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.548784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f7725-c87b-4370-ae7b-c192c3930dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.566878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:48.572159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-625f7725-c87b-4370-ae7b-c192c3930dfa None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.572159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-625f7725-c87b-4370-ae7b-c192c3930dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.581333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:48.605353 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 780/1554] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.606211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa3940-4adc-46a2-945c-d40999d1de06 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:48.615798 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa3940-4adc-46a2-945c-d40999d1de06 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:48.620938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76cdac-b8f5-4381-a24a-2161cbc1b75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:48.621860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76cdac-b8f5-4381-a24a-2161cbc1b75e admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.621860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76cdac-b8f5-4381-a24a-2161cbc1b75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.622155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76cdac-b8f5-4381-a24a-2161cbc1b75e admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.622880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76cdac-b8f5-4381-a24a-2161cbc1b75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:48.624472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76cdac-b8f5-4381-a24a-2161cbc1b75e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.631787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 775/1555] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.631787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb603f-b43f-43c0-9a45-6b8306f65a18 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.631787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb603f-b43f-43c0-9a45-6b8306f65a18 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.631787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb603f-b43f-43c0-9a45-6b8306f65a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.640189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 781/1556] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:48.640189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e71f2-06f2-4f61-9060-3c8c11455993 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.640189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e71f2-06f2-4f61-9060-3c8c11455993 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.640189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e71f2-06f2-4f61-9060-3c8c11455993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.656181 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-53fb603f-b43f-43c0-9a45-6b8306f65a18 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.657762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-53fb603f-b43f-43c0-9a45-6b8306f65a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.659715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e14e71f2-06f2-4f61-9060-3c8c11455993 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.660964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e14e71f2-06f2-4f61-9060-3c8c11455993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.665968 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 776/1557] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.667254 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627d72a-b099-4cbc-a583-7a4833c45d1d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.667584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627d72a-b099-4cbc-a583-7a4833c45d1d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.667823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627d72a-b099-4cbc-a583-7a4833c45d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.669046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 782/1558] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.673772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a244-45b5-4c8e-aece-b991aa25003a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.674071 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a244-45b5-4c8e-aece-b991aa25003a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.674352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a244-45b5-4c8e-aece-b991aa25003a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.686617 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b627d72a-b099-4cbc-a583-7a4833c45d1d None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.687813 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b627d72a-b099-4cbc-a583-7a4833c45d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.692791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-21b5a244-45b5-4c8e-aece-b991aa25003a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.693941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-21b5a244-45b5-4c8e-aece-b991aa25003a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.697487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 777/1559] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.697487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734071f-0230-4e15-b33c-b44ea610d48b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.697487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734071f-0230-4e15-b33c-b44ea610d48b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.706073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734071f-0230-4e15-b33c-b44ea610d48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.706169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 783/1560] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.706169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42ff90-11fa-4c9c-9a26-a5ed944c1736 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.706169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42ff90-11fa-4c9c-9a26-a5ed944c1736 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.706169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42ff90-11fa-4c9c-9a26-a5ed944c1736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.723869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-2734071f-0230-4e15-b33c-b44ea610d48b None None] MFA Rules not processed for user `3e35ecf64db94d728d8aac2c95536417`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.725107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2734071f-0230-4e15-b33c-b44ea610d48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.729698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-aa42ff90-11fa-4c9c-9a26-a5ed944c1736 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.730857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-aa42ff90-11fa-4c9c-9a26-a5ed944c1736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.738610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 784/1561] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.739370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42ff90-11fa-4c9c-9a26-a5ed944c1736 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:48.750773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42ff90-11fa-4c9c-9a26-a5ed944c1736 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:48.755373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f5abd-8dd8-4af4-8b91-117abaf373ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:48.756120 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5abd-8dd8-4af4-8b91-117abaf373ac admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.756380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5abd-8dd8-4af4-8b91-117abaf373ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.756684 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5abd-8dd8-4af4-8b91-117abaf373ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.757421 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f5abd-8dd8-4af4-8b91-117abaf373ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:48.759522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f5abd-8dd8-4af4-8b91-117abaf373ac admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.770086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 785/1562] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:48.771313 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ee272-31d5-4585-8758-0465ffcbda66 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.771654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ee272-31d5-4585-8758-0465ffcbda66 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.771930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ee272-31d5-4585-8758-0465ffcbda66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.789758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-847ee272-31d5-4585-8758-0465ffcbda66 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.791371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-847ee272-31d5-4585-8758-0465ffcbda66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.796962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 778/1563] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.797961 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734071f-0230-4e15-b33c-b44ea610d48b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:48.799575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 786/1564] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.804218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaafca8-a583-45f5-923a-caed6a8c230a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.804508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaafca8-a583-45f5-923a-caed6a8c230a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.804854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaafca8-a583-45f5-923a-caed6a8c230a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.811605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734071f-0230-4e15-b33c-b44ea610d48b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:48.816076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ad11a-4bda-45bb-a309-729820619e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:48.816827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ad11a-4bda-45bb-a309-729820619e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.817506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ad11a-4bda-45bb-a309-729820619e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.817506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ad11a-4bda-45bb-a309-729820619e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.818172 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ad11a-4bda-45bb-a309-729820619e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:48.818480 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ad11a-4bda-45bb-a309-729820619e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:48.820417 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ad11a-4bda-45bb-a309-729820619e0e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.824565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ccaafca8-a583-45f5-923a-caed6a8c230a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.825873 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ccaafca8-a583-45f5-923a-caed6a8c230a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.840923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 779/1565] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:48.841105 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 787/1566] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.841211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ef22a-3b08-43ae-9f94-1faa70377958 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.841211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ef22a-3b08-43ae-9f94-1faa70377958 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.841211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ef22a-3b08-43ae-9f94-1faa70377958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.841458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d31e3-32bd-4d6a-b4c0-467af4db9c56 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.841458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d31e3-32bd-4d6a-b4c0-467af4db9c56 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.841458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d31e3-32bd-4d6a-b4c0-467af4db9c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.858939 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-113ef22a-3b08-43ae-9f94-1faa70377958 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.860057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-744d31e3-32bd-4d6a-b4c0-467af4db9c56 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.860216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-113ef22a-3b08-43ae-9f94-1faa70377958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.861261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-744d31e3-32bd-4d6a-b4c0-467af4db9c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.868095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 780/1567] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.868892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ef22a-3b08-43ae-9f94-1faa70377958 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:48.869408 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 788/1568] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.870234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d31e3-32bd-4d6a-b4c0-467af4db9c56 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:48.879762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d31e3-32bd-4d6a-b4c0-467af4db9c56 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:48.881836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ef22a-3b08-43ae-9f94-1faa70377958 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:48.885064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884e39-c139-462f-91ea-49bd904f5026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:48.885936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884e39-c139-462f-91ea-49bd904f5026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.886215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884e39-c139-462f-91ea-49bd904f5026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.886491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884e39-c139-462f-91ea-49bd904f5026 admin admin] PATH_INFO: `/v3/projects/cc5ac82cb96a4ea29481ed2d110fabfa/users/6ea0e418862e413da1cdd32642939c06/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.886738 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a35db-fe89-4a13-9099-d60bc8e89268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:48.887386 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a35db-fe89-4a13-9099-d60bc8e89268 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.887670 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a35db-fe89-4a13-9099-d60bc8e89268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.887944 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a35db-fe89-4a13-9099-d60bc8e89268 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.888730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a35db-fe89-4a13-9099-d60bc8e89268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:48.889042 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a35db-fe89-4a13-9099-d60bc8e89268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:48.890627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a35db-fe89-4a13-9099-d60bc8e89268 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.902224 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c884e39-c139-462f-91ea-49bd904f5026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5ac82cb96a4ea29481ed2d110fabfa, user_id=6ea0e418862e413da1cdd32642939c06, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:48.902733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 781/1569] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:48.903260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-7c884e39-c139-462f-91ea-49bd904f5026 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:12:48.903260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 23 13:12:48.903260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: Jun 23 13:12:48.903592 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a35db-fe89-4a13-9099-d60bc8e89268 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:48.905217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c884e39-c139-462f-91ea-49bd904f5026 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.913808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a35db-fe89-4a13-9099-d60bc8e89268 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:48.918926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe995-36ed-4aa2-a2b4-af9b3317a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:48.921892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe995-36ed-4aa2-a2b4-af9b3317a45c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.921892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe995-36ed-4aa2-a2b4-af9b3317a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.921892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe995-36ed-4aa2-a2b4-af9b3317a45c admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.921892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fe995-36ed-4aa2-a2b4-af9b3317a45c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:48.921892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fe995-36ed-4aa2-a2b4-af9b3317a45c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:48.922793 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fe995-36ed-4aa2-a2b4-af9b3317a45c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.935198 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 782/1570] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:48.936376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeef189-03a0-42fe-9ff2-21f396839892 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.936679 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeef189-03a0-42fe-9ff2-21f396839892 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.936970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeef189-03a0-42fe-9ff2-21f396839892 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.938184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 783/1571] 10.222.0.33 () {54 vars in 961 bytes} [Thu Jun 23 13:12:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:12:48.938846 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeef189-03a0-42fe-9ff2-21f396839892 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:48.950876 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeef189-03a0-42fe-9ff2-21f396839892 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:48.955255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a8a97-e067-4b19-bb7b-f526a6fe929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:48.955847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a8a97-e067-4b19-bb7b-f526a6fe929d admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.956128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a8a97-e067-4b19-bb7b-f526a6fe929d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.956403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a8a97-e067-4b19-bb7b-f526a6fe929d admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.957163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a8a97-e067-4b19-bb7b-f526a6fe929d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:48.959003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a8a97-e067-4b19-bb7b-f526a6fe929d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.975523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 789/1572] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:48 2022] PUT /identity/v3/projects/cc5ac82cb96a4ea29481ed2d110fabfa/users/6ea0e418862e413da1cdd32642939c06/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:48.979368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884e39-c139-462f-91ea-49bd904f5026 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.035893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884e39-c139-462f-91ea-49bd904f5026 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.040996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355c814-6825-4f73-a79f-b8837834d7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.041649 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355c814-6825-4f73-a79f-b8837834d7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.041931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355c814-6825-4f73-a79f-b8837834d7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.042211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355c814-6825-4f73-a79f-b8837834d7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.042930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355c814-6825-4f73-a79f-b8837834d7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:49.043234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355c814-6825-4f73-a79f-b8837834d7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.044836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355c814-6825-4f73-a79f-b8837834d7e6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.058436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 784/1573] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:49.058436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a8a97-e067-4b19-bb7b-f526a6fe929d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.064253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 790/1574] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:49.065255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355c814-6825-4f73-a79f-b8837834d7e6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.074894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355c814-6825-4f73-a79f-b8837834d7e6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.090662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:49.111223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:49.123662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a8a97-e067-4b19-bb7b-f526a6fe929d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.128558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a841e6-658c-4f97-a744-fbfd0d01bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.129296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a841e6-658c-4f97-a744-fbfd0d01bee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.129587 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a841e6-658c-4f97-a744-fbfd0d01bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.129872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a841e6-658c-4f97-a744-fbfd0d01bee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.130602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a841e6-658c-4f97-a744-fbfd0d01bee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:49.130911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a841e6-658c-4f97-a744-fbfd0d01bee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.132557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a841e6-658c-4f97-a744-fbfd0d01bee6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.132842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9689f-98bf-477e-9eb4-7c1efeb590cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.133509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9689f-98bf-477e-9eb4-7c1efeb590cf admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.133859 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9689f-98bf-477e-9eb4-7c1efeb590cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.134339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9689f-98bf-477e-9eb4-7c1efeb590cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.135052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9689f-98bf-477e-9eb4-7c1efeb590cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:49.135409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9689f-98bf-477e-9eb4-7c1efeb590cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.137016 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9689f-98bf-477e-9eb4-7c1efeb590cf admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.144928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 785/1575] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:49.145896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a841e6-658c-4f97-a744-fbfd0d01bee6 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.148798 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 791/1576] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:49.150096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9689f-98bf-477e-9eb4-7c1efeb590cf admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.157777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a841e6-658c-4f97-a744-fbfd0d01bee6 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.168570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9689f-98bf-477e-9eb4-7c1efeb590cf admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.168885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44e92b-af27-431b-8fce-718ea8a812a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.168885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44e92b-af27-431b-8fce-718ea8a812a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.168885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44e92b-af27-431b-8fce-718ea8a812a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.168885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44e92b-af27-431b-8fce-718ea8a812a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.169267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44e92b-af27-431b-8fce-718ea8a812a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.169267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44e92b-af27-431b-8fce-718ea8a812a4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.169434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb2519-c224-4fec-8546-8e43bc8d0b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.169434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb2519-c224-4fec-8546-8e43bc8d0b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.169434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb2519-c224-4fec-8546-8e43bc8d0b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.169434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb2519-c224-4fec-8546-8e43bc8d0b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.169803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb2519-c224-4fec-8546-8e43bc8d0b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.171029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb2519-c224-4fec-8546-8e43bc8d0b2f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.325842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 792/1578] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:49 2022] POST /identity/v3/projects => generated 389 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:49.326035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 786/1578] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:49 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:49.327209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621b8a7-55f3-4b81-86e9-d41526199808 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.327502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621b8a7-55f3-4b81-86e9-d41526199808 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.327783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621b8a7-55f3-4b81-86e9-d41526199808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.328138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2319eb-0ea4-4c68-917c-a91e50c75142 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.328679 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2319eb-0ea4-4c68-917c-a91e50c75142 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.329342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2319eb-0ea4-4c68-917c-a91e50c75142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.345889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5621b8a7-55f3-4b81-86e9-d41526199808 None None] MFA Rules not processed for user `5874e98df57242028c0f9983dee3b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:49.348943 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5621b8a7-55f3-4b81-86e9-d41526199808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:49.356128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ef2319eb-0ea4-4c68-917c-a91e50c75142 None None] MFA Rules not processed for user `6ea0e418862e413da1cdd32642939c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:49.357481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ef2319eb-0ea4-4c68-917c-a91e50c75142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:49.417699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 793/1579] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Jun 23 13:12:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:49.418546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621b8a7-55f3-4b81-86e9-d41526199808 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.424393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 787/1580] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:49.425293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2319eb-0ea4-4c68-917c-a91e50c75142 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.495177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621b8a7-55f3-4b81-86e9-d41526199808 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.500213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b64f94-a43d-47dc-bb90-07dce2510c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.500922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b64f94-a43d-47dc-bb90-07dce2510c2a admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.501212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b64f94-a43d-47dc-bb90-07dce2510c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.501490 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b64f94-a43d-47dc-bb90-07dce2510c2a admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.502178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b64f94-a43d-47dc-bb90-07dce2510c2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.503123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2319eb-0ea4-4c68-917c-a91e50c75142 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.504150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b64f94-a43d-47dc-bb90-07dce2510c2a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.507718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a587f9-5471-4da8-824b-b6004744cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.511623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a587f9-5471-4da8-824b-b6004744cc80 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.511623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a587f9-5471-4da8-824b-b6004744cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.511623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a587f9-5471-4da8-824b-b6004744cc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.511623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a587f9-5471-4da8-824b-b6004744cc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.512217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a587f9-5471-4da8-824b-b6004744cc80 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.597294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 794/1581] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:49 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:49.598297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b64f94-a43d-47dc-bb90-07dce2510c2a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.599555 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 788/1582] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:49 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:49.600366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a587f9-5471-4da8-824b-b6004744cc80 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.609450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b64f94-a43d-47dc-bb90-07dce2510c2a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.614467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:49.635661 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:49.662331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a587f9-5471-4da8-824b-b6004744cc80 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.665992 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8946e-423e-4836-bd5b-b4a0a1958efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.666657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8946e-423e-4836-bd5b-b4a0a1958efb admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.666934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8946e-423e-4836-bd5b-b4a0a1958efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.667206 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8946e-423e-4836-bd5b-b4a0a1958efb admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.667548 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2957ce5-3a99-40ef-832b-d56e59ff0d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.667939 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8946e-423e-4836-bd5b-b4a0a1958efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.668209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2957ce5-3a99-40ef-832b-d56e59ff0d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.668506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2957ce5-3a99-40ef-832b-d56e59ff0d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.668818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2957ce5-3a99-40ef-832b-d56e59ff0d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.669504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2957ce5-3a99-40ef-832b-d56e59ff0d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.669836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8946e-423e-4836-bd5b-b4a0a1958efb admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.671396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2957ce5-3a99-40ef-832b-d56e59ff0d45 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.817523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 795/1583] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:49 2022] POST /identity/v3/projects => generated 367 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:49.817523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8946e-423e-4836-bd5b-b4a0a1958efb admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.847774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 789/1584] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:49 2022] POST /identity/v3/projects => generated 391 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:49.847774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2957ce5-3a99-40ef-832b-d56e59ff0d45 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.879355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8946e-423e-4836-bd5b-b4a0a1958efb admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.905803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2957ce5-3a99-40ef-832b-d56e59ff0d45 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.910591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bb5f6-d97b-4455-a123-0b85606285e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.911326 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bb5f6-d97b-4455-a123-0b85606285e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.911615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bb5f6-d97b-4455-a123-0b85606285e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.911945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bb5f6-d97b-4455-a123-0b85606285e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.912625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bb5f6-d97b-4455-a123-0b85606285e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.917727 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bb5f6-d97b-4455-a123-0b85606285e4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.933873 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd725c66-d168-4c2b-9480-37e66a656e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.934485 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd725c66-d168-4c2b-9480-37e66a656e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.934859 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd725c66-d168-4c2b-9480-37e66a656e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.935181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd725c66-d168-4c2b-9480-37e66a656e05 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.935864 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd725c66-d168-4c2b-9480-37e66a656e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.937807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd725c66-d168-4c2b-9480-37e66a656e05 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.078995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 790/1585] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:49 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:50.080128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bb5f6-d97b-4455-a123-0b85606285e4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.100392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 796/1586] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:49 2022] POST /identity/v3/users => generated 286 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:50.101687 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db71f5a-c10e-462f-8eb3-808e12955fb9 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.101978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db71f5a-c10e-462f-8eb3-808e12955fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.102258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db71f5a-c10e-462f-8eb3-808e12955fb9 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.104440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 797/1587] 10.222.0.33 () {54 vars in 961 bytes} [Thu Jun 23 13:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:12:50.105170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db71f5a-c10e-462f-8eb3-808e12955fb9 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.117867 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db71f5a-c10e-462f-8eb3-808e12955fb9 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.122445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3526c0d-ef5d-4734-8a00-ff3969722650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.123151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3526c0d-ef5d-4734-8a00-ff3969722650 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.123440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3526c0d-ef5d-4734-8a00-ff3969722650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.123746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3526c0d-ef5d-4734-8a00-ff3969722650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.124470 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3526c0d-ef5d-4734-8a00-ff3969722650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.126103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3526c0d-ef5d-4734-8a00-ff3969722650 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.136250 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 798/1588] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:50.136848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3526c0d-ef5d-4734-8a00-ff3969722650 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.146454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3526c0d-ef5d-4734-8a00-ff3969722650 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.151746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d268b8-3934-427b-81cf-d1f447bf6546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.152382 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d268b8-3934-427b-81cf-d1f447bf6546 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.152698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d268b8-3934-427b-81cf-d1f447bf6546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.152975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d268b8-3934-427b-81cf-d1f447bf6546 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.153647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d268b8-3934-427b-81cf-d1f447bf6546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.155592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d268b8-3934-427b-81cf-d1f447bf6546 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.159898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bb5f6-d97b-4455-a123-0b85606285e4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.166165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77594637-bd9f-4908-8ece-2590b34929e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.166776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594637-bd9f-4908-8ece-2590b34929e9 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.167073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594637-bd9f-4908-8ece-2590b34929e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.167348 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594637-bd9f-4908-8ece-2590b34929e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.208489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:50.223546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77594637-bd9f-4908-8ece-2590b34929e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.225215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77594637-bd9f-4908-8ece-2590b34929e9 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.234976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 791/1589] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:50.235832 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77594637-bd9f-4908-8ece-2590b34929e9 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.245730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77594637-bd9f-4908-8ece-2590b34929e9 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.255902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12752c-6633-4a43-8fbe-c2f3b762e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.255902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12752c-6633-4a43-8fbe-c2f3b762e460 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.255902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12752c-6633-4a43-8fbe-c2f3b762e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.255902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12752c-6633-4a43-8fbe-c2f3b762e460 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.256349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12752c-6633-4a43-8fbe-c2f3b762e460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.256349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12752c-6633-4a43-8fbe-c2f3b762e460 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.322291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 799/1590] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:50 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:50.322291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d268b8-3934-427b-81cf-d1f447bf6546 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.330029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d268b8-3934-427b-81cf-d1f447bf6546 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.334565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a3c20-3b30-4996-a4c4-d0cd7c86f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.335396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a3c20-3b30-4996-a4c4-d0cd7c86f74b admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.335853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a3c20-3b30-4996-a4c4-d0cd7c86f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.337728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a3c20-3b30-4996-a4c4-d0cd7c86f74b admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.338430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a3c20-3b30-4996-a4c4-d0cd7c86f74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.340394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a3c20-3b30-4996-a4c4-d0cd7c86f74b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.373524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 792/1591] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:50 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:50.374342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12752c-6633-4a43-8fbe-c2f3b762e460 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.384272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12752c-6633-4a43-8fbe-c2f3b762e460 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.388819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a7799-0a23-4b73-a168-0e53d9430e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.389445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a7799-0a23-4b73-a168-0e53d9430e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.389726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a7799-0a23-4b73-a168-0e53d9430e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.390002 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a7799-0a23-4b73-a168-0e53d9430e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.390707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a7799-0a23-4b73-a168-0e53d9430e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.392321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a7799-0a23-4b73-a168-0e53d9430e35 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.403937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 793/1592] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:50.405136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a7799-0a23-4b73-a168-0e53d9430e35 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.415589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a7799-0a23-4b73-a168-0e53d9430e35 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.420201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748e3e8-a7dc-4707-91a9-e30c50719ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.420857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748e3e8-a7dc-4707-91a9-e30c50719ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.421147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748e3e8-a7dc-4707-91a9-e30c50719ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.421428 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748e3e8-a7dc-4707-91a9-e30c50719ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.422131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748e3e8-a7dc-4707-91a9-e30c50719ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.423785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748e3e8-a7dc-4707-91a9-e30c50719ba3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.434113 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 794/1593] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:50.435341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4339-1b08-472c-a369-3e349a96ffb8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.435634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4339-1b08-472c-a369-3e349a96ffb8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.435916 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4339-1b08-472c-a369-3e349a96ffb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.450058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 800/1594] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:50 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:50.451118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a3c20-3b30-4996-a4c4-d0cd7c86f74b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.458301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-27de4339-1b08-472c-a369-3e349a96ffb8 None None] MFA Rules not processed for user `5874e98df57242028c0f9983dee3b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:50.459767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-27de4339-1b08-472c-a369-3e349a96ffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:50.459911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:50.464855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a3c20-3b30-4996-a4c4-d0cd7c86f74b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.469742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d3c43-777b-40bc-9a37-c375a1d04901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.470402 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d3c43-777b-40bc-9a37-c375a1d04901 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.470887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d3c43-777b-40bc-9a37-c375a1d04901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.471192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d3c43-777b-40bc-9a37-c375a1d04901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.472038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 795/1595] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Jun 23 13:12:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:50.472181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d3c43-777b-40bc-9a37-c375a1d04901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.472762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de4339-1b08-472c-a369-3e349a96ffb8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.473622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d3c43-777b-40bc-9a37-c375a1d04901 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.483908 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 801/1596] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:50.484575 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de4339-1b08-472c-a369-3e349a96ffb8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.484751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d3c43-777b-40bc-9a37-c375a1d04901 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.491098 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951795b7-b3c1-44bd-90bc-62cc934f75b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.491763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951795b7-b3c1-44bd-90bc-62cc934f75b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.492166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951795b7-b3c1-44bd-90bc-62cc934f75b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.492454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951795b7-b3c1-44bd-90bc-62cc934f75b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.493240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951795b7-b3c1-44bd-90bc-62cc934f75b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.494943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951795b7-b3c1-44bd-90bc-62cc934f75b3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.499320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d3c43-777b-40bc-9a37-c375a1d04901 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.501100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebfa6c-b069-4545-97f2-2f88f6b1eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.501779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebfa6c-b069-4545-97f2-2f88f6b1eeaa admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.502073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebfa6c-b069-4545-97f2-2f88f6b1eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.502350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebfa6c-b069-4545-97f2-2f88f6b1eeaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.503067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebfa6c-b069-4545-97f2-2f88f6b1eeaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.504674 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebfa6c-b069-4545-97f2-2f88f6b1eeaa admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.508595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 796/1597] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:50.508595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951795b7-b3c1-44bd-90bc-62cc934f75b3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.518356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 802/1598] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:50.518356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebfa6c-b069-4545-97f2-2f88f6b1eeaa admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.519255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951795b7-b3c1-44bd-90bc-62cc934f75b3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.524422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846afb2b-86f5-4dbe-ba09-1bf791fd1bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.525647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846afb2b-86f5-4dbe-ba09-1bf791fd1bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.525931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846afb2b-86f5-4dbe-ba09-1bf791fd1bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.526209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846afb2b-86f5-4dbe-ba09-1bf791fd1bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.526926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846afb2b-86f5-4dbe-ba09-1bf791fd1bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.527311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebfa6c-b069-4545-97f2-2f88f6b1eeaa admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.528507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846afb2b-86f5-4dbe-ba09-1bf791fd1bd1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.532181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060fecd-dc81-4f9f-9fa5-1a8cf7ff5234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.533821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060fecd-dc81-4f9f-9fa5-1a8cf7ff5234 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.533821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060fecd-dc81-4f9f-9fa5-1a8cf7ff5234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.533821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060fecd-dc81-4f9f-9fa5-1a8cf7ff5234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.534268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060fecd-dc81-4f9f-9fa5-1a8cf7ff5234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.536019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060fecd-dc81-4f9f-9fa5-1a8cf7ff5234 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.539421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 797/1599] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:50.541640 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846afb2b-86f5-4dbe-ba09-1bf791fd1bd1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.546422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 803/1600] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:50.547558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b41d8-4130-44f6-94d1-134bbd8e4f34 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.547847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b41d8-4130-44f6-94d1-134bbd8e4f34 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.548522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b41d8-4130-44f6-94d1-134bbd8e4f34 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.549597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 804/1601] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jun 23 13:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:12:50.552265 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846afb2b-86f5-4dbe-ba09-1bf791fd1bd1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.553672 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b41d8-4130-44f6-94d1-134bbd8e4f34 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.557491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43468014-3ff8-4f29-9a2b-fdb1511566e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.559860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43468014-3ff8-4f29-9a2b-fdb1511566e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.559860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43468014-3ff8-4f29-9a2b-fdb1511566e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.559860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43468014-3ff8-4f29-9a2b-fdb1511566e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.559860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43468014-3ff8-4f29-9a2b-fdb1511566e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.561169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43468014-3ff8-4f29-9a2b-fdb1511566e8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.568638 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b41d8-4130-44f6-94d1-134bbd8e4f34 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.574799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 798/1602] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:50.574799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43468014-3ff8-4f29-9a2b-fdb1511566e8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.575016 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ef42a-1328-4c69-8212-653c26dd0dea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.575447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ef42a-1328-4c69-8212-653c26dd0dea service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.575732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ef42a-1328-4c69-8212-653c26dd0dea service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.576015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ef42a-1328-4c69-8212-653c26dd0dea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.583771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43468014-3ff8-4f29-9a2b-fdb1511566e8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.588572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171a287-f5c2-4428-8256-32bca2eb2402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.589453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171a287-f5c2-4428-8256-32bca2eb2402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.589733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171a287-f5c2-4428-8256-32bca2eb2402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.590006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171a287-f5c2-4428-8256-32bca2eb2402 admin admin] PATH_INFO: `/v3/projects/44241e4684c746209c0e0be8851fcd3e/users/852d5930824842d5a28160bcc54f5c71/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.604232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171a287-f5c2-4428-8256-32bca2eb2402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44241e4684c746209c0e0be8851fcd3e, user_id=852d5930824842d5a28160bcc54f5c71, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.606887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171a287-f5c2-4428-8256-32bca2eb2402 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.632590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ef42a-1328-4c69-8212-653c26dd0dea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.634984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ef42a-1328-4c69-8212-653c26dd0dea service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.644404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 805/1603] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:50.645228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ef42a-1328-4c69-8212-653c26dd0dea service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.654770 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ef42a-1328-4c69-8212-653c26dd0dea service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.659400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fdd9d-ea4e-4ec6-a767-18eb485726e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.660035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fdd9d-ea4e-4ec6-a767-18eb485726e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.660330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fdd9d-ea4e-4ec6-a767-18eb485726e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.660611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fdd9d-ea4e-4ec6-a767-18eb485726e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.665682 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fdd9d-ea4e-4ec6-a767-18eb485726e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.665682 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fdd9d-ea4e-4ec6-a767-18eb485726e3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.672981 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 806/1604] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:50.672981 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fdd9d-ea4e-4ec6-a767-18eb485726e3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.683367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fdd9d-ea4e-4ec6-a767-18eb485726e3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.688097 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5cc3a-7c51-4d90-9fa7-aabb9e7024fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.688959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5cc3a-7c51-4d90-9fa7-aabb9e7024fa admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.689256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5cc3a-7c51-4d90-9fa7-aabb9e7024fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.689515 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5cc3a-7c51-4d90-9fa7-aabb9e7024fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.690211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5cc3a-7c51-4d90-9fa7-aabb9e7024fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.691747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5cc3a-7c51-4d90-9fa7-aabb9e7024fa admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.700218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 799/1605] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:50 2022] PUT /identity/v3/projects/44241e4684c746209c0e0be8851fcd3e/users/852d5930824842d5a28160bcc54f5c71/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:50.700218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171a287-f5c2-4428-8256-32bca2eb2402 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.710778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 807/1606] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:50.710778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5cc3a-7c51-4d90-9fa7-aabb9e7024fa admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.720868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5cc3a-7c51-4d90-9fa7-aabb9e7024fa admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.777062 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171a287-f5c2-4428-8256-32bca2eb2402 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.782928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26ad8b-15da-4c0b-9571-1e5c05fb4346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.783193 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87c700-3609-40a7-8a07-dfea73f2a02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.783983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26ad8b-15da-4c0b-9571-1e5c05fb4346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.784246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87c700-3609-40a7-8a07-dfea73f2a02d admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.784349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26ad8b-15da-4c0b-9571-1e5c05fb4346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.784675 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87c700-3609-40a7-8a07-dfea73f2a02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.784820 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26ad8b-15da-4c0b-9571-1e5c05fb4346 admin admin] PATH_INFO: `/v3/projects/5b8bf9b5dc74423c9c9f7792dbc60bed/users/7d740fb903c24d8f851fe03e05cb8afa/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.785089 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87c700-3609-40a7-8a07-dfea73f2a02d admin admin] PATH_INFO: `/v3/projects/b5599970680b46b5aa8d539faa8bc1d0/users/6aef4fdb47e8427fb06a15d6c69317e8/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.801090 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26ad8b-15da-4c0b-9571-1e5c05fb4346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8bf9b5dc74423c9c9f7792dbc60bed, user_id=7d740fb903c24d8f851fe03e05cb8afa, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.801782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87c700-3609-40a7-8a07-dfea73f2a02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5599970680b46b5aa8d539faa8bc1d0, user_id=6aef4fdb47e8427fb06a15d6c69317e8, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.803881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26ad8b-15da-4c0b-9571-1e5c05fb4346 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.804595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87c700-3609-40a7-8a07-dfea73f2a02d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.878155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 800/1607] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:50 2022] PUT /identity/v3/projects/5b8bf9b5dc74423c9c9f7792dbc60bed/users/7d740fb903c24d8f851fe03e05cb8afa/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:50.879423 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3932b6-a557-4e73-be54-314d9a09739b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.885215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3932b6-a557-4e73-be54-314d9a09739b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.885215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3932b6-a557-4e73-be54-314d9a09739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.887525 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:50.898125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-2a3932b6-a557-4e73-be54-314d9a09739b None None] MFA Rules not processed for user `5874e98df57242028c0f9983dee3b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:50.899389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2a3932b6-a557-4e73-be54-314d9a09739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:50.913400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 808/1608] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:50 2022] PUT /identity/v3/projects/b5599970680b46b5aa8d539faa8bc1d0/users/6aef4fdb47e8427fb06a15d6c69317e8/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:50.914353 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87c700-3609-40a7-8a07-dfea73f2a02d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.947181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:50.974557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87c700-3609-40a7-8a07-dfea73f2a02d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.975960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 801/1609] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:12:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:50.976887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3932b6-a557-4e73-be54-314d9a09739b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.979956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf2088-1358-4771-804f-8c0d1c57bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.980630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2088-1358-4771-804f-8c0d1c57bd5c admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.987164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2088-1358-4771-804f-8c0d1c57bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.987164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2088-1358-4771-804f-8c0d1c57bd5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.987164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf2088-1358-4771-804f-8c0d1c57bd5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.987164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf2088-1358-4771-804f-8c0d1c57bd5c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:50.994638 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 809/1610] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:50.995888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46530515-a81a-46ce-8c35-f946b882f35a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.996177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46530515-a81a-46ce-8c35-f946b882f35a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.996459 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46530515-a81a-46ce-8c35-f946b882f35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.014367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-46530515-a81a-46ce-8c35-f946b882f35a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:51.015714 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-46530515-a81a-46ce-8c35-f946b882f35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.023864 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 810/1611] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:51.024599 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46530515-a81a-46ce-8c35-f946b882f35a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.034804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46530515-a81a-46ce-8c35-f946b882f35a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.039362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d94148-de88-4768-b6fa-748cdc45a9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.040768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d94148-de88-4768-b6fa-748cdc45a9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.041054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d94148-de88-4768-b6fa-748cdc45a9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.041342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d94148-de88-4768-b6fa-748cdc45a9b9 admin admin] PATH_INFO: `/v3/projects/2d0656b9a93b4efb8a60496b7337f6f0/users/f2b71ad35f044169a58eb6b8aab031b8/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.045790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3932b6-a557-4e73-be54-314d9a09739b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.050557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e33fea-f80f-4ea9-8ca0-f98b08cd44d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.051438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e33fea-f80f-4ea9-8ca0-f98b08cd44d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.051721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e33fea-f80f-4ea9-8ca0-f98b08cd44d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.051996 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e33fea-f80f-4ea9-8ca0-f98b08cd44d1 admin admin] PATH_INFO: `/v3/projects/faf58b45b4ab4a2cbcc272527dbbdb75/users/b8430c50c6be41f1b52b7787b9b90b45/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.056956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d94148-de88-4768-b6fa-748cdc45a9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0656b9a93b4efb8a60496b7337f6f0, user_id=f2b71ad35f044169a58eb6b8aab031b8, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.059591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d94148-de88-4768-b6fa-748cdc45a9b9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.067080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e33fea-f80f-4ea9-8ca0-f98b08cd44d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf58b45b4ab4a2cbcc272527dbbdb75, user_id=b8430c50c6be41f1b52b7787b9b90b45, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.069773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e33fea-f80f-4ea9-8ca0-f98b08cd44d1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.175403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 811/1612] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:51 2022] PUT /identity/v3/projects/2d0656b9a93b4efb8a60496b7337f6f0/users/f2b71ad35f044169a58eb6b8aab031b8/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:51.176736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a71a-e23f-4383-a9f8-c2f797098ec0 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.177021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a71a-e23f-4383-a9f8-c2f797098ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.177295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a71a-e23f-4383-a9f8-c2f797098ec0 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.178553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 812/1613] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jun 23 13:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:12:51.179581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd93484-15ff-46ee-a35f-06c2f6eacb91 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.179862 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd93484-15ff-46ee-a35f-06c2f6eacb91 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.180130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd93484-15ff-46ee-a35f-06c2f6eacb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.198204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4fd93484-15ff-46ee-a35f-06c2f6eacb91 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:51.199397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4fd93484-15ff-46ee-a35f-06c2f6eacb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.202352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 802/1614] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:50 2022] PUT /identity/v3/projects/faf58b45b4ab4a2cbcc272527dbbdb75/users/b8430c50c6be41f1b52b7787b9b90b45/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:51.203740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0f28-18a4-41f4-bf30-3697301e2d28 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.204024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0f28-18a4-41f4-bf30-3697301e2d28 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.204300 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0f28-18a4-41f4-bf30-3697301e2d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.232612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f68d0f28-18a4-41f4-bf30-3697301e2d28 None None] MFA Rules not processed for user `6aef4fdb47e8427fb06a15d6c69317e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:51.233774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f68d0f28-18a4-41f4-bf30-3697301e2d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.269405 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 813/1615] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:51.270250 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd93484-15ff-46ee-a35f-06c2f6eacb91 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.304211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 803/1616] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:51.305056 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0f28-18a4-41f4-bf30-3697301e2d28 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.315104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0f28-18a4-41f4-bf30-3697301e2d28 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.319546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df95085-0602-49aa-a993-1cb90816111c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.320443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df95085-0602-49aa-a993-1cb90816111c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.320757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df95085-0602-49aa-a993-1cb90816111c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.321034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df95085-0602-49aa-a993-1cb90816111c admin admin] PATH_INFO: `/v3/projects/e30048e6dd464482a72ca7cea538e9c7/users/2694401e38424109bce306728953c986/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.323829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd93484-15ff-46ee-a35f-06c2f6eacb91 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.325338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:51.327499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74087bb5-689b-441f-ae4e-6fd0a88005a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.328141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74087bb5-689b-441f-ae4e-6fd0a88005a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.328423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74087bb5-689b-441f-ae4e-6fd0a88005a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.328737 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74087bb5-689b-441f-ae4e-6fd0a88005a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.336403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df95085-0602-49aa-a993-1cb90816111c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e30048e6dd464482a72ca7cea538e9c7, user_id=2694401e38424109bce306728953c986, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.339129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df95085-0602-49aa-a993-1cb90816111c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.375253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:51.394918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74087bb5-689b-441f-ae4e-6fd0a88005a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.396340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74087bb5-689b-441f-ae4e-6fd0a88005a0 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.406927 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 814/1617] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:51.407784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74087bb5-689b-441f-ae4e-6fd0a88005a0 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.409175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-74087bb5-689b-441f-ae4e-6fd0a88005a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.427817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 804/1618] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:51 2022] PUT /identity/v3/projects/e30048e6dd464482a72ca7cea538e9c7/users/2694401e38424109bce306728953c986/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:51.431298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec5f97-e2c4-4c3c-9d5a-f911fc26740a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.431694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec5f97-e2c4-4c3c-9d5a-f911fc26740a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.432077 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec5f97-e2c4-4c3c-9d5a-f911fc26740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.451715 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a2ec5f97-e2c4-4c3c-9d5a-f911fc26740a None None] MFA Rules not processed for user `5874e98df57242028c0f9983dee3b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:51.452908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a2ec5f97-e2c4-4c3c-9d5a-f911fc26740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.465972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74087bb5-689b-441f-ae4e-6fd0a88005a0 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.518926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf2aca-36e5-4d92-a521-66aff038eeb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.519935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2aca-36e5-4d92-a521-66aff038eeb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.520226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2aca-36e5-4d92-a521-66aff038eeb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.520507 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2aca-36e5-4d92-a521-66aff038eeb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.532378 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 805/1619] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:51.533551 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83793e91-7bf9-4888-8981-440f1a6c666b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.533842 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83793e91-7bf9-4888-8981-440f1a6c666b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.534123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83793e91-7bf9-4888-8981-440f1a6c666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.562905 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-83793e91-7bf9-4888-8981-440f1a6c666b None None] MFA Rules not processed for user `f2b71ad35f044169a58eb6b8aab031b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:51.564688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-83793e91-7bf9-4888-8981-440f1a6c666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.595692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf2aca-36e5-4d92-a521-66aff038eeb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.597344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf2aca-36e5-4d92-a521-66aff038eeb4 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.609601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 815/1620] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:51.610766 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a9bf-87c9-4668-b5ec-f3f440018dc6 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.611341 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a9bf-87c9-4668-b5ec-f3f440018dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.611656 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a9bf-87c9-4668-b5ec-f3f440018dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.641174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 806/1621] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:51.646599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83793e91-7bf9-4888-8981-440f1a6c666b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.647311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2551a9bf-87c9-4668-b5ec-f3f440018dc6 None None] MFA Rules not processed for user `b8430c50c6be41f1b52b7787b9b90b45`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:51.649170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2551a9bf-87c9-4668-b5ec-f3f440018dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.653012 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83793e91-7bf9-4888-8981-440f1a6c666b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.657260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ab63d-ce61-4fc7-8cf9-8344be13f397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.657973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ab63d-ce61-4fc7-8cf9-8344be13f397 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.658397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ab63d-ce61-4fc7-8cf9-8344be13f397 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.658675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ab63d-ce61-4fc7-8cf9-8344be13f397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.668981 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ab63d-ce61-4fc7-8cf9-8344be13f397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.670468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ab63d-ce61-4fc7-8cf9-8344be13f397 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.681312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 807/1622] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:51.682171 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ab63d-ce61-4fc7-8cf9-8344be13f397 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.690882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:51.691475 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ab63d-ce61-4fc7-8cf9-8344be13f397 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.697623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30243054-71f9-44cd-93ed-70ad31a39717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.704137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30243054-71f9-44cd-93ed-70ad31a39717 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.704137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30243054-71f9-44cd-93ed-70ad31a39717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.704137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30243054-71f9-44cd-93ed-70ad31a39717 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.704137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30243054-71f9-44cd-93ed-70ad31a39717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.704137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30243054-71f9-44cd-93ed-70ad31a39717 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.726020 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 816/1623] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:51.727296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2280c-45fe-4e1a-8649-a00dbd7129ab None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.728117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2280c-45fe-4e1a-8649-a00dbd7129ab None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.728391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2280c-45fe-4e1a-8649-a00dbd7129ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.745719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d6f2280c-45fe-4e1a-8649-a00dbd7129ab None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:51.746830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d6f2280c-45fe-4e1a-8649-a00dbd7129ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.754384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 817/1624] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:51.755132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2280c-45fe-4e1a-8649-a00dbd7129ab None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.814215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2280c-45fe-4e1a-8649-a00dbd7129ab None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.818335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79b2a-6118-429b-93ec-bce292d267b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.819100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79b2a-6118-429b-93ec-bce292d267b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.819387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79b2a-6118-429b-93ec-bce292d267b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.819661 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79b2a-6118-429b-93ec-bce292d267b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.830110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e79b2a-6118-429b-93ec-bce292d267b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.831538 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e79b2a-6118-429b-93ec-bce292d267b4 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.842414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 818/1625] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:51.843007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79b2a-6118-429b-93ec-bce292d267b4 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.851350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79b2a-6118-429b-93ec-bce292d267b4 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.855646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4862ff-c76e-403c-ab82-236e9a7bdfc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.856329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4862ff-c76e-403c-ab82-236e9a7bdfc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.856610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4862ff-c76e-403c-ab82-236e9a7bdfc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.856918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4862ff-c76e-403c-ab82-236e9a7bdfc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.866503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4862ff-c76e-403c-ab82-236e9a7bdfc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.867934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4862ff-c76e-403c-ab82-236e9a7bdfc9 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.878405 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 819/1626] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:51.914741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 808/1627] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:51.919321 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4862ff-c76e-403c-ab82-236e9a7bdfc9 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.929163 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4862ff-c76e-403c-ab82-236e9a7bdfc9 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:52.055824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d2101-7175-4221-a671-6b6fcfd9f03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:52.055824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2101-7175-4221-a671-6b6fcfd9f03c admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.055824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2101-7175-4221-a671-6b6fcfd9f03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.055824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2101-7175-4221-a671-6b6fcfd9f03c admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.065173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d2101-7175-4221-a671-6b6fcfd9f03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:52.065173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d2101-7175-4221-a671-6b6fcfd9f03c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:52.206628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 820/1628] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:52.206758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30243054-71f9-44cd-93ed-70ad31a39717 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:52.215237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30243054-71f9-44cd-93ed-70ad31a39717 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:52.220441 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e167e-57be-48b1-8fb7-a8f99c6a6f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:52.221273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e167e-57be-48b1-8fb7-a8f99c6a6f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.221588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e167e-57be-48b1-8fb7-a8f99c6a6f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.221985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e167e-57be-48b1-8fb7-a8f99c6a6f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.222725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e167e-57be-48b1-8fb7-a8f99c6a6f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:52.224399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e167e-57be-48b1-8fb7-a8f99c6a6f4b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:52.236082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 809/1629] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:12:52.240280 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d2101-7175-4221-a671-6b6fcfd9f03c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:52.250840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d2101-7175-4221-a671-6b6fcfd9f03c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:52.255546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3abf0a-7792-45f5-addd-234264bc9756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:52.256435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3abf0a-7792-45f5-addd-234264bc9756 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.256754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3abf0a-7792-45f5-addd-234264bc9756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.257038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3abf0a-7792-45f5-addd-234264bc9756 admin admin] PATH_INFO: `/v3/projects/74667386cd8544c0a0ea7d8801b6d4a9/users/8bfc9d395abb4bd48c647627f56bf16a/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.271990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3abf0a-7792-45f5-addd-234264bc9756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74667386cd8544c0a0ea7d8801b6d4a9, user_id=8bfc9d395abb4bd48c647627f56bf16a, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:52.275189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3abf0a-7792-45f5-addd-234264bc9756 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:52.423880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 821/1630] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:52 2022] PUT /identity/v3/projects/74667386cd8544c0a0ea7d8801b6d4a9/users/8bfc9d395abb4bd48c647627f56bf16a/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:52.427914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e167e-57be-48b1-8fb7-a8f99c6a6f4b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:52.439605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e167e-57be-48b1-8fb7-a8f99c6a6f4b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:52.485979 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:52.516623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3abf0a-7792-45f5-addd-234264bc9756 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:52.545067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc5d4b-fd49-49d3-810d-c238214da7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:52.545780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc5d4b-fd49-49d3-810d-c238214da7db admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.546034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc5d4b-fd49-49d3-810d-c238214da7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.546304 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc5d4b-fd49-49d3-810d-c238214da7db admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.547024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc5d4b-fd49-49d3-810d-c238214da7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:52.548645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc5d4b-fd49-49d3-810d-c238214da7db admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:52.552693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:52.559897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 810/1631] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:52.563954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc5d4b-fd49-49d3-810d-c238214da7db admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:52.579901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc5d4b-fd49-49d3-810d-c238214da7db admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:52.591076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3abf0a-7792-45f5-addd-234264bc9756 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:52.593466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91052af5-9b5d-4489-a8c4-7475de5de027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:52.594387 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91052af5-9b5d-4489-a8c4-7475de5de027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.594673 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91052af5-9b5d-4489-a8c4-7475de5de027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.594992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91052af5-9b5d-4489-a8c4-7475de5de027 admin admin] PATH_INFO: `/v3/projects/74667386cd8544c0a0ea7d8801b6d4a9/users/8bfc9d395abb4bd48c647627f56bf16a/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.597149 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91052af5-9b5d-4489-a8c4-7475de5de027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74667386cd8544c0a0ea7d8801b6d4a9, user_id=8bfc9d395abb4bd48c647627f56bf16a, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:52.597623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9a038-5e99-4937-84fd-45f2c6626f19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:52.598570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9a038-5e99-4937-84fd-45f2c6626f19 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.599085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9a038-5e99-4937-84fd-45f2c6626f19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.599553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9a038-5e99-4937-84fd-45f2c6626f19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.600049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91052af5-9b5d-4489-a8c4-7475de5de027 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:52.613187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 811/1632] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:52 2022] PUT /identity/v3/projects/74667386cd8544c0a0ea7d8801b6d4a9/users/8bfc9d395abb4bd48c647627f56bf16a/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:52.626120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964c2ac-c2ae-4307-a5e2-7b83d5ba2dda None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.626417 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964c2ac-c2ae-4307-a5e2-7b83d5ba2dda None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.626696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964c2ac-c2ae-4307-a5e2-7b83d5ba2dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.664155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-2964c2ac-c2ae-4307-a5e2-7b83d5ba2dda None None] MFA Rules not processed for user `8bfc9d395abb4bd48c647627f56bf16a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:52.666607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2964c2ac-c2ae-4307-a5e2-7b83d5ba2dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:52.673051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9a038-5e99-4937-84fd-45f2c6626f19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:52.674514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9a038-5e99-4937-84fd-45f2c6626f19 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:52.698283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 822/1633] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:52.819257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 812/1634] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:53.033103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9a038-5e99-4937-84fd-45f2c6626f19 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:53.040544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964c2ac-c2ae-4307-a5e2-7b83d5ba2dda None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:53.141230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9a038-5e99-4937-84fd-45f2c6626f19 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:53.175331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964c2ac-c2ae-4307-a5e2-7b83d5ba2dda None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:53.179582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d68c-ca39-4075-8b03-111d3c5a96fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:53.180487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d68c-ca39-4075-8b03-111d3c5a96fe service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:53.184874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d68c-ca39-4075-8b03-111d3c5a96fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:53.185387 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d68c-ca39-4075-8b03-111d3c5a96fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:53.205269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277d68c-ca39-4075-8b03-111d3c5a96fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:53.207777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277d68c-ca39-4075-8b03-111d3c5a96fe service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:53.219965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15822dd8-50a9-4ccd-a01c-af57532f1a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:53.220751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15822dd8-50a9-4ccd-a01c-af57532f1a1e service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:53.221349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15822dd8-50a9-4ccd-a01c-af57532f1a1e service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:53.221349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15822dd8-50a9-4ccd-a01c-af57532f1a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:53.224293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 813/1635] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:53.285871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15822dd8-50a9-4ccd-a01c-af57532f1a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:53.287536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15822dd8-50a9-4ccd-a01c-af57532f1a1e service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:53.297102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 823/1636] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:53.385768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:53.801740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d68c-ca39-4075-8b03-111d3c5a96fe service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:53.846509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:53.887611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d68c-ca39-4075-8b03-111d3c5a96fe service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:53.896925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:53.897895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:53.898288 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:53.898645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] PATH_INFO: `/v3/users/b8430c50c6be41f1b52b7787b9b90b45` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:53.900014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8430c50c6be41f1b52b7787b9b90b45)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:53.902137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:54.210344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8430c50c6be41f1b52b7787b9b90b45'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:54.211315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8430c50c6be41f1b52b7787b9b90b45'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:54.211980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8430c50c6be41f1b52b7787b9b90b45'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:54.228884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8430c50c6be41f1b52b7787b9b90b45'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:54.239978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8430c50c6be41f1b52b7787b9b90b45'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:54.606263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 814/1637] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:53 2022] DELETE /identity/v3/users/b8430c50c6be41f1b52b7787b9b90b45 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:54.608318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2700a4-b301-4c21-9fa5-6bd135222f6f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:54.608318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2700a4-b301-4c21-9fa5-6bd135222f6f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:54.608318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2700a4-b301-4c21-9fa5-6bd135222f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:54.608318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ad2700a4-b301-4c21-9fa5-6bd135222f6f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:54.608318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ad2700a4-b301-4c21-9fa5-6bd135222f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:54.608318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 824/1638] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:54.653347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:54.653347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:54.739193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07995779-4af4-4c89-bd1e-eb85e99dd10b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:54.743856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eed99-8859-4eda-b971-4e518009bccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:54.744738 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eed99-8859-4eda-b971-4e518009bccd service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:54.745192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eed99-8859-4eda-b971-4e518009bccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:54.745539 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eed99-8859-4eda-b971-4e518009bccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:54.756537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eed99-8859-4eda-b971-4e518009bccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:54.758227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eed99-8859-4eda-b971-4e518009bccd service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:54.769732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 815/1639] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:55.373036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2700a4-b301-4c21-9fa5-6bd135222f6f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:55.374504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ad2700a4-b301-4c21-9fa5-6bd135222f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:55.387445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2700a4-b301-4c21-9fa5-6bd135222f6f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:55.392306 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8db02-af6e-40ef-9db4-eb413cf284b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:55.393363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8db02-af6e-40ef-9db4-eb413cf284b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:55.393652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8db02-af6e-40ef-9db4-eb413cf284b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:55.393930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8db02-af6e-40ef-9db4-eb413cf284b0 admin admin] PATH_INFO: `/v3/users/6aef4fdb47e8427fb06a15d6c69317e8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:55.395223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8db02-af6e-40ef-9db4-eb413cf284b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aef4fdb47e8427fb06a15d6c69317e8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:55.396256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: WARNING py.warnings [None req-8bb8db02-af6e-40ef-9db4-eb413cf284b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:12:55.396256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: warnings.warn(msg) Jun 23 13:12:55.396256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: Jun 23 13:12:55.397536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8db02-af6e-40ef-9db4-eb413cf284b0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:55.770036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8bb8db02-af6e-40ef-9db4-eb413cf284b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aef4fdb47e8427fb06a15d6c69317e8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:55.770726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8bb8db02-af6e-40ef-9db4-eb413cf284b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aef4fdb47e8427fb06a15d6c69317e8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:55.771080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eed99-8859-4eda-b971-4e518009bccd service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:55.773202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1f5eed99-8859-4eda-b971-4e518009bccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:55.792496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eed99-8859-4eda-b971-4e518009bccd service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:55.818135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:55.819415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:55.819714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:55.822831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] PATH_INFO: `/v3/projects/faf58b45b4ab4a2cbcc272527dbbdb75` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:55.829820 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf58b45b4ab4a2cbcc272527dbbdb75)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:55.831730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: WARNING py.warnings [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:12:55.831730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: warnings.warn(msg) Jun 23 13:12:55.831730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: Jun 23 13:12:55.841996 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:55.874720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8bb8db02-af6e-40ef-9db4-eb413cf284b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aef4fdb47e8427fb06a15d6c69317e8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:55.931664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8bb8db02-af6e-40ef-9db4-eb413cf284b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aef4fdb47e8427fb06a15d6c69317e8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:55.976341 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8bb8db02-af6e-40ef-9db4-eb413cf284b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aef4fdb47e8427fb06a15d6c69317e8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:55.997996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 825/1640] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:55 2022] DELETE /identity/v3/users/6aef4fdb47e8427fb06a15d6c69317e8 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:56.003055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648fd13-ffb0-48c6-8c8f-fefa207a38c8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:56.019418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648fd13-ffb0-48c6-8c8f-fefa207a38c8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:56.019667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648fd13-ffb0-48c6-8c8f-fefa207a38c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:56.074497 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3648fd13-ffb0-48c6-8c8f-fefa207a38c8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:56.079920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3648fd13-ffb0-48c6-8c8f-fefa207a38c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:56.123399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:56.171272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:56.179792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf58b45b4ab4a2cbcc272527dbbdb75', 'request_id': 'req-3b3bc718-7e0f-4755-8089-7cd8a929802b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:56.300920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 826/1641] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:56.328107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf58b45b4ab4a2cbcc272527dbbdb75', 'request_id': 'req-3b3bc718-7e0f-4755-8089-7cd8a929802b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:56.358421 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648fd13-ffb0-48c6-8c8f-fefa207a38c8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:56.360125 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3648fd13-ffb0-48c6-8c8f-fefa207a38c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:56.371603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf58b45b4ab4a2cbcc272527dbbdb75', 'request_id': 'req-3b3bc718-7e0f-4755-8089-7cd8a929802b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:56.389864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] The token cache is being invalidate because project faf58b45b4ab4a2cbcc272527dbbdb75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:56.390162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:56.401169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3b3bc718-7e0f-4755-8089-7cd8a929802b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:56.403258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 816/1642] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:55 2022] DELETE /identity/v3/projects/faf58b45b4ab4a2cbcc272527dbbdb75 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:56.407822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da2e23-8138-4b1a-b7e5-4954f1628c01 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:56.408123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da2e23-8138-4b1a-b7e5-4954f1628c01 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:56.410378 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da2e23-8138-4b1a-b7e5-4954f1628c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:56.446781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-99da2e23-8138-4b1a-b7e5-4954f1628c01 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:56.451893 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-99da2e23-8138-4b1a-b7e5-4954f1628c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:56.456953 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648fd13-ffb0-48c6-8c8f-fefa207a38c8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:56.570360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891b0d9-86a5-40c7-b563-484cf698a032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:56.571717 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891b0d9-86a5-40c7-b563-484cf698a032 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:56.572001 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891b0d9-86a5-40c7-b563-484cf698a032 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:56.572281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891b0d9-86a5-40c7-b563-484cf698a032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:56.602709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5891b0d9-86a5-40c7-b563-484cf698a032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:56.618881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 817/1643] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:56.627299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98d156-1365-4423-8c6a-9540b6272c38 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:56.627957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98d156-1365-4423-8c6a-9540b6272c38 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:56.628649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98d156-1365-4423-8c6a-9540b6272c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:56.663881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891b0d9-86a5-40c7-b563-484cf698a032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:56.667825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891b0d9-86a5-40c7-b563-484cf698a032 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:56.675835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3c98d156-1365-4423-8c6a-9540b6272c38 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:56.678005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3c98d156-1365-4423-8c6a-9540b6272c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:56.688198 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 827/1644] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:56.713978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 818/1645] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:56.716883 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891b0d9-86a5-40c7-b563-484cf698a032 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:56.734384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891b0d9-86a5-40c7-b563-484cf698a032 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:56.748027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887d5c5-7a97-40c8-a92b-eacbc857e008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:56.748828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887d5c5-7a97-40c8-a92b-eacbc857e008 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:56.749159 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887d5c5-7a97-40c8-a92b-eacbc857e008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:56.749393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887d5c5-7a97-40c8-a92b-eacbc857e008 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:56.750102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887d5c5-7a97-40c8-a92b-eacbc857e008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:56.750416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887d5c5-7a97-40c8-a92b-eacbc857e008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:56.752033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887d5c5-7a97-40c8-a92b-eacbc857e008 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:56.773898 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 828/1646] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:56.789109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98d156-1365-4423-8c6a-9540b6272c38 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:56.802138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98d156-1365-4423-8c6a-9540b6272c38 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:56.808144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ec930-d129-45e6-b3a9-9c25dc69e14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:56.809943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ec930-d129-45e6-b3a9-9c25dc69e14c admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:56.810419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ec930-d129-45e6-b3a9-9c25dc69e14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:56.810693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ec930-d129-45e6-b3a9-9c25dc69e14c admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:56.811955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ec930-d129-45e6-b3a9-9c25dc69e14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:56.814129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ec930-d129-45e6-b3a9-9c25dc69e14c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:56.945148 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 819/1647] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:56 2022] POST /identity/v3/projects => generated 393 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:56.949243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887d5c5-7a97-40c8-a92b-eacbc857e008 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:56.962017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887d5c5-7a97-40c8-a92b-eacbc857e008 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:57.045958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e8590-3d27-4fcc-bdc5-8d8065068b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:57.046942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e8590-3d27-4fcc-bdc5-8d8065068b7e admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:57.047333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e8590-3d27-4fcc-bdc5-8d8065068b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:57.047715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e8590-3d27-4fcc-bdc5-8d8065068b7e admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:57.048998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e8590-3d27-4fcc-bdc5-8d8065068b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:57.051350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e8590-3d27-4fcc-bdc5-8d8065068b7e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:57.194138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 829/1648] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:56 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:57.197741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ec930-d129-45e6-b3a9-9c25dc69e14c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:57.211933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ec930-d129-45e6-b3a9-9c25dc69e14c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:57.218708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fed290-9df9-45cd-91a0-042a1cae5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:57.219735 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fed290-9df9-45cd-91a0-042a1cae5289 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:57.220214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fed290-9df9-45cd-91a0-042a1cae5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:57.220767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fed290-9df9-45cd-91a0-042a1cae5289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:57.232818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fed290-9df9-45cd-91a0-042a1cae5289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:57.232818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fed290-9df9-45cd-91a0-042a1cae5289 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:57.251547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 820/1649] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:57.252758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e8590-3d27-4fcc-bdc5-8d8065068b7e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:57.266515 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e8590-3d27-4fcc-bdc5-8d8065068b7e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:57.272526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a1bdd-4127-4b70-84ba-71747fc5e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:57.273565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a1bdd-4127-4b70-84ba-71747fc5e142 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:57.273931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a1bdd-4127-4b70-84ba-71747fc5e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:57.274221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a1bdd-4127-4b70-84ba-71747fc5e142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:57.274970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a1bdd-4127-4b70-84ba-71747fc5e142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:57.277852 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a1bdd-4127-4b70-84ba-71747fc5e142 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:57.296782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 830/1650] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:57.300018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fed290-9df9-45cd-91a0-042a1cae5289 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:57.312412 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fed290-9df9-45cd-91a0-042a1cae5289 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:57.318116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9833051-5566-43fa-8e2a-0f65b32030a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:57.319461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9833051-5566-43fa-8e2a-0f65b32030a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:57.320744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9833051-5566-43fa-8e2a-0f65b32030a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:57.325572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9833051-5566-43fa-8e2a-0f65b32030a1 admin admin] PATH_INFO: `/v3/projects/6029b95f0ef2499792f5ee726b91372e/users/f910fc790a2741a99ceb3dc6debc0981/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:57.351992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9833051-5566-43fa-8e2a-0f65b32030a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6029b95f0ef2499792f5ee726b91372e, user_id=f910fc790a2741a99ceb3dc6debc0981, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:57.355635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9833051-5566-43fa-8e2a-0f65b32030a1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:57.450876 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 821/1651] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:57 2022] PUT /identity/v3/projects/6029b95f0ef2499792f5ee726b91372e/users/f910fc790a2741a99ceb3dc6debc0981/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:57.460601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126cc5a-5dff-4938-a061-eb740f8e905f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:57.461002 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126cc5a-5dff-4938-a061-eb740f8e905f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:57.461387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126cc5a-5dff-4938-a061-eb740f8e905f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:57.506435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9126cc5a-5dff-4938-a061-eb740f8e905f None None] MFA Rules not processed for user `f910fc790a2741a99ceb3dc6debc0981`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:57.508082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9126cc5a-5dff-4938-a061-eb740f8e905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:57.657904 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 831/1652] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:57.658968 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9833051-5566-43fa-8e2a-0f65b32030a1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:57.826994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9833051-5566-43fa-8e2a-0f65b32030a1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:57.834678 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d179f-4843-4bab-a72f-89c5c8b5c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:57.835592 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d179f-4843-4bab-a72f-89c5c8b5c321 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:57.836085 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d179f-4843-4bab-a72f-89c5c8b5c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:57.837953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d179f-4843-4bab-a72f-89c5c8b5c321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:57.850322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d179f-4843-4bab-a72f-89c5c8b5c321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:57.850322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d179f-4843-4bab-a72f-89c5c8b5c321 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:58.015281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126cc5a-5dff-4938-a061-eb740f8e905f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:58.016928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9126cc5a-5dff-4938-a061-eb740f8e905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:58.029750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 822/1653] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:57 2022] POST /identity/v3/projects => generated 391 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:58.031058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d179f-4843-4bab-a72f-89c5c8b5c321 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:58.068958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126cc5a-5dff-4938-a061-eb740f8e905f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:58.232297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d179f-4843-4bab-a72f-89c5c8b5c321 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:58.240555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:58.241683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:58.243883 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:58.244277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] PATH_INFO: `/v3/projects/b5599970680b46b5aa8d539faa8bc1d0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:58.247474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5599970680b46b5aa8d539faa8bc1d0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:58.249976 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:58.253501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb06b6-d1ac-43b6-a7d5-0edcf020c181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:58.254256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb06b6-d1ac-43b6-a7d5-0edcf020c181 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:58.254598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb06b6-d1ac-43b6-a7d5-0edcf020c181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:58.258640 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb06b6-d1ac-43b6-a7d5-0edcf020c181 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:58.258640 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb06b6-d1ac-43b6-a7d5-0edcf020c181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:58.258640 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb06b6-d1ac-43b6-a7d5-0edcf020c181 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:58.358786 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 823/1654] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:58 2022] POST /identity/v3/users => generated 302 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:58.359767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb06b6-d1ac-43b6-a7d5-0edcf020c181 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:58.382495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb06b6-d1ac-43b6-a7d5-0edcf020c181 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:58.421367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5599970680b46b5aa8d539faa8bc1d0', 'request_id': 'req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:58.425634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bc4c7-9eac-4fab-9723-851dd900f369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:58.426494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bc4c7-9eac-4fab-9723-851dd900f369 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:58.426929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bc4c7-9eac-4fab-9723-851dd900f369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:58.427352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bc4c7-9eac-4fab-9723-851dd900f369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:58.432795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bc4c7-9eac-4fab-9723-851dd900f369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:58.432909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5599970680b46b5aa8d539faa8bc1d0', 'request_id': 'req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:58.432982 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bc4c7-9eac-4fab-9723-851dd900f369 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:58.447722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5599970680b46b5aa8d539faa8bc1d0', 'request_id': 'req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:58.474068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 824/1655] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:58.474995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bc4c7-9eac-4fab-9723-851dd900f369 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:58.490914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bc4c7-9eac-4fab-9723-851dd900f369 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:58.499565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:58.588041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] The token cache is being invalidate because project b5599970680b46b5aa8d539faa8bc1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:58.588399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:58.589136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:58.591748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 832/1656] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:58 2022] DELETE /identity/v3/projects/b5599970680b46b5aa8d539faa8bc1d0 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:58.594868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:58.601649 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:58.616836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:58.629742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cda50-7906-4c67-9453-bc90b9363e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:58.631808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cda50-7906-4c67-9453-bc90b9363e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:58.632267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cda50-7906-4c67-9453-bc90b9363e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:58.633665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cda50-7906-4c67-9453-bc90b9363e1c admin admin] PATH_INFO: `/v3/projects/ea0a014cec71409083995eae5794e9ba/users/5724e189cd504fd5b76ec3569f5d37e3/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:58.665872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cda50-7906-4c67-9453-bc90b9363e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0a014cec71409083995eae5794e9ba, user_id=5724e189cd504fd5b76ec3569f5d37e3, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:58.681729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cda50-7906-4c67-9453-bc90b9363e1c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:58.774998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dbfd5-570b-49be-9f80-2e8fbf5c9e9f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:58.781025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:58.782192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:58.782603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:58.782983 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] PATH_INFO: `/v3/users/8bfc9d395abb4bd48c647627f56bf16a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:58.784973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bfc9d395abb4bd48c647627f56bf16a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:58.787244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:58.796019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 825/1657] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:58 2022] PUT /identity/v3/projects/ea0a014cec71409083995eae5794e9ba/users/5724e189cd504fd5b76ec3569f5d37e3/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:58.799869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cda50-7906-4c67-9453-bc90b9363e1c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:58.804798 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-405cda50-7906-4c67-9453-bc90b9363e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:58.891183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cda50-7906-4c67-9453-bc90b9363e1c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:58.897105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d15721-012c-4aa0-9f3d-3d255cb03735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:58.898540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d15721-012c-4aa0-9f3d-3d255cb03735 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:58.898540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d15721-012c-4aa0-9f3d-3d255cb03735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:58.899320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d15721-012c-4aa0-9f3d-3d255cb03735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:58.900197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d15721-012c-4aa0-9f3d-3d255cb03735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:58.902258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d15721-012c-4aa0-9f3d-3d255cb03735 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:58.926472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 826/1658] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:12:58.931908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d15721-012c-4aa0-9f3d-3d255cb03735 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:58.952004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d15721-012c-4aa0-9f3d-3d255cb03735 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:58.966385 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91668689-aa66-4214-bf0f-1c8890f5389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:58.967494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668689-aa66-4214-bf0f-1c8890f5389e admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:58.967818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668689-aa66-4214-bf0f-1c8890f5389e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:58.968121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668689-aa66-4214-bf0f-1c8890f5389e admin admin] PATH_INFO: `/v3/projects/ea0a014cec71409083995eae5794e9ba/users/5724e189cd504fd5b76ec3569f5d37e3/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:58.975242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91668689-aa66-4214-bf0f-1c8890f5389e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0a014cec71409083995eae5794e9ba, user_id=5724e189cd504fd5b76ec3569f5d37e3, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:58.981934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91668689-aa66-4214-bf0f-1c8890f5389e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:59.051772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bfc9d395abb4bd48c647627f56bf16a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:59.052340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 827/1659] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:58 2022] PUT /identity/v3/projects/ea0a014cec71409083995eae5794e9ba/users/5724e189cd504fd5b76ec3569f5d37e3/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:59.053931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d78bc-abcb-46f8-b5ff-a82ad5255cfe None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:59.054225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d78bc-abcb-46f8-b5ff-a82ad5255cfe None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:59.054509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d78bc-abcb-46f8-b5ff-a82ad5255cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:59.056520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bfc9d395abb4bd48c647627f56bf16a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:59.098331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-167d78bc-abcb-46f8-b5ff-a82ad5255cfe None None] MFA Rules not processed for user `5724e189cd504fd5b76ec3569f5d37e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:59.099656 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-167d78bc-abcb-46f8-b5ff-a82ad5255cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:59.175435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bfc9d395abb4bd48c647627f56bf16a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:59.203954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bfc9d395abb4bd48c647627f56bf16a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:59.225427 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bfc9d395abb4bd48c647627f56bf16a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:59.259255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 833/1660] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:58 2022] DELETE /identity/v3/users/8bfc9d395abb4bd48c647627f56bf16a => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:59.294499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 828/1661] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:12:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:59.297782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:59.299240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:59.441832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c38c40-e1e6-44be-a6b6-6d4a77255490 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:59.453270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000cb14-0f82-4aa0-b3dd-7c7cc29b31e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:59.454141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000cb14-0f82-4aa0-b3dd-7c7cc29b31e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:59.456752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000cb14-0f82-4aa0-b3dd-7c7cc29b31e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:59.457076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000cb14-0f82-4aa0-b3dd-7c7cc29b31e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:59.608349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000cb14-0f82-4aa0-b3dd-7c7cc29b31e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:59.609866 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000cb14-0f82-4aa0-b3dd-7c7cc29b31e2 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:59.634932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 834/1662] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:59.727412 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d78bc-abcb-46f8-b5ff-a82ad5255cfe None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:59.729179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-167d78bc-abcb-46f8-b5ff-a82ad5255cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:59.874494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d78bc-abcb-46f8-b5ff-a82ad5255cfe None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:59.878440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515ab30-013e-4f6c-803c-363198be08b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:59.879191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515ab30-013e-4f6c-803c-363198be08b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:59.879496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515ab30-013e-4f6c-803c-363198be08b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:59.879777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515ab30-013e-4f6c-803c-363198be08b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:59.881966 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3515ab30-013e-4f6c-803c-363198be08b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:59.888081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:59.981304 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515ab30-013e-4f6c-803c-363198be08b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:59.982911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515ab30-013e-4f6c-803c-363198be08b0 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:00.000999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 829/1663] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:00.491140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:00.783220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000cb14-0f82-4aa0-b3dd-7c7cc29b31e2 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:00.792485 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6000cb14-0f82-4aa0-b3dd-7c7cc29b31e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:00.918663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000cb14-0f82-4aa0-b3dd-7c7cc29b31e2 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:00.925052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd2fe2-e753-42f7-a477-377861af3a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:00.927218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd2fe2-e753-42f7-a477-377861af3a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:00.927676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd2fe2-e753-42f7-a477-377861af3a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:00.928187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd2fe2-e753-42f7-a477-377861af3a56 admin admin] PATH_INFO: `/v3/projects/74667386cd8544c0a0ea7d8801b6d4a9` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:00.929627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd2fe2-e753-42f7-a477-377861af3a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74667386cd8544c0a0ea7d8801b6d4a9)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:00.932535 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd2fe2-e753-42f7-a477-377861af3a56 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:01.158164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e0dd2fe2-e753-42f7-a477-377861af3a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74667386cd8544c0a0ea7d8801b6d4a9', 'request_id': 'req-e0dd2fe2-e753-42f7-a477-377861af3a56'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:01.168431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e0dd2fe2-e753-42f7-a477-377861af3a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74667386cd8544c0a0ea7d8801b6d4a9', 'request_id': 'req-e0dd2fe2-e753-42f7-a477-377861af3a56'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:01.176130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e0dd2fe2-e753-42f7-a477-377861af3a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74667386cd8544c0a0ea7d8801b6d4a9', 'request_id': 'req-e0dd2fe2-e753-42f7-a477-377861af3a56'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:01.339047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e0dd2fe2-e753-42f7-a477-377861af3a56 admin admin] The token cache is being invalidate because project 74667386cd8544c0a0ea7d8801b6d4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:01.345652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e0dd2fe2-e753-42f7-a477-377861af3a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:01.347219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e0dd2fe2-e753-42f7-a477-377861af3a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:01.358184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 835/1664] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:00 2022] DELETE /identity/v3/projects/74667386cd8544c0a0ea7d8801b6d4a9 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:01.362610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27e6a6-8c8f-454d-8b34-fcbe69b6cb08 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:01.363121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27e6a6-8c8f-454d-8b34-fcbe69b6cb08 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:01.363243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27e6a6-8c8f-454d-8b34-fcbe69b6cb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:01.416008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1d27e6a6-8c8f-454d-8b34-fcbe69b6cb08 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:01.423128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1d27e6a6-8c8f-454d-8b34-fcbe69b6cb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:01.586773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ce3eb-e44f-44c9-b9d8-b275c9353b2c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:01.587282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ce3eb-e44f-44c9-b9d8-b275c9353b2c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:01.587427 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ce3eb-e44f-44c9-b9d8-b275c9353b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:01.590206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 830/1665] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:01.621070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-340ce3eb-e44f-44c9-b9d8-b275c9353b2c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:01.626393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-340ce3eb-e44f-44c9-b9d8-b275c9353b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:01.652030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27e6a6-8c8f-454d-8b34-fcbe69b6cb08 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:01.660066 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 836/1666] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:01.662493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27e6a6-8c8f-454d-8b34-fcbe69b6cb08 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:01.676338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717864a5-b0ff-4aca-82c9-eec61b7df9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:01.678595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717864a5-b0ff-4aca-82c9-eec61b7df9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:01.679037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717864a5-b0ff-4aca-82c9-eec61b7df9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:01.679414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717864a5-b0ff-4aca-82c9-eec61b7df9b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:01.680525 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717864a5-b0ff-4aca-82c9-eec61b7df9b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:01.681096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717864a5-b0ff-4aca-82c9-eec61b7df9b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:01.682970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717864a5-b0ff-4aca-82c9-eec61b7df9b8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:01.699104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 831/1667] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:01.711737 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ce3eb-e44f-44c9-b9d8-b275c9353b2c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:01.723884 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ce3eb-e44f-44c9-b9d8-b275c9353b2c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:01.731188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f628-d7f9-4f8c-b321-d8199fb2cc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:01.732008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f628-d7f9-4f8c-b321-d8199fb2cc15 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:01.732296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f628-d7f9-4f8c-b321-d8199fb2cc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:01.732571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f628-d7f9-4f8c-b321-d8199fb2cc15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:01.733647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45f628-d7f9-4f8c-b321-d8199fb2cc15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:01.735814 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45f628-d7f9-4f8c-b321-d8199fb2cc15 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:01.884196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 837/1668] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:01 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:01.888054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717864a5-b0ff-4aca-82c9-eec61b7df9b8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:01.913137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717864a5-b0ff-4aca-82c9-eec61b7df9b8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:02.051546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d9720-9ec8-4949-9193-056986b19e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:02.052772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d9720-9ec8-4949-9193-056986b19e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.053346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d9720-9ec8-4949-9193-056986b19e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.053818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d9720-9ec8-4949-9193-056986b19e10 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.055449 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d9720-9ec8-4949-9193-056986b19e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:02.057940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d9720-9ec8-4949-9193-056986b19e10 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:02.143739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 832/1669] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:01 2022] POST /identity/v3/users => generated 283 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:02.147738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f628-d7f9-4f8c-b321-d8199fb2cc15 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:02.161504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f628-d7f9-4f8c-b321-d8199fb2cc15 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:02.192516 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f19726-822b-4d90-a300-fc1c96b70630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:02.193394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f19726-822b-4d90-a300-fc1c96b70630 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.193931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f19726-822b-4d90-a300-fc1c96b70630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.194785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f19726-822b-4d90-a300-fc1c96b70630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.196970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f19726-822b-4d90-a300-fc1c96b70630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:02.201445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f19726-822b-4d90-a300-fc1c96b70630 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:02.246523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 838/1670] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:02.249689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d9720-9ec8-4949-9193-056986b19e10 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:02.264377 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d9720-9ec8-4949-9193-056986b19e10 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:02.304517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862b0ff-ca13-4f62-b208-a2880212aa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:02.305556 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862b0ff-ca13-4f62-b208-a2880212aa22 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.305978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862b0ff-ca13-4f62-b208-a2880212aa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.306389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862b0ff-ca13-4f62-b208-a2880212aa22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.307473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862b0ff-ca13-4f62-b208-a2880212aa22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:02.310388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862b0ff-ca13-4f62-b208-a2880212aa22 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:02.345924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 833/1671] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:02.348295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f19726-822b-4d90-a300-fc1c96b70630 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:02.364870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f19726-822b-4d90-a300-fc1c96b70630 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:02.376385 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dfa63-8d7b-4bec-ba97-c43f19a36d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:02.377336 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfa63-8d7b-4bec-ba97-c43f19a36d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.380314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfa63-8d7b-4bec-ba97-c43f19a36d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.380314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfa63-8d7b-4bec-ba97-c43f19a36d0c admin admin] PATH_INFO: `/v3/projects/972bf6bb86f84eacaf95569b18bada3d/users/5ee9c0f92a484017aed53b78f389a24c/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.420618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dfa63-8d7b-4bec-ba97-c43f19a36d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=972bf6bb86f84eacaf95569b18bada3d, user_id=5ee9c0f92a484017aed53b78f389a24c, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:02.423358 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dfa63-8d7b-4bec-ba97-c43f19a36d0c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:02.513681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 839/1672] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:02 2022] PUT /identity/v3/projects/972bf6bb86f84eacaf95569b18bada3d/users/5ee9c0f92a484017aed53b78f389a24c/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:02.525101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b311dd-9837-4cc7-a070-080b878d3152 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.525497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b311dd-9837-4cc7-a070-080b878d3152 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.525864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b311dd-9837-4cc7-a070-080b878d3152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.536153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:02.613622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-77b311dd-9837-4cc7-a070-080b878d3152 None None] MFA Rules not processed for user `5ee9c0f92a484017aed53b78f389a24c`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:02.617729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-77b311dd-9837-4cc7-a070-080b878d3152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:02.710620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:02.738225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bd3a-8bc0-42b1-8ad7-c86ffbc83df2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.739745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bd3a-8bc0-42b1-8ad7-c86ffbc83df2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.740215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bd3a-8bc0-42b1-8ad7-c86ffbc83df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.748945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 834/1673] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:02.753505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b311dd-9837-4cc7-a070-080b878d3152 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:02.841569 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3b83bd3a-8bc0-42b1-8ad7-c86ffbc83df2 None None] MFA Rules not processed for user `7d740fb903c24d8f851fe03e05cb8afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:02.842819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3b83bd3a-8bc0-42b1-8ad7-c86ffbc83df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:02.991006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b311dd-9837-4cc7-a070-080b878d3152 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:03.032245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e1e22-1879-4f2e-a2a4-9661c05ea35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:03.033246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e1e22-1879-4f2e-a2a4-9661c05ea35a admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.035585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e1e22-1879-4f2e-a2a4-9661c05ea35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.036018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e1e22-1879-4f2e-a2a4-9661c05ea35a admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:03.036952 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e1e22-1879-4f2e-a2a4-9661c05ea35a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:03.039017 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e1e22-1879-4f2e-a2a4-9661c05ea35a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:03.069348 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 840/1674] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:03.089937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83bd3a-8bc0-42b1-8ad7-c86ffbc83df2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:03.092487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3b83bd3a-8bc0-42b1-8ad7-c86ffbc83df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:03.202729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 835/1675] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:02 2022] POST /identity/v3/projects => generated 361 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:03.207825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e1e22-1879-4f2e-a2a4-9661c05ea35a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:03.368157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83bd3a-8bc0-42b1-8ad7-c86ffbc83df2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:03.421568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e1e22-1879-4f2e-a2a4-9661c05ea35a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:03.439719 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa51863-4616-422d-85d8-79e5ff1f31aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:03.442902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa51863-4616-422d-85d8-79e5ff1f31aa admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.444554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa51863-4616-422d-85d8-79e5ff1f31aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.445600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa51863-4616-422d-85d8-79e5ff1f31aa admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:03.448938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa51863-4616-422d-85d8-79e5ff1f31aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:03.450946 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa51863-4616-422d-85d8-79e5ff1f31aa admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:03.517578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a3e95-3b51-4859-9bc3-828e86bb6485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:03.519124 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a3e95-3b51-4859-9bc3-828e86bb6485 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.519415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a3e95-3b51-4859-9bc3-828e86bb6485 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.519694 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a3e95-3b51-4859-9bc3-828e86bb6485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:03.690134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a3e95-3b51-4859-9bc3-828e86bb6485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:03.691991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a3e95-3b51-4859-9bc3-828e86bb6485 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:03.714740 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 841/1676] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:03.721819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6c2a9-0751-461f-bb41-e95f564c0f92 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.722935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6c2a9-0751-461f-bb41-e95f564c0f92 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.723295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6c2a9-0751-461f-bb41-e95f564c0f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:03.805527 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-43e6c2a9-0751-461f-bb41-e95f564c0f92 None None] MFA Rules not processed for user `852d5930824842d5a28160bcc54f5c71`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:03.805527 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-43e6c2a9-0751-461f-bb41-e95f564c0f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:03.889855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 836/1677] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:03 2022] POST /identity/v3/users => generated 287 bytes in 647 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:03.889855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af6625-83a9-466e-8fbb-e6e8956ba0c1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.889855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af6625-83a9-466e-8fbb-e6e8956ba0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.889855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af6625-83a9-466e-8fbb-e6e8956ba0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:03.895173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 842/1678] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:03.898554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6c2a9-0751-461f-bb41-e95f564c0f92 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:03.995163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-35af6625-83a9-466e-8fbb-e6e8956ba0c1 None None] MFA Rules not processed for user `2694401e38424109bce306728953c986`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:03.995163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-35af6625-83a9-466e-8fbb-e6e8956ba0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:03.995351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6c2a9-0751-461f-bb41-e95f564c0f92 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:03.995351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584d401-a478-4508-9792-d80de905df8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:03.995351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584d401-a478-4508-9792-d80de905df8d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.995351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584d401-a478-4508-9792-d80de905df8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.995663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584d401-a478-4508-9792-d80de905df8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:03.995663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584d401-a478-4508-9792-d80de905df8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:03.995663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584d401-a478-4508-9792-d80de905df8d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:03.995663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 843/1679] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:03.995663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786f068-f794-48fb-89bf-7794146cbe6f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.995663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786f068-f794-48fb-89bf-7794146cbe6f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.996077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786f068-f794-48fb-89bf-7794146cbe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.003141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a786f068-f794-48fb-89bf-7794146cbe6f None None] MFA Rules not processed for user `852d5930824842d5a28160bcc54f5c71`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:04.004368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a786f068-f794-48fb-89bf-7794146cbe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:04.016332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 844/1680] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:04.017285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786f068-f794-48fb-89bf-7794146cbe6f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.024584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 837/1681] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:04.037628 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0e3e3-a664-4def-a734-50e41ab6127a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.038036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0e3e3-a664-4def-a734-50e41ab6127a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.038324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0e3e3-a664-4def-a734-50e41ab6127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.051719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786f068-f794-48fb-89bf-7794146cbe6f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:04.056030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27334c84-bdc5-4e79-8679-c897d833ae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:04.057548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27334c84-bdc5-4e79-8679-c897d833ae48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.058048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27334c84-bdc5-4e79-8679-c897d833ae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.058491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27334c84-bdc5-4e79-8679-c897d833ae48 admin admin] PATH_INFO: `/v3/projects/b76af948dabf4610b62a86d8c9dc9a49/users/32a4651a3afc492399ddee1da60295bb/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.101171 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-eff0e3e3-a664-4def-a734-50e41ab6127a None None] MFA Rules not processed for user `2694401e38424109bce306728953c986`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:04.102847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-eff0e3e3-a664-4def-a734-50e41ab6127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:04.116024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27334c84-bdc5-4e79-8679-c897d833ae48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76af948dabf4610b62a86d8c9dc9a49, user_id=32a4651a3afc492399ddee1da60295bb, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:04.119824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27334c84-bdc5-4e79-8679-c897d833ae48 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:04.142162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 838/1682] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:04.206992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0e3e3-a664-4def-a734-50e41ab6127a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.208962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-eff0e3e3-a664-4def-a734-50e41ab6127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:04.233833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 845/1683] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:04 2022] PUT /identity/v3/projects/b76af948dabf4610b62a86d8c9dc9a49/users/32a4651a3afc492399ddee1da60295bb/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:04.237882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27334c84-bdc5-4e79-8679-c897d833ae48 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.237882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-27334c84-bdc5-4e79-8679-c897d833ae48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:04.249212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0e3e3-a664-4def-a734-50e41ab6127a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:04.417418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27334c84-bdc5-4e79-8679-c897d833ae48 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:04.424014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed92dd-dc2e-48bb-bb98-7dcd8d920038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:04.424920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed92dd-dc2e-48bb-bb98-7dcd8d920038 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.425209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed92dd-dc2e-48bb-bb98-7dcd8d920038 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.425493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed92dd-dc2e-48bb-bb98-7dcd8d920038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.493868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:04.493868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.493868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.493868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] PATH_INFO: `/v3/users/6ea0e418862e413da1cdd32642939c06` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.494561 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea0e418862e413da1cdd32642939c06)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:04.501365 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:04.515570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed92dd-dc2e-48bb-bb98-7dcd8d920038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:04.518053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed92dd-dc2e-48bb-bb98-7dcd8d920038 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:04.555669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 846/1684] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:04.557786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed92dd-dc2e-48bb-bb98-7dcd8d920038 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.592911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed92dd-dc2e-48bb-bb98-7dcd8d920038 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:04.613557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587a3c5-3feb-4623-a7e1-bb36af2cf80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:04.613557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587a3c5-3feb-4623-a7e1-bb36af2cf80c admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.613557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587a3c5-3feb-4623-a7e1-bb36af2cf80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.613557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587a3c5-3feb-4623-a7e1-bb36af2cf80c admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.613831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587a3c5-3feb-4623-a7e1-bb36af2cf80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:04.616046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587a3c5-3feb-4623-a7e1-bb36af2cf80c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:04.646678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 847/1685] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:04.649305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587a3c5-3feb-4623-a7e1-bb36af2cf80c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.677855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587a3c5-3feb-4623-a7e1-bb36af2cf80c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:04.684348 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41a87b-4106-4407-80ad-408bbd5d0c87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:04.685102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41a87b-4106-4407-80ad-408bbd5d0c87 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.685718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41a87b-4106-4407-80ad-408bbd5d0c87 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.686125 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41a87b-4106-4407-80ad-408bbd5d0c87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.760133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea0e418862e413da1cdd32642939c06'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:04.760968 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea0e418862e413da1cdd32642939c06'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:04.761687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea0e418862e413da1cdd32642939c06'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:04.802226 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea0e418862e413da1cdd32642939c06'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:04.814308 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea0e418862e413da1cdd32642939c06'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:04.856430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41a87b-4106-4407-80ad-408bbd5d0c87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:04.858595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41a87b-4106-4407-80ad-408bbd5d0c87 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:04.884098 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 839/1686] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:04 2022] DELETE /identity/v3/users/6ea0e418862e413da1cdd32642939c06 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:04.885004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.886421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:04.902874 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 848/1687] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:04.904774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57863e-3680-448d-85af-17666f6c2832 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.905235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57863e-3680-448d-85af-17666f6c2832 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.905669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57863e-3680-448d-85af-17666f6c2832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.955172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ab57863e-3680-448d-85af-17666f6c2832 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:04.956720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ab57863e-3680-448d-85af-17666f6c2832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:05.020216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed76e3-3729-42ea-a744-13ba2a441f1b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:05.033917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9227cb-306d-439a-a8fb-0d45c07bef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:05.034875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9227cb-306d-439a-a8fb-0d45c07bef32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.035165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9227cb-306d-439a-a8fb-0d45c07bef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.035440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9227cb-306d-439a-a8fb-0d45c07bef32 admin admin] PATH_INFO: `/v3/projects/b76af948dabf4610b62a86d8c9dc9a49/users/32a4651a3afc492399ddee1da60295bb/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.042160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9227cb-306d-439a-a8fb-0d45c07bef32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76af948dabf4610b62a86d8c9dc9a49, user_id=32a4651a3afc492399ddee1da60295bb, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:05.051224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9227cb-306d-439a-a8fb-0d45c07bef32 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:05.079401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 840/1688] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:04 2022] PUT /identity/v3/projects/b76af948dabf4610b62a86d8c9dc9a49/users/32a4651a3afc492399ddee1da60295bb/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:05.091794 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88c7e-dc12-42c5-ae9c-aec46793f39f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.092410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88c7e-dc12-42c5-ae9c-aec46793f39f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.093445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88c7e-dc12-42c5-ae9c-aec46793f39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.108150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 849/1689] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:05.130046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57863e-3680-448d-85af-17666f6c2832 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:05.133210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ab57863e-3680-448d-85af-17666f6c2832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:05.169882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-14a88c7e-dc12-42c5-ae9c-aec46793f39f None None] MFA Rules not processed for user `32a4651a3afc492399ddee1da60295bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:05.171147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-14a88c7e-dc12-42c5-ae9c-aec46793f39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:05.275657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57863e-3680-448d-85af-17666f6c2832 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:05.398481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:05.406447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4452c5-9bb8-4240-8073-8c42cf831ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:05.407599 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4452c5-9bb8-4240-8073-8c42cf831ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.408462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4452c5-9bb8-4240-8073-8c42cf831ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.409014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4452c5-9bb8-4240-8073-8c42cf831ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.414400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 841/1690] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:05.509906 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a88c7e-dc12-42c5-ae9c-aec46793f39f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:05.511345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-14a88c7e-dc12-42c5-ae9c-aec46793f39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:05.604108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4452c5-9bb8-4240-8073-8c42cf831ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:05.605605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4452c5-9bb8-4240-8073-8c42cf831ca1 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:05.644539 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 850/1691] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:05.681543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a88c7e-dc12-42c5-ae9c-aec46793f39f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:05.693896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f68c6-3217-4496-979e-44d00e8cbe24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:05.696253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f68c6-3217-4496-979e-44d00e8cbe24 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.696253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f68c6-3217-4496-979e-44d00e8cbe24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.696253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f68c6-3217-4496-979e-44d00e8cbe24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.713526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f68c6-3217-4496-979e-44d00e8cbe24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:05.715080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f68c6-3217-4496-979e-44d00e8cbe24 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:05.742010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 842/1692] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:05.866033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52323e-b8c2-4974-9bfd-67c6f478a2cf None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.866327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52323e-b8c2-4974-9bfd-67c6f478a2cf None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.866615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52323e-b8c2-4974-9bfd-67c6f478a2cf None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.869275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 851/1693] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jun 23 13:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:13:05.876260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6112dd-3ba2-444d-ae08-6deb7eac910e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.876552 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6112dd-3ba2-444d-ae08-6deb7eac910e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.876854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6112dd-3ba2-444d-ae08-6deb7eac910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.942957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7b6112dd-3ba2-444d-ae08-6deb7eac910e None None] MFA Rules not processed for user `b1eb257517674c63840d6a2090eb2200`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:05.944460 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7b6112dd-3ba2-444d-ae08-6deb7eac910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:05.967969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52323e-b8c2-4974-9bfd-67c6f478a2cf None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:05.967969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7b52323e-b8c2-4974-9bfd-67c6f478a2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:05.976000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 843/1694] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:05.983940 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52323e-b8c2-4974-9bfd-67c6f478a2cf None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:05.987744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cd096-76f8-4c0c-8f1b-b3df3757280d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:05.988590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd096-76f8-4c0c-8f1b-b3df3757280d service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.989070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd096-76f8-4c0c-8f1b-b3df3757280d service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.989511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd096-76f8-4c0c-8f1b-b3df3757280d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.998675 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cd096-76f8-4c0c-8f1b-b3df3757280d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:06.000149 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cd096-76f8-4c0c-8f1b-b3df3757280d service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:06.044912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 852/1695] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:06.092599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6112dd-3ba2-444d-ae08-6deb7eac910e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:06.108306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6112dd-3ba2-444d-ae08-6deb7eac910e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:06.113313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c09f2d-9bf8-4eeb-a9f7-55b9eb612964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:06.114034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c09f2d-9bf8-4eeb-a9f7-55b9eb612964 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:06.118671 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c09f2d-9bf8-4eeb-a9f7-55b9eb612964 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:06.119009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c09f2d-9bf8-4eeb-a9f7-55b9eb612964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:06.121386 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-91c09f2d-9bf8-4eeb-a9f7-55b9eb612964 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:06.238314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:06.253084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c09f2d-9bf8-4eeb-a9f7-55b9eb612964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:06.254822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c09f2d-9bf8-4eeb-a9f7-55b9eb612964 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:06.280461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 844/1696] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:06.335205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac798e-a268-49db-8d53-41a60df9c774 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:06.335502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac798e-a268-49db-8d53-41a60df9c774 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:06.336303 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac798e-a268-49db-8d53-41a60df9c774 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:06.338609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 853/1697] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jun 23 13:13:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:13:06.344483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace098fd-0098-48b9-9ac6-953e26519061 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:06.344847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace098fd-0098-48b9-9ac6-953e26519061 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:06.345131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace098fd-0098-48b9-9ac6-953e26519061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:06.373259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ace098fd-0098-48b9-9ac6-953e26519061 None None] MFA Rules not processed for user `b1eb257517674c63840d6a2090eb2200`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:06.375318 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ace098fd-0098-48b9-9ac6-953e26519061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:06.384902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 845/1698] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:13:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:06.401138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac798e-a268-49db-8d53-41a60df9c774 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:06.424160 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac798e-a268-49db-8d53-41a60df9c774 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:06.431859 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf3bf6-ba17-4f3e-ba09-bc107aacf72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:06.432538 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf3bf6-ba17-4f3e-ba09-bc107aacf72c service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:06.432945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf3bf6-ba17-4f3e-ba09-bc107aacf72c service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:06.433274 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf3bf6-ba17-4f3e-ba09-bc107aacf72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:06.448772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf3bf6-ba17-4f3e-ba09-bc107aacf72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:06.458587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf3bf6-ba17-4f3e-ba09-bc107aacf72c service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:06.482909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 854/1699] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:06.855789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace098fd-0098-48b9-9ac6-953e26519061 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:06.858422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ace098fd-0098-48b9-9ac6-953e26519061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:06.881714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace098fd-0098-48b9-9ac6-953e26519061 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:06.887619 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:06.888504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:06.899705 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:06.900307 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] PATH_INFO: `/v3/projects/cc5ac82cb96a4ea29481ed2d110fabfa` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:06.906229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5ac82cb96a4ea29481ed2d110fabfa)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:06.908424 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:07.033688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69893-2c74-4b50-9aa4-6beb0ed151e2 None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:07.034586 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69893-2c74-4b50-9aa4-6beb0ed151e2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:07.035010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69893-2c74-4b50-9aa4-6beb0ed151e2 None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:07.037123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 855/1700] 10.222.0.33 () {54 vars in 960 bytes} [Thu Jun 23 13:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:13:07.048432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ff23a-eaef-4aac-a326-4e13310f5a17 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:07.054988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ff23a-eaef-4aac-a326-4e13310f5a17 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:07.054988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ff23a-eaef-4aac-a326-4e13310f5a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:07.078044 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-dd3ff23a-eaef-4aac-a326-4e13310f5a17 None None] MFA Rules not processed for user `8644754798b5439c954c86dc9aa9e7af`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:07.079931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dd3ff23a-eaef-4aac-a326-4e13310f5a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:07.137451 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5ac82cb96a4ea29481ed2d110fabfa', 'request_id': 'req-5d856140-e206-4e5e-a9ef-24f3b9931ec8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:07.292797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 856/1701] 10.222.0.33 () {58 vars in 1057 bytes} [Thu Jun 23 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:07.294466 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ff23a-eaef-4aac-a326-4e13310f5a17 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:07.296104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dd3ff23a-eaef-4aac-a326-4e13310f5a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:07.314785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ff23a-eaef-4aac-a326-4e13310f5a17 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:07.352325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5ac82cb96a4ea29481ed2d110fabfa', 'request_id': 'req-5d856140-e206-4e5e-a9ef-24f3b9931ec8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:07.360647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5ac82cb96a4ea29481ed2d110fabfa', 'request_id': 'req-5d856140-e206-4e5e-a9ef-24f3b9931ec8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:07.394870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] The token cache is being invalidate because project cc5ac82cb96a4ea29481ed2d110fabfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:07.395209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:07.395917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:07.400369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 846/1702] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:06 2022] DELETE /identity/v3/projects/cc5ac82cb96a4ea29481ed2d110fabfa => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:07.401346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:07.404610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:07.435443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9819bb5-538a-40b1-b29d-038125023d0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:07.436803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9819bb5-538a-40b1-b29d-038125023d0f service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:07.436803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9819bb5-538a-40b1-b29d-038125023d0f service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:07.436803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9819bb5-538a-40b1-b29d-038125023d0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:07.442862 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e9819bb5-538a-40b1-b29d-038125023d0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:07.467165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9819bb5-538a-40b1-b29d-038125023d0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:07.468797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9819bb5-538a-40b1-b29d-038125023d0f service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:07.490655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 857/1703] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:07.494387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f77c67-2e60-49af-8223-2d978f46f20f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:07.496443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f77c67-2e60-49af-8223-2d978f46f20f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:07.497696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f77c67-2e60-49af-8223-2d978f46f20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:07.558709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f1f77c67-2e60-49af-8223-2d978f46f20f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:07.562816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f1f77c67-2e60-49af-8223-2d978f46f20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:07.578032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d856140-e206-4e5e-a9ef-24f3b9931ec8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:07.590416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5182ed9-0dd7-491e-bd72-bdae85ade46e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:07.596104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5182ed9-0dd7-491e-bd72-bdae85ade46e service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:07.596104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5182ed9-0dd7-491e-bd72-bdae85ade46e service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:07.596418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5182ed9-0dd7-491e-bd72-bdae85ade46e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:07.619980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5182ed9-0dd7-491e-bd72-bdae85ade46e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:07.623695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5182ed9-0dd7-491e-bd72-bdae85ade46e service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:07.649304 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 847/1704] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:07.656973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1e3a0-302e-4b2d-85cf-994f70dd274e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:07.657553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1e3a0-302e-4b2d-85cf-994f70dd274e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:07.658036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1e3a0-302e-4b2d-85cf-994f70dd274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:07.701951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-28a1e3a0-302e-4b2d-85cf-994f70dd274e None None] MFA Rules not processed for user `2694401e38424109bce306728953c986`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:07.706300 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-28a1e3a0-302e-4b2d-85cf-994f70dd274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:07.733989 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 858/1705] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:07.741411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d98338-def5-4b7d-b35e-2ac65bada5e2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:07.741703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d98338-def5-4b7d-b35e-2ac65bada5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:07.746143 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d98338-def5-4b7d-b35e-2ac65bada5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:07.775200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-58d98338-def5-4b7d-b35e-2ac65bada5e2 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:07.776643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-58d98338-def5-4b7d-b35e-2ac65bada5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:07.788434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 859/1706] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:07.794925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d98338-def5-4b7d-b35e-2ac65bada5e2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:07.814700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d98338-def5-4b7d-b35e-2ac65bada5e2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:07.829997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c03b60-8840-4b2c-9ca9-691e63ddb19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:07.831022 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c03b60-8840-4b2c-9ca9-691e63ddb19e admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:07.832232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c03b60-8840-4b2c-9ca9-691e63ddb19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:07.833196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c03b60-8840-4b2c-9ca9-691e63ddb19e admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:07.834872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c03b60-8840-4b2c-9ca9-691e63ddb19e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:07.836235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c03b60-8840-4b2c-9ca9-691e63ddb19e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:07.842802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c03b60-8840-4b2c-9ca9-691e63ddb19e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:07.862294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 848/1707] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:07.863839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:07.892272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 860/1708] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:07.897206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1e3a0-302e-4b2d-85cf-994f70dd274e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:07.935954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1e3a0-302e-4b2d-85cf-994f70dd274e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:07.952184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4809be-0d1a-4713-b27c-39d518212fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:07.953150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4809be-0d1a-4713-b27c-39d518212fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:07.953574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4809be-0d1a-4713-b27c-39d518212fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:07.954005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4809be-0d1a-4713-b27c-39d518212fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:07.954865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4809be-0d1a-4713-b27c-39d518212fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:07.957915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4809be-0d1a-4713-b27c-39d518212fbe admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:08.168388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 849/1709] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:07 2022] POST /identity/v3/projects => generated 367 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:08.172315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c03b60-8840-4b2c-9ca9-691e63ddb19e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:08.190659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c03b60-8840-4b2c-9ca9-691e63ddb19e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:08.328128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f017a-ae37-4940-bc9b-82efbd786265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:08.329817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f017a-ae37-4940-bc9b-82efbd786265 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:08.330366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f017a-ae37-4940-bc9b-82efbd786265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:08.330794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f017a-ae37-4940-bc9b-82efbd786265 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:08.332546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f017a-ae37-4940-bc9b-82efbd786265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:08.335762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f017a-ae37-4940-bc9b-82efbd786265 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:08.545536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 861/1710] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:08 2022] POST /identity/v3/users => generated 284 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:08.546797 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4809be-0d1a-4713-b27c-39d518212fbe admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:08.563912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4809be-0d1a-4713-b27c-39d518212fbe admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:08.576273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253bced-2553-41ce-b534-a0645cd2eb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:08.577263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253bced-2553-41ce-b534-a0645cd2eb4a admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:08.577629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253bced-2553-41ce-b534-a0645cd2eb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:08.580634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253bced-2553-41ce-b534-a0645cd2eb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:08.584837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253bced-2553-41ce-b534-a0645cd2eb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:08.588182 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253bced-2553-41ce-b534-a0645cd2eb4a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:08.630812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 850/1711] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:08.634784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f017a-ae37-4940-bc9b-82efbd786265 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:08.655003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f017a-ae37-4940-bc9b-82efbd786265 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:08.667375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d01b3d-5fd9-4916-b96d-f9bb98cadb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:08.668498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d01b3d-5fd9-4916-b96d-f9bb98cadb88 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:08.670825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d01b3d-5fd9-4916-b96d-f9bb98cadb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:08.671391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d01b3d-5fd9-4916-b96d-f9bb98cadb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:08.672353 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d01b3d-5fd9-4916-b96d-f9bb98cadb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:08.683139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d01b3d-5fd9-4916-b96d-f9bb98cadb88 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:08.751923 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 862/1712] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:08.755191 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253bced-2553-41ce-b534-a0645cd2eb4a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:08.790805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253bced-2553-41ce-b534-a0645cd2eb4a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:08.803699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d01b3d-5fd9-4916-b96d-f9bb98cadb88 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:08.805800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c2d01b3d-5fd9-4916-b96d-f9bb98cadb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:08.806723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54242a4a-dac5-4819-a4d9-37c7bda65c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:08.808032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54242a4a-dac5-4819-a4d9-37c7bda65c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:08.808537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54242a4a-dac5-4819-a4d9-37c7bda65c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:08.809215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54242a4a-dac5-4819-a4d9-37c7bda65c87 admin admin] PATH_INFO: `/v3/projects/e098255eead5458c8c95e6c5b569988b/users/41e91aff6d5a48438ca3015d12d50c6f/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:08.838636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d01b3d-5fd9-4916-b96d-f9bb98cadb88 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:08.840931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54242a4a-dac5-4819-a4d9-37c7bda65c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e098255eead5458c8c95e6c5b569988b, user_id=41e91aff6d5a48438ca3015d12d50c6f, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:08.844463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54242a4a-dac5-4819-a4d9-37c7bda65c87 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:08.845501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7df5-7f5c-41ab-8470-009130c48fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:08.847510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7df5-7f5c-41ab-8470-009130c48fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:08.847510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7df5-7f5c-41ab-8470-009130c48fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:08.847510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7df5-7f5c-41ab-8470-009130c48fcd admin admin] PATH_INFO: `/v3/users/f910fc790a2741a99ceb3dc6debc0981` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:08.848786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7df5-7f5c-41ab-8470-009130c48fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f910fc790a2741a99ceb3dc6debc0981)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:08.850878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7df5-7f5c-41ab-8470-009130c48fcd admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:08.982716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 851/1713] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:08 2022] PUT /identity/v3/projects/e098255eead5458c8c95e6c5b569988b/users/41e91aff6d5a48438ca3015d12d50c6f/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:09.006882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499e21d-9ea7-4673-9604-b11c994d3ff4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.007185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499e21d-9ea7-4673-9604-b11c994d3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.007988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499e21d-9ea7-4673-9604-b11c994d3ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.133836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f499e21d-9ea7-4673-9604-b11c994d3ff4 None None] MFA Rules not processed for user `41e91aff6d5a48438ca3015d12d50c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:09.141286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f499e21d-9ea7-4673-9604-b11c994d3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:09.227395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5b4e7df5-7f5c-41ab-8470-009130c48fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f910fc790a2741a99ceb3dc6debc0981'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:09.231746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5b4e7df5-7f5c-41ab-8470-009130c48fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f910fc790a2741a99ceb3dc6debc0981'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:09.367295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5b4e7df5-7f5c-41ab-8470-009130c48fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f910fc790a2741a99ceb3dc6debc0981'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:09.414314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5b4e7df5-7f5c-41ab-8470-009130c48fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f910fc790a2741a99ceb3dc6debc0981'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:09.443155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 852/1714] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:09.448200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499e21d-9ea7-4673-9604-b11c994d3ff4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:09.450042 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f499e21d-9ea7-4673-9604-b11c994d3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:09.474810 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5b4e7df5-7f5c-41ab-8470-009130c48fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f910fc790a2741a99ceb3dc6debc0981'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:09.503856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 863/1715] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:08 2022] DELETE /identity/v3/users/f910fc790a2741a99ceb3dc6debc0981 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:09.508727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242f814-a219-4267-a3da-8e2aef92ec94 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.509024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242f814-a219-4267-a3da-8e2aef92ec94 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.511118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242f814-a219-4267-a3da-8e2aef92ec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.610955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6242f814-a219-4267-a3da-8e2aef92ec94 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:09.610955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6242f814-a219-4267-a3da-8e2aef92ec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:09.724244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499e21d-9ea7-4673-9604-b11c994d3ff4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:09.842758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 864/1716] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:09.845602 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242f814-a219-4267-a3da-8e2aef92ec94 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:09.849128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6242f814-a219-4267-a3da-8e2aef92ec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:09.896522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242f814-a219-4267-a3da-8e2aef92ec94 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:09.924371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:09.927313 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.930266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.931941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] PATH_INFO: `/v3/users/3e35ecf64db94d728d8aac2c95536417` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.933153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a27bc5-9361-4661-a375-888d21d05fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:09.933512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a27bc5-9361-4661-a375-888d21d05fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.934817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e35ecf64db94d728d8aac2c95536417)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:09.935064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a27bc5-9361-4661-a375-888d21d05fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.935818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a27bc5-9361-4661-a375-888d21d05fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.938763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a27bc5-9361-4661-a375-888d21d05fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:09.942477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:09.957268 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a27bc5-9361-4661-a375-888d21d05fc3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:10.203203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 853/1717] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:09 2022] POST /identity/v3/projects => generated 369 bytes in 756 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:10.208779 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a27bc5-9361-4661-a375-888d21d05fc3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:10.208779 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-88a27bc5-9361-4661-a375-888d21d05fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:10.285320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a27bc5-9361-4661-a375-888d21d05fc3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:10.292540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d06b20-f304-4e1a-9ca8-bc890e18e6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:10.293522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d06b20-f304-4e1a-9ca8-bc890e18e6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.294513 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d06b20-f304-4e1a-9ca8-bc890e18e6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.295003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d06b20-f304-4e1a-9ca8-bc890e18e6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.317743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e35ecf64db94d728d8aac2c95536417'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.318213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e35ecf64db94d728d8aac2c95536417'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.369458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d06b20-f304-4e1a-9ca8-bc890e18e6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:10.370902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d06b20-f304-4e1a-9ca8-bc890e18e6d2 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:10.404162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 854/1718] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:10.407521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23569f1b-ea27-4591-895b-db226468e09f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.408003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23569f1b-ea27-4591-895b-db226468e09f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.408430 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23569f1b-ea27-4591-895b-db226468e09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.449134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-23569f1b-ea27-4591-895b-db226468e09f None None] MFA Rules not processed for user `7d740fb903c24d8f851fe03e05cb8afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:10.451557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-23569f1b-ea27-4591-895b-db226468e09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:10.464557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:10.466684 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e35ecf64db94d728d8aac2c95536417'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.499664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e35ecf64db94d728d8aac2c95536417'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.526180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e35ecf64db94d728d8aac2c95536417'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.546333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 865/1719] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:09 2022] DELETE /identity/v3/users/3e35ecf64db94d728d8aac2c95536417 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:10.550308 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:10.552963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:10.565232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 855/1720] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:10.571899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ddc43-064e-4337-8149-af319d19fc7d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.572336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ddc43-064e-4337-8149-af319d19fc7d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.574322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ddc43-064e-4337-8149-af319d19fc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.616632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d51ddc43-064e-4337-8149-af319d19fc7d None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:10.620998 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d51ddc43-064e-4337-8149-af319d19fc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:10.690497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:10.740450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 856/1721] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:10.762373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ddc43-064e-4337-8149-af319d19fc7d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:10.770486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d51ddc43-064e-4337-8149-af319d19fc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:10.804809 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac199979-507a-446d-8976-5496ddbc07ce admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:10.823555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46589dd-5485-492c-8544-b182e95c7df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:10.824554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46589dd-5485-492c-8544-b182e95c7df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.825012 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46589dd-5485-492c-8544-b182e95c7df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.825439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46589dd-5485-492c-8544-b182e95c7df7 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.826797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46589dd-5485-492c-8544-b182e95c7df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:10.832467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46589dd-5485-492c-8544-b182e95c7df7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:10.900458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ddc43-064e-4337-8149-af319d19fc7d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:10.904799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689f85-a564-4ce4-a58d-26a1827bb790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:10.905495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689f85-a564-4ce4-a58d-26a1827bb790 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.905828 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689f85-a564-4ce4-a58d-26a1827bb790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.906157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689f85-a564-4ce4-a58d-26a1827bb790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.920181 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa689f85-a564-4ce4-a58d-26a1827bb790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:10.922850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa689f85-a564-4ce4-a58d-26a1827bb790 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:10.936161 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 857/1722] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:11.016870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 866/1723] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:10 2022] POST /identity/v3/users => generated 291 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:11.023112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689f85-a564-4ce4-a58d-26a1827bb790 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:11.056761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689f85-a564-4ce4-a58d-26a1827bb790 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:11.106954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2f6f4-ff4c-437e-b035-8df42fd3f6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:11.107707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2f6f4-ff4c-437e-b035-8df42fd3f6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:11.108006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2f6f4-ff4c-437e-b035-8df42fd3f6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:11.108549 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2f6f4-ff4c-437e-b035-8df42fd3f6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:11.109486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2f6f4-ff4c-437e-b035-8df42fd3f6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:11.112622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2f6f4-ff4c-437e-b035-8df42fd3f6b1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:11.158323 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46589dd-5485-492c-8544-b182e95c7df7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:11.176544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46589dd-5485-492c-8544-b182e95c7df7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:11.177675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 858/1724] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:11.198499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b077b8-5d37-4140-ae49-0d88c24a0f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:11.199440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b077b8-5d37-4140-ae49-0d88c24a0f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:11.199727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b077b8-5d37-4140-ae49-0d88c24a0f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:11.200005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b077b8-5d37-4140-ae49-0d88c24a0f3e admin admin] PATH_INFO: `/v3/projects/b9b12534bed5481281f07a68b42c8c74/users/4018520205f8493d89c567db50f3ded9/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:11.269658 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b077b8-5d37-4140-ae49-0d88c24a0f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b12534bed5481281f07a68b42c8c74, user_id=4018520205f8493d89c567db50f3ded9, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:11.289435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b077b8-5d37-4140-ae49-0d88c24a0f3e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:11.521519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 867/1725] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:11 2022] PUT /identity/v3/projects/b9b12534bed5481281f07a68b42c8c74/users/4018520205f8493d89c567db50f3ded9/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:11.527124 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2f6f4-ff4c-437e-b035-8df42fd3f6b1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:11.533581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b077b8-5d37-4140-ae49-0d88c24a0f3e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:11.546109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-90b077b8-5d37-4140-ae49-0d88c24a0f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:11.553830 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2f6f4-ff4c-437e-b035-8df42fd3f6b1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:11.818324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b519-2a3e-43cb-9b10-62ab69ee66e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:11.819048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b519-2a3e-43cb-9b10-62ab69ee66e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:11.819322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b519-2a3e-43cb-9b10-62ab69ee66e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:11.819603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b519-2a3e-43cb-9b10-62ab69ee66e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:11.823912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627b519-2a3e-43cb-9b10-62ab69ee66e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:11.825619 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627b519-2a3e-43cb-9b10-62ab69ee66e5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:11.838571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b077b8-5d37-4140-ae49-0d88c24a0f3e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:11.851658 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:11.857218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:11.858229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:11.858229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] PATH_INFO: `/v3/projects/6029b95f0ef2499792f5ee726b91372e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:11.860135 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6029b95f0ef2499792f5ee726b91372e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:11.860784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 859/1726] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:11.861847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b519-2a3e-43cb-9b10-62ab69ee66e5 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:11.865401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:11.904714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b519-2a3e-43cb-9b10-62ab69ee66e5 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:11.916830 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eedd41-b58c-4c9a-945f-49d76465d18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:11.917775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eedd41-b58c-4c9a-945f-49d76465d18a admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:11.918027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eedd41-b58c-4c9a-945f-49d76465d18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:11.918304 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eedd41-b58c-4c9a-945f-49d76465d18a admin admin] PATH_INFO: `/v3/projects/b9b12534bed5481281f07a68b42c8c74/users/4018520205f8493d89c567db50f3ded9/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:11.927293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eedd41-b58c-4c9a-945f-49d76465d18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b12534bed5481281f07a68b42c8c74, user_id=4018520205f8493d89c567db50f3ded9, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:11.935805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eedd41-b58c-4c9a-945f-49d76465d18a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:11.999475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:12.028858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 860/1727] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:11 2022] PUT /identity/v3/projects/b9b12534bed5481281f07a68b42c8c74/users/4018520205f8493d89c567db50f3ded9/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:12.033505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f328-7f55-4203-89a7-f679845e92ed None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:12.036410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f328-7f55-4203-89a7-f679845e92ed None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:12.036410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f328-7f55-4203-89a7-f679845e92ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:12.151037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f414f328-7f55-4203-89a7-f679845e92ed None None] MFA Rules not processed for user `4018520205f8493d89c567db50f3ded9`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:12.154332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f414f328-7f55-4203-89a7-f679845e92ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:12.214076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6029b95f0ef2499792f5ee726b91372e', 'request_id': 'req-68dbfb27-b6f0-412f-bd10-aeb445d6f472'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.227352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6029b95f0ef2499792f5ee726b91372e', 'request_id': 'req-68dbfb27-b6f0-412f-bd10-aeb445d6f472'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.251954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6029b95f0ef2499792f5ee726b91372e', 'request_id': 'req-68dbfb27-b6f0-412f-bd10-aeb445d6f472'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.315417 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 861/1728] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:12 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:12.323183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414f328-7f55-4203-89a7-f679845e92ed None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:12.323183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f414f328-7f55-4203-89a7-f679845e92ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:12.437509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414f328-7f55-4203-89a7-f679845e92ed None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:12.454297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] The token cache is being invalidate because project 6029b95f0ef2499792f5ee726b91372e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:12.454845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.456928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.459132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 868/1729] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:11 2022] DELETE /identity/v3/projects/6029b95f0ef2499792f5ee726b91372e => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:12.460285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:12.462605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:12.532419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:12.534222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:12.535000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:12.535512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] PATH_INFO: `/v3/users/5ee9c0f92a484017aed53b78f389a24c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:12.537758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee9c0f92a484017aed53b78f389a24c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:12.541004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:12.618166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbfb27-b6f0-412f-bd10-aeb445d6f472 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:12.621854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe96699-a2dc-4ddd-8505-11820eee6a65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:12.622916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe96699-a2dc-4ddd-8505-11820eee6a65 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:12.624119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe96699-a2dc-4ddd-8505-11820eee6a65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:12.624585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe96699-a2dc-4ddd-8505-11820eee6a65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:12.628185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-efe96699-a2dc-4ddd-8505-11820eee6a65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:12.724681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe96699-a2dc-4ddd-8505-11820eee6a65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:12.726634 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe96699-a2dc-4ddd-8505-11820eee6a65 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:12.756451 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 869/1730] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:12 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:12.758853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe96699-a2dc-4ddd-8505-11820eee6a65 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:12.763745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-efe96699-a2dc-4ddd-8505-11820eee6a65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:12.797488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe96699-a2dc-4ddd-8505-11820eee6a65 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:12.802804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:12.803701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:12.803984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:12.805050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] PATH_INFO: `/v3/users/5724e189cd504fd5b76ec3569f5d37e3` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:12.806739 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5724e189cd504fd5b76ec3569f5d37e3)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:12.810034 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:12.896133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee9c0f92a484017aed53b78f389a24c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.897095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee9c0f92a484017aed53b78f389a24c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.899561 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee9c0f92a484017aed53b78f389a24c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.913310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee9c0f92a484017aed53b78f389a24c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.922575 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee9c0f92a484017aed53b78f389a24c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.025511 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 862/1731] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:12 2022] DELETE /identity/v3/users/5ee9c0f92a484017aed53b78f389a24c => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:13.026759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:13.036931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.134383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5724e189cd504fd5b76ec3569f5d37e3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.135653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5724e189cd504fd5b76ec3569f5d37e3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.182778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17372616-9a77-470a-8558-796fec1d8ee2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:13.188442 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028c8af-161f-45de-9c01-a616198a8dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:13.189629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028c8af-161f-45de-9c01-a616198a8dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.193287 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028c8af-161f-45de-9c01-a616198a8dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.194254 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028c8af-161f-45de-9c01-a616198a8dee admin admin] PATH_INFO: `/v3/projects/b486a0d20533487abf8c2ee29aaed8b0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.197039 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028c8af-161f-45de-9c01-a616198a8dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b486a0d20533487abf8c2ee29aaed8b0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:13.200065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028c8af-161f-45de-9c01-a616198a8dee admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:13.226036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5724e189cd504fd5b76ec3569f5d37e3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.242749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5724e189cd504fd5b76ec3569f5d37e3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.259465 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5724e189cd504fd5b76ec3569f5d37e3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.275492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 870/1732] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:12 2022] DELETE /identity/v3/users/5724e189cd504fd5b76ec3569f5d37e3 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:13.278270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:13.282190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.418199 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3028c8af-161f-45de-9c01-a616198a8dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b486a0d20533487abf8c2ee29aaed8b0', 'request_id': 'req-3028c8af-161f-45de-9c01-a616198a8dee'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.421884 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb627f-b112-4be6-a47a-91c0dc5b8ab3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:13.574701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9198f-fe68-456b-8b58-6a84532e0343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:13.576065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9198f-fe68-456b-8b58-6a84532e0343 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.576599 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9198f-fe68-456b-8b58-6a84532e0343 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.576765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9198f-fe68-456b-8b58-6a84532e0343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.582970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-34e9198f-fe68-456b-8b58-6a84532e0343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.603997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3028c8af-161f-45de-9c01-a616198a8dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b486a0d20533487abf8c2ee29aaed8b0', 'request_id': 'req-3028c8af-161f-45de-9c01-a616198a8dee'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.625085 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3028c8af-161f-45de-9c01-a616198a8dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b486a0d20533487abf8c2ee29aaed8b0', 'request_id': 'req-3028c8af-161f-45de-9c01-a616198a8dee'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.696221 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3028c8af-161f-45de-9c01-a616198a8dee admin admin] The token cache is being invalidate because project b486a0d20533487abf8c2ee29aaed8b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:13.696904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3028c8af-161f-45de-9c01-a616198a8dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.703461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-3028c8af-161f-45de-9c01-a616198a8dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.714259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 863/1733] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:13 2022] DELETE /identity/v3/projects/b486a0d20533487abf8c2ee29aaed8b0 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:13.716119 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da2c71-cabc-4ef8-950c-d119fb7f79e3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.716418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da2c71-cabc-4ef8-950c-d119fb7f79e3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.716725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da2c71-cabc-4ef8-950c-d119fb7f79e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.738126 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9198f-fe68-456b-8b58-6a84532e0343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:13.740222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9198f-fe68-456b-8b58-6a84532e0343 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:13.767944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 871/1734] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:13.771533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a59ce-0330-427a-8dfb-24b5b25bf58c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.772445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a59ce-0330-427a-8dfb-24b5b25bf58c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.775275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a59ce-0330-427a-8dfb-24b5b25bf58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.795712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f6da2c71-cabc-4ef8-950c-d119fb7f79e3 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:13.797358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f6da2c71-cabc-4ef8-950c-d119fb7f79e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.818388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b97a59ce-0330-427a-8dfb-24b5b25bf58c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:13.820425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b97a59ce-0330-427a-8dfb-24b5b25bf58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.959910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 864/1735] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:13.986135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da2c71-cabc-4ef8-950c-d119fb7f79e3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:13.987594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f6da2c71-cabc-4ef8-950c-d119fb7f79e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:14.007715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 872/1736] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:14.029016 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75820fe8-b86e-4a2e-ba77-a1d80da3854b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.029308 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75820fe8-b86e-4a2e-ba77-a1d80da3854b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.029587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75820fe8-b86e-4a2e-ba77-a1d80da3854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.059266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-75820fe8-b86e-4a2e-ba77-a1d80da3854b None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:14.061777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-75820fe8-b86e-4a2e-ba77-a1d80da3854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:14.090487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 873/1737] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:14.108322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da2c71-cabc-4ef8-950c-d119fb7f79e3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.110540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75820fe8-b86e-4a2e-ba77-a1d80da3854b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.113412 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78276068-7e40-4e7f-856b-ab98d803de99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.114460 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78276068-7e40-4e7f-856b-ab98d803de99 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.115131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78276068-7e40-4e7f-856b-ab98d803de99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.115655 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78276068-7e40-4e7f-856b-ab98d803de99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.129485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78276068-7e40-4e7f-856b-ab98d803de99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.132134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78276068-7e40-4e7f-856b-ab98d803de99 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.146754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75820fe8-b86e-4a2e-ba77-a1d80da3854b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.148094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 865/1738] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:14.154525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e3342-8759-43b3-b36e-5cbd9e9ea75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.156001 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e3342-8759-43b3-b36e-5cbd9e9ea75f admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.156363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e3342-8759-43b3-b36e-5cbd9e9ea75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.157011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e3342-8759-43b3-b36e-5cbd9e9ea75f admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.157931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e3342-8759-43b3-b36e-5cbd9e9ea75f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:14.159368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e3342-8759-43b3-b36e-5cbd9e9ea75f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.161874 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e3342-8759-43b3-b36e-5cbd9e9ea75f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.177743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bc8db-90ef-4f6a-8d2b-804815066f0d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.177743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bc8db-90ef-4f6a-8d2b-804815066f0d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.177743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bc8db-90ef-4f6a-8d2b-804815066f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.182614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 874/1739] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:14.187422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e3342-8759-43b3-b36e-5cbd9e9ea75f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.204844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e3342-8759-43b3-b36e-5cbd9e9ea75f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.213605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf4bee-7e9b-403e-ae05-7f615ace3dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.213826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-724bc8db-90ef-4f6a-8d2b-804815066f0d None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:14.214948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf4bee-7e9b-403e-ae05-7f615ace3dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.215188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-724bc8db-90ef-4f6a-8d2b-804815066f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:14.215840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf4bee-7e9b-403e-ae05-7f615ace3dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.216401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf4bee-7e9b-403e-ae05-7f615ace3dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.217548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf4bee-7e9b-403e-ae05-7f615ace3dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.220182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf4bee-7e9b-403e-ae05-7f615ace3dfd admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.346739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 866/1740] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 23 13:13:14.387466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bc8db-90ef-4f6a-8d2b-804815066f0d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.389252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 875/1741] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:14 2022] POST /identity/v3/projects => generated 405 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:14.409822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bc8db-90ef-4f6a-8d2b-804815066f0d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.424047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:14.499238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:14.505762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7e6b9-8caf-4f8b-9a88-d7c451b6e588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.508012 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7e6b9-8caf-4f8b-9a88-d7c451b6e588 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.508447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7e6b9-8caf-4f8b-9a88-d7c451b6e588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.509701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7e6b9-8caf-4f8b-9a88-d7c451b6e588 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.510605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7e6b9-8caf-4f8b-9a88-d7c451b6e588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.512907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7e6b9-8caf-4f8b-9a88-d7c451b6e588 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.566748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf4bee-7e9b-403e-ae05-7f615ace3dfd admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.568956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-55cf4bee-7e9b-403e-ae05-7f615ace3dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:14.582673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf4bee-7e9b-403e-ae05-7f615ace3dfd admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.588248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.589174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.589459 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.589752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] PATH_INFO: `/v3/users/f2b71ad35f044169a58eb6b8aab031b8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.591090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b71ad35f044169a58eb6b8aab031b8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.593057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.647574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 867/1742] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:14 2022] POST /identity/v3/users => generated 303 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:14.650452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7e6b9-8caf-4f8b-9a88-d7c451b6e588 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.665874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7e6b9-8caf-4f8b-9a88-d7c451b6e588 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.672583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c045d9-084d-4dbd-9b74-80bd9a97b9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.673468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c045d9-084d-4dbd-9b74-80bd9a97b9cd admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.673825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c045d9-084d-4dbd-9b74-80bd9a97b9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.674238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c045d9-084d-4dbd-9b74-80bd9a97b9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.675048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c045d9-084d-4dbd-9b74-80bd9a97b9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.677009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c045d9-084d-4dbd-9b74-80bd9a97b9cd admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.708380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 868/1743] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:14.709329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c045d9-084d-4dbd-9b74-80bd9a97b9cd admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.720589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c045d9-084d-4dbd-9b74-80bd9a97b9cd admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.726173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73d025-3608-482d-9e5e-6ace1bb9b232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.726701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73d025-3608-482d-9e5e-6ace1bb9b232 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.726994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73d025-3608-482d-9e5e-6ace1bb9b232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.727515 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73d025-3608-482d-9e5e-6ace1bb9b232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.727987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73d025-3608-482d-9e5e-6ace1bb9b232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.729642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73d025-3608-482d-9e5e-6ace1bb9b232 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.742513 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 869/1744] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:14.746786 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73d025-3608-482d-9e5e-6ace1bb9b232 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.756590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73d025-3608-482d-9e5e-6ace1bb9b232 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.765415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547130f3-a474-429d-8e19-f93070a31c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.766324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547130f3-a474-429d-8e19-f93070a31c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.766610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547130f3-a474-429d-8e19-f93070a31c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.766882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547130f3-a474-429d-8e19-f93070a31c89 admin admin] PATH_INFO: `/v3/projects/db402ca32d8b4c8097848132281fed01/users/9b7a0d1b8967491e822ae8b524a9642a/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.793000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547130f3-a474-429d-8e19-f93070a31c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db402ca32d8b4c8097848132281fed01, user_id=9b7a0d1b8967491e822ae8b524a9642a, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.796274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547130f3-a474-429d-8e19-f93070a31c89 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.975003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 870/1745] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:14 2022] PUT /identity/v3/projects/db402ca32d8b4c8097848132281fed01/users/9b7a0d1b8967491e822ae8b524a9642a/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:14.975003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547130f3-a474-429d-8e19-f93070a31c89 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.975003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-547130f3-a474-429d-8e19-f93070a31c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:14.997202 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b71ad35f044169a58eb6b8aab031b8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.998371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b71ad35f044169a58eb6b8aab031b8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.105636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547130f3-a474-429d-8e19-f93070a31c89 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:15.111605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b71ad35f044169a58eb6b8aab031b8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.116384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f853a53-69ba-494c-9c75-2bff9b772ee3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:15.123732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853a53-69ba-494c-9c75-2bff9b772ee3 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.123732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853a53-69ba-494c-9c75-2bff9b772ee3 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.123732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853a53-69ba-494c-9c75-2bff9b772ee3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.124841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5f853a53-69ba-494c-9c75-2bff9b772ee3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:15.163615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b71ad35f044169a58eb6b8aab031b8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.198703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b71ad35f044169a58eb6b8aab031b8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.219356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 876/1746] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:14 2022] DELETE /identity/v3/users/f2b71ad35f044169a58eb6b8aab031b8 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:15.219356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:15.221722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:15.262790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f853a53-69ba-494c-9c75-2bff9b772ee3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:15.264686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f853a53-69ba-494c-9c75-2bff9b772ee3 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:15.285703 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 871/1747] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:13:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:13:15.287178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf618-2315-4631-bbb8-d6ab6ca5c84a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.287632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf618-2315-4631-bbb8-d6ab6ca5c84a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.288062 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf618-2315-4631-bbb8-d6ab6ca5c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.367776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a06cf618-2315-4631-bbb8-d6ab6ca5c84a None None] MFA Rules not processed for user `9b7a0d1b8967491e822ae8b524a9642a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:15.377718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a06cf618-2315-4631-bbb8-d6ab6ca5c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:15.469758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb303e2-f4b9-4fe4-98d8-8859e41f2685 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:15.489592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:15.490918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.491518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.499906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] PATH_INFO: `/v3/projects/ea0a014cec71409083995eae5794e9ba` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.514061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0a014cec71409083995eae5794e9ba)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:15.514061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:15.553921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 872/1748] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:15.555246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fa6af-2d86-47af-ab06-5897f4e94df7 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.555544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fa6af-2d86-47af-ab06-5897f4e94df7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.555830 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fa6af-2d86-47af-ab06-5897f4e94df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.601066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a73fa6af-2d86-47af-ab06-5897f4e94df7 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:15.603107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a73fa6af-2d86-47af-ab06-5897f4e94df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:15.620756 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:15.641048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 873/1749] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:15.642414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fa6af-2d86-47af-ab06-5897f4e94df7 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:15.644696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a73fa6af-2d86-47af-ab06-5897f4e94df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:15.663281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fa6af-2d86-47af-ab06-5897f4e94df7 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:15.669938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e309d07-6411-4cab-9c8b-f3e404204e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:15.670517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e309d07-6411-4cab-9c8b-f3e404204e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.670869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e309d07-6411-4cab-9c8b-f3e404204e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.671427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e309d07-6411-4cab-9c8b-f3e404204e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.672207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e309d07-6411-4cab-9c8b-f3e404204e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:15.675221 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e309d07-6411-4cab-9c8b-f3e404204e70 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:15.745995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0a014cec71409083995eae5794e9ba', 'request_id': 'req-f0eb67a8-9cdb-48c3-aace-f46394f046b9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.753164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0a014cec71409083995eae5794e9ba', 'request_id': 'req-f0eb67a8-9cdb-48c3-aace-f46394f046b9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.761961 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0a014cec71409083995eae5794e9ba', 'request_id': 'req-f0eb67a8-9cdb-48c3-aace-f46394f046b9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.827150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 874/1750] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:15 2022] POST /identity/v3/projects => generated 403 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:15.831341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02247991-6fe8-4e54-8211-29081517b755 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.831642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02247991-6fe8-4e54-8211-29081517b755 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.831929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02247991-6fe8-4e54-8211-29081517b755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.894364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] The token cache is being invalidate because project ea0a014cec71409083995eae5794e9ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:15.894662 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.898046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.905531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 877/1751] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:15 2022] DELETE /identity/v3/projects/ea0a014cec71409083995eae5794e9ba => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:15.906631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:15.912186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:15.928817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-02247991-6fe8-4e54-8211-29081517b755 None None] MFA Rules not processed for user `b1eb257517674c63840d6a2090eb2200`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:15.928817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-02247991-6fe8-4e54-8211-29081517b755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.030642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb67a8-9cdb-48c3-aace-f46394f046b9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.083147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 875/1752] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jun 23 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:16.084553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02247991-6fe8-4e54-8211-29081517b755 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.088091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-02247991-6fe8-4e54-8211-29081517b755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.139209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371393b4-904b-43ee-b758-61b51ae3059e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.140110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371393b4-904b-43ee-b758-61b51ae3059e service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.140459 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371393b4-904b-43ee-b758-61b51ae3059e service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.140916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371393b4-904b-43ee-b758-61b51ae3059e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.146080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-371393b4-904b-43ee-b758-61b51ae3059e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.337201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02247991-6fe8-4e54-8211-29081517b755 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.343907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a570fdd-81a7-4c7a-93e0-9f595780aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.344872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570fdd-81a7-4c7a-93e0-9f595780aff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.349535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570fdd-81a7-4c7a-93e0-9f595780aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.349535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570fdd-81a7-4c7a-93e0-9f595780aff6 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.349535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a570fdd-81a7-4c7a-93e0-9f595780aff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.349535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a570fdd-81a7-4c7a-93e0-9f595780aff6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.349833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371393b4-904b-43ee-b758-61b51ae3059e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.351809 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371393b4-904b-43ee-b758-61b51ae3059e service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.381404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 878/1753] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:16.387990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfea3a-b8a1-4149-ac28-d944e6872e1e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.387990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfea3a-b8a1-4149-ac28-d944e6872e1e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.387990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfea3a-b8a1-4149-ac28-d944e6872e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.410240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-41bfea3a-b8a1-4149-ac28-d944e6872e1e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:16.411554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-41bfea3a-b8a1-4149-ac28-d944e6872e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.430766 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 879/1754] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:16.431686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfea3a-b8a1-4149-ac28-d944e6872e1e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.436459 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-41bfea3a-b8a1-4149-ac28-d944e6872e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.454231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfea3a-b8a1-4149-ac28-d944e6872e1e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.479383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507c661-92d7-4225-919e-c520298c9316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.483352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507c661-92d7-4225-919e-c520298c9316 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.483352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507c661-92d7-4225-919e-c520298c9316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.483352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507c661-92d7-4225-919e-c520298c9316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.503634 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507c661-92d7-4225-919e-c520298c9316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.512447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507c661-92d7-4225-919e-c520298c9316 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.518388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 876/1755] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:16 2022] POST /identity/v3/users => generated 308 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:16.518388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a570fdd-81a7-4c7a-93e0-9f595780aff6 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.520984 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7a570fdd-81a7-4c7a-93e0-9f595780aff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.538072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a570fdd-81a7-4c7a-93e0-9f595780aff6 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.548842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 880/1756] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:16.558423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714805b-64e7-4c75-b0bb-2342a97c2364 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.558423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714805b-64e7-4c75-b0bb-2342a97c2364 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.558423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714805b-64e7-4c75-b0bb-2342a97c2364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.558766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.558766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.558766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.558766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] PATH_INFO: `/v3/projects/972bf6bb86f84eacaf95569b18bada3d` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.560135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] RBAC: Authorizing `identity:delete_project(project_id=972bf6bb86f84eacaf95569b18bada3d)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.562911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.608174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6714805b-64e7-4c75-b0bb-2342a97c2364 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:16.610352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6714805b-64e7-4c75-b0bb-2342a97c2364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.651145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 881/1757] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:16.652009 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714805b-64e7-4c75-b0bb-2342a97c2364 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.680559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714805b-64e7-4c75-b0bb-2342a97c2364 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.703009 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdf08d-cfcb-402a-a696-38d5bd6598e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.703715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdf08d-cfcb-402a-a696-38d5bd6598e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.703998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdf08d-cfcb-402a-a696-38d5bd6598e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.704272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdf08d-cfcb-402a-a696-38d5bd6598e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.705808 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdf08d-cfcb-402a-a696-38d5bd6598e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.710436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdf08d-cfcb-402a-a696-38d5bd6598e6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.737930 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972bf6bb86f84eacaf95569b18bada3d', 'request_id': 'req-f37e9176-a252-405b-9ce7-df343cba488a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:16.745181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 882/1758] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:16.746301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdf08d-cfcb-402a-a696-38d5bd6598e6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.772307 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdf08d-cfcb-402a-a696-38d5bd6598e6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.800245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:16.835556 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972bf6bb86f84eacaf95569b18bada3d', 'request_id': 'req-f37e9176-a252-405b-9ce7-df343cba488a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:16.847674 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972bf6bb86f84eacaf95569b18bada3d', 'request_id': 'req-f37e9176-a252-405b-9ce7-df343cba488a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:16.897297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] The token cache is being invalidate because project 972bf6bb86f84eacaf95569b18bada3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:16.897662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:16.898345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:16.906509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 877/1759] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:16 2022] DELETE /identity/v3/projects/972bf6bb86f84eacaf95569b18bada3d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:16.907869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.919506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.930068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:16.948851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164da3c-7380-4f98-83ff-da6c418fe96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.949427 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164da3c-7380-4f98-83ff-da6c418fe96a admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.949715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164da3c-7380-4f98-83ff-da6c418fe96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.949996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164da3c-7380-4f98-83ff-da6c418fe96a admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.951832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164da3c-7380-4f98-83ff-da6c418fe96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:16.952152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164da3c-7380-4f98-83ff-da6c418fe96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.963318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164da3c-7380-4f98-83ff-da6c418fe96a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.986812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e9176-a252-405b-9ce7-df343cba488a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.996940 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 883/1760] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:16.997960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164da3c-7380-4f98-83ff-da6c418fe96a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.001102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a164da3c-7380-4f98-83ff-da6c418fe96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:17.016078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac053b-4e4a-48d7-8e40-609a3c72dd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.017470 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac053b-4e4a-48d7-8e40-609a3c72dd3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.018307 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac053b-4e4a-48d7-8e40-609a3c72dd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.018764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac053b-4e4a-48d7-8e40-609a3c72dd3c admin admin] PATH_INFO: `/v3/projects/c8aa204b06cb48e6ba04d4c0d239054a/users/d60f996df09b42e1b5daa12c54e40f58/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.058465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac053b-4e4a-48d7-8e40-609a3c72dd3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8aa204b06cb48e6ba04d4c0d239054a, user_id=d60f996df09b42e1b5daa12c54e40f58, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.062206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac053b-4e4a-48d7-8e40-609a3c72dd3c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.085356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164da3c-7380-4f98-83ff-da6c418fe96a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.104404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.105719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.106124 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.106551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] PATH_INFO: `/v3/users/32a4651a3afc492399ddee1da60295bb` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.109450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a4651a3afc492399ddee1da60295bb)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.112345 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.183899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 878/1761] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:16 2022] PUT /identity/v3/projects/c8aa204b06cb48e6ba04d4c0d239054a/users/d60f996df09b42e1b5daa12c54e40f58/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:17.185183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac053b-4e4a-48d7-8e40-609a3c72dd3c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.187019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7eac053b-4e4a-48d7-8e40-609a3c72dd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:17.570126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac053b-4e4a-48d7-8e40-609a3c72dd3c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.576427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23447e4-bcaf-4ce9-96ba-dc7593b46727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.577949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23447e4-bcaf-4ce9-96ba-dc7593b46727 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.577949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23447e4-bcaf-4ce9-96ba-dc7593b46727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.577949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23447e4-bcaf-4ce9-96ba-dc7593b46727 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.578895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23447e4-bcaf-4ce9-96ba-dc7593b46727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.586688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23447e4-bcaf-4ce9-96ba-dc7593b46727 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.586909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a4651a3afc492399ddee1da60295bb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.588871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a4651a3afc492399ddee1da60295bb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.901300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a4651a3afc492399ddee1da60295bb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.925225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 879/1762] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:17 2022] POST /identity/v3/projects => generated 377 bytes in 737 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:17.925225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23447e4-bcaf-4ce9-96ba-dc7593b46727 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.945104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b23447e4-bcaf-4ce9-96ba-dc7593b46727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:17.957170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a4651a3afc492399ddee1da60295bb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.986462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a4651a3afc492399ddee1da60295bb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:18.017025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 884/1763] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:16 2022] DELETE /identity/v3/users/32a4651a3afc492399ddee1da60295bb => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:18.030840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.033890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.148344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23447e4-bcaf-4ce9-96ba-dc7593b46727 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.226458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbfd07-a824-41c5-8918-59412c3f58e2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.245029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b15779-f529-4bad-a4aa-b418c8806890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.246445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b15779-f529-4bad-a4aa-b418c8806890 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.246859 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b15779-f529-4bad-a4aa-b418c8806890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.247237 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b15779-f529-4bad-a4aa-b418c8806890 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.248063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b15779-f529-4bad-a4aa-b418c8806890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.251035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b15779-f529-4bad-a4aa-b418c8806890 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.311053 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382384b-591b-4780-87b6-510b0a6de23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.311975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382384b-591b-4780-87b6-510b0a6de23c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.312458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382384b-591b-4780-87b6-510b0a6de23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.313000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382384b-591b-4780-87b6-510b0a6de23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.313892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382384b-591b-4780-87b6-510b0a6de23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.315589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382384b-591b-4780-87b6-510b0a6de23c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.350723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 880/1764] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:18.352472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382384b-591b-4780-87b6-510b0a6de23c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.356776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f382384b-591b-4780-87b6-510b0a6de23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.380434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382384b-591b-4780-87b6-510b0a6de23c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.387019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53128aa-f893-49b6-8aa8-736085f85ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.388260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53128aa-f893-49b6-8aa8-736085f85ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.388806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53128aa-f893-49b6-8aa8-736085f85ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.389293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53128aa-f893-49b6-8aa8-736085f85ffc admin admin] PATH_INFO: `/v3/projects/2d0656b9a93b4efb8a60496b7337f6f0` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.390995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53128aa-f893-49b6-8aa8-736085f85ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0656b9a93b4efb8a60496b7337f6f0)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.394123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53128aa-f893-49b6-8aa8-736085f85ffc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.462332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 885/1765] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:18 2022] POST /identity/v3/users => generated 289 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:18.463459 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b15779-f529-4bad-a4aa-b418c8806890 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.478979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b15779-f529-4bad-a4aa-b418c8806890 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.484986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ec23a-4b32-4421-b759-24e91523fca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.485993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ec23a-4b32-4421-b759-24e91523fca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.486478 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ec23a-4b32-4421-b759-24e91523fca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.486762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ec23a-4b32-4421-b759-24e91523fca2 admin admin] PATH_INFO: `/v3/projects/c8aa204b06cb48e6ba04d4c0d239054a/users/d60f996df09b42e1b5daa12c54e40f58/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.488765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ec23a-4b32-4421-b759-24e91523fca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8aa204b06cb48e6ba04d4c0d239054a, user_id=d60f996df09b42e1b5daa12c54e40f58, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.494808 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ec23a-4b32-4421-b759-24e91523fca2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.504703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 886/1766] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:18 2022] PUT /identity/v3/projects/c8aa204b06cb48e6ba04d4c0d239054a/users/d60f996df09b42e1b5daa12c54e40f58/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:18.505810 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ec23a-4b32-4421-b759-24e91523fca2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.602664 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a53128aa-f893-49b6-8aa8-736085f85ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0656b9a93b4efb8a60496b7337f6f0', 'request_id': 'req-a53128aa-f893-49b6-8aa8-736085f85ffc'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:18.665669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ec23a-4b32-4421-b759-24e91523fca2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.692435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a53128aa-f893-49b6-8aa8-736085f85ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0656b9a93b4efb8a60496b7337f6f0', 'request_id': 'req-a53128aa-f893-49b6-8aa8-736085f85ffc'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:18.701465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a53128aa-f893-49b6-8aa8-736085f85ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0656b9a93b4efb8a60496b7337f6f0', 'request_id': 'req-a53128aa-f893-49b6-8aa8-736085f85ffc'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:18.744044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a53128aa-f893-49b6-8aa8-736085f85ffc admin admin] The token cache is being invalidate because project 2d0656b9a93b4efb8a60496b7337f6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:18.744345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a53128aa-f893-49b6-8aa8-736085f85ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:18.747707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a53128aa-f893-49b6-8aa8-736085f85ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:18.751035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 881/1767] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:18 2022] DELETE /identity/v3/projects/2d0656b9a93b4efb8a60496b7337f6f0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:18.758663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b3b1d-582f-44af-9969-00ed35100fca None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.761205 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b3b1d-582f-44af-9969-00ed35100fca None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.762429 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b3b1d-582f-44af-9969-00ed35100fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.826824 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b18b3b1d-582f-44af-9969-00ed35100fca None None] MFA Rules not processed for user `d60f996df09b42e1b5daa12c54e40f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:18.837607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e95597-c472-48db-97d1-202142e1937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.838524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e95597-c472-48db-97d1-202142e1937d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.839449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e95597-c472-48db-97d1-202142e1937d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.839449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e95597-c472-48db-97d1-202142e1937d admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.840049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e95597-c472-48db-97d1-202142e1937d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.840796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b18b3b1d-582f-44af-9969-00ed35100fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.842065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e95597-c472-48db-97d1-202142e1937d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.864148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 887/1768] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:18.864148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410a9ae-708c-47c0-a7f8-11b8f3a5cb82 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.864148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410a9ae-708c-47c0-a7f8-11b8f3a5cb82 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.864148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410a9ae-708c-47c0-a7f8-11b8f3a5cb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.914611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7410a9ae-708c-47c0-a7f8-11b8f3a5cb82 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:18.926646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7410a9ae-708c-47c0-a7f8-11b8f3a5cb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.973035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 888/1769] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:18.974632 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410a9ae-708c-47c0-a7f8-11b8f3a5cb82 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.977647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7410a9ae-708c-47c0-a7f8-11b8f3a5cb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:19.005877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410a9ae-708c-47c0-a7f8-11b8f3a5cb82 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.011588 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c8515-8e8f-45fb-875a-131cb0b58e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.012752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c8515-8e8f-45fb-875a-131cb0b58e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.012752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c8515-8e8f-45fb-875a-131cb0b58e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.021204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c8515-8e8f-45fb-875a-131cb0b58e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.022091 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c8515-8e8f-45fb-875a-131cb0b58e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.024450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c8515-8e8f-45fb-875a-131cb0b58e8a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.047982 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 889/1770] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:19.049348 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5d120-e2bf-4f5b-ac19-fc3b50588557 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.049644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5d120-e2bf-4f5b-ac19-fc3b50588557 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.049925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5d120-e2bf-4f5b-ac19-fc3b50588557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.087891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 882/1771] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:19.089066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b3b1d-582f-44af-9969-00ed35100fca None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:19.127096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-82b5d120-e2bf-4f5b-ac19-fc3b50588557 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:19.128388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-82b5d120-e2bf-4f5b-ac19-fc3b50588557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:19.130769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b3b1d-582f-44af-9969-00ed35100fca None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.140180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079899c-cd66-4f09-9d6b-d1ff54ae73ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.144238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079899c-cd66-4f09-9d6b-d1ff54ae73ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.145263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079899c-cd66-4f09-9d6b-d1ff54ae73ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.146184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079899c-cd66-4f09-9d6b-d1ff54ae73ec admin admin] PATH_INFO: `/v3/projects/7224a6550f1042a4bedb8ec3b19ed7bb/users/daf07074f155449aa5e39c5b4253db2e/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.157222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 890/1772] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:19.162328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5d120-e2bf-4f5b-ac19-fc3b50588557 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:19.164059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-82b5d120-e2bf-4f5b-ac19-fc3b50588557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:19.185542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079899c-cd66-4f09-9d6b-d1ff54ae73ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7224a6550f1042a4bedb8ec3b19ed7bb, user_id=daf07074f155449aa5e39c5b4253db2e, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.190998 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079899c-cd66-4f09-9d6b-d1ff54ae73ec admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.201420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:19.282652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5d120-e2bf-4f5b-ac19-fc3b50588557 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.288540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de711f6e-a930-4959-8d03-e25bfc3d2e3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.290195 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de711f6e-a930-4959-8d03-e25bfc3d2e3b service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.290716 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de711f6e-a930-4959-8d03-e25bfc3d2e3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.291350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de711f6e-a930-4959-8d03-e25bfc3d2e3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.308368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de711f6e-a930-4959-8d03-e25bfc3d2e3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.308368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de711f6e-a930-4959-8d03-e25bfc3d2e3b service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.323776 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 891/1773] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:19.324911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de711f6e-a930-4959-8d03-e25bfc3d2e3b service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:19.341593 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 883/1774] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:19 2022] PUT /identity/v3/projects/7224a6550f1042a4bedb8ec3b19ed7bb/users/daf07074f155449aa5e39c5b4253db2e/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:19.350331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de711f6e-a930-4959-8d03-e25bfc3d2e3b service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.353694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11571cbf-8501-41a3-ac9b-2a3bee6895c3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.354336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11571cbf-8501-41a3-ac9b-2a3bee6895c3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.355194 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11571cbf-8501-41a3-ac9b-2a3bee6895c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.457024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-11571cbf-8501-41a3-ac9b-2a3bee6895c3 None None] MFA Rules not processed for user `daf07074f155449aa5e39c5b4253db2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:19.463779 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-11571cbf-8501-41a3-ac9b-2a3bee6895c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:19.578449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b9ef9-897d-45eb-bb3e-656065f3145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.581254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b9ef9-897d-45eb-bb3e-656065f3145f admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.583935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b9ef9-897d-45eb-bb3e-656065f3145f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.585424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b9ef9-897d-45eb-bb3e-656065f3145f admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.588854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b9ef9-897d-45eb-bb3e-656065f3145f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:19.592270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b9ef9-897d-45eb-bb3e-656065f3145f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.601737 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b9ef9-897d-45eb-bb3e-656065f3145f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.649280 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 892/1775] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:19.651070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b9ef9-897d-45eb-bb3e-656065f3145f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:19.658482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8f8b9ef9-897d-45eb-bb3e-656065f3145f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:19.683381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b9ef9-897d-45eb-bb3e-656065f3145f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.699903 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.700948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.701666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.702327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] PATH_INFO: `/v3/users/9b7a0d1b8967491e822ae8b524a9642a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.704593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7a0d1b8967491e822ae8b524a9642a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.710757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.776229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 884/1776] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:19.776229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11571cbf-8501-41a3-ac9b-2a3bee6895c3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:19.818327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11571cbf-8501-41a3-ac9b-2a3bee6895c3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.832995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4777f-72fc-4fe2-a50d-be57e83c7686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.835366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4777f-72fc-4fe2-a50d-be57e83c7686 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.836326 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4777f-72fc-4fe2-a50d-be57e83c7686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.836957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4777f-72fc-4fe2-a50d-be57e83c7686 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.851695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4777f-72fc-4fe2-a50d-be57e83c7686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.853816 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4777f-72fc-4fe2-a50d-be57e83c7686 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.999674 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 885/1777] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:19 2022] POST /identity/v3/projects => generated 369 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:20.001114 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4777f-72fc-4fe2-a50d-be57e83c7686 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.084605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7a0d1b8967491e822ae8b524a9642a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:20.086612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7a0d1b8967491e822ae8b524a9642a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:20.102544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:20.168778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7a0d1b8967491e822ae8b524a9642a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:20.190902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7a0d1b8967491e822ae8b524a9642a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:20.215826 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7a0d1b8967491e822ae8b524a9642a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:20.244845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 893/1778] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:19 2022] DELETE /identity/v3/users/9b7a0d1b8967491e822ae8b524a9642a => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:20.245893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.247770 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:20.249958 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4777f-72fc-4fe2-a50d-be57e83c7686 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:20.435652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec3365-8db2-4dc4-a404-6aedd7587d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:20.438509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec3365-8db2-4dc4-a404-6aedd7587d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.439149 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec3365-8db2-4dc4-a404-6aedd7587d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.439713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec3365-8db2-4dc4-a404-6aedd7587d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.444446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2156d9-1515-47e6-8f6a-298b04c9d039 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:20.449384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec3365-8db2-4dc4-a404-6aedd7587d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:20.454926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec3365-8db2-4dc4-a404-6aedd7587d60 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:20.480015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fed4db-b7c9-4f07-81b1-49720d06c7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:20.481325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fed4db-b7c9-4f07-81b1-49720d06c7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.485041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fed4db-b7c9-4f07-81b1-49720d06c7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.485460 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fed4db-b7c9-4f07-81b1-49720d06c7e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.487798 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fed4db-b7c9-4f07-81b1-49720d06c7e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:20.491822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fed4db-b7c9-4f07-81b1-49720d06c7e5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:20.600018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 894/1779] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:20 2022] POST /identity/v3/users => generated 285 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:20.600018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fed4db-b7c9-4f07-81b1-49720d06c7e5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.617107 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-93fed4db-b7c9-4f07-81b1-49720d06c7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:20.677090 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 886/1780] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:19 2022] POST /identity/v3/projects => generated 377 bytes in 677 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:20.678920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98c67a-5cf9-4ab4-a269-3b0c81f3a7cb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.679471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98c67a-5cf9-4ab4-a269-3b0c81f3a7cb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.680258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98c67a-5cf9-4ab4-a269-3b0c81f3a7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.685341 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fed4db-b7c9-4f07-81b1-49720d06c7e5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:20.749178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6d98c67a-5cf9-4ab4-a269-3b0c81f3a7cb None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:20.756929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6d98c67a-5cf9-4ab4-a269-3b0c81f3a7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:20.915311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:20.916346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.916761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.917072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] PATH_INFO: `/v3/projects/b76af948dabf4610b62a86d8c9dc9a49` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.919830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76af948dabf4610b62a86d8c9dc9a49)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:20.923164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:20.967631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 887/1781] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:20.967631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98c67a-5cf9-4ab4-a269-3b0c81f3a7cb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.990788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98c67a-5cf9-4ab4-a269-3b0c81f3a7cb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:21.010214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c26bb7-6764-46b9-bb42-15b4f8d8985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:21.011353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c26bb7-6764-46b9-bb42-15b4f8d8985c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.012110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c26bb7-6764-46b9-bb42-15b4f8d8985c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.015531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c26bb7-6764-46b9-bb42-15b4f8d8985c admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.016464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c26bb7-6764-46b9-bb42-15b4f8d8985c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:21.023660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c26bb7-6764-46b9-bb42-15b4f8d8985c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:21.053452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 888/1782] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:21.054956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c26bb7-6764-46b9-bb42-15b4f8d8985c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:21.060623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-13c26bb7-6764-46b9-bb42-15b4f8d8985c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:21.080201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c26bb7-6764-46b9-bb42-15b4f8d8985c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:21.088879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9997e0f-bbbd-49cf-a789-8ae45e645ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:21.089802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9997e0f-bbbd-49cf-a789-8ae45e645ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.090311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9997e0f-bbbd-49cf-a789-8ae45e645ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.090786 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9997e0f-bbbd-49cf-a789-8ae45e645ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.091861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9997e0f-bbbd-49cf-a789-8ae45e645ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:21.107743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9997e0f-bbbd-49cf-a789-8ae45e645ba7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:21.135368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76af948dabf4610b62a86d8c9dc9a49', 'request_id': 'req-ce701648-593b-4297-951d-c88b09955668'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:21.181211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76af948dabf4610b62a86d8c9dc9a49', 'request_id': 'req-ce701648-593b-4297-951d-c88b09955668'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:21.227328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76af948dabf4610b62a86d8c9dc9a49', 'request_id': 'req-ce701648-593b-4297-951d-c88b09955668'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:21.236382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 889/1783] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:21 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:21.236382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9997e0f-bbbd-49cf-a789-8ae45e645ba7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:21.243821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b9997e0f-bbbd-49cf-a789-8ae45e645ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:21.378321 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] The token cache is being invalidate because project b76af948dabf4610b62a86d8c9dc9a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:21.378878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:21.381100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:21.383200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 895/1784] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:20 2022] DELETE /identity/v3/projects/b76af948dabf4610b62a86d8c9dc9a49 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:21.384412 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:21.396048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:21.409283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9997e0f-bbbd-49cf-a789-8ae45e645ba7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:21.527837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2287a-efb1-40ba-b9eb-7c2b78ff6c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:21.528524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2287a-efb1-40ba-b9eb-7c2b78ff6c91 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.528986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2287a-efb1-40ba-b9eb-7c2b78ff6c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.529358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2287a-efb1-40ba-b9eb-7c2b78ff6c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.534520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-aae2287a-efb1-40ba-b9eb-7c2b78ff6c91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:21.660033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce701648-593b-4297-951d-c88b09955668 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:21.685411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623d0e5-41df-487d-a786-91eca958eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:21.686246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623d0e5-41df-487d-a786-91eca958eccd admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.686535 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623d0e5-41df-487d-a786-91eca958eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.686813 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623d0e5-41df-487d-a786-91eca958eccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.687604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623d0e5-41df-487d-a786-91eca958eccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:21.689254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623d0e5-41df-487d-a786-91eca958eccd admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:21.736589 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 896/1785] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:21.739134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623d0e5-41df-487d-a786-91eca958eccd admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:21.751378 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3623d0e5-41df-487d-a786-91eca958eccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:21.787955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2287a-efb1-40ba-b9eb-7c2b78ff6c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:21.793879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2287a-efb1-40ba-b9eb-7c2b78ff6c91 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:21.800742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623d0e5-41df-487d-a786-91eca958eccd admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:21.822352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553a020-7b0f-41e0-8dd7-3de22bcbbacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:21.824114 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 890/1786] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:21.824884 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553a020-7b0f-41e0-8dd7-3de22bcbbacf admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.826039 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553a020-7b0f-41e0-8dd7-3de22bcbbacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.826703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553a020-7b0f-41e0-8dd7-3de22bcbbacf admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.828248 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b40ad-7b1b-4b00-af08-76829403b826 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.829592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553a020-7b0f-41e0-8dd7-3de22bcbbacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:21.830069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b40ad-7b1b-4b00-af08-76829403b826 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.830510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b40ad-7b1b-4b00-af08-76829403b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.832944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553a020-7b0f-41e0-8dd7-3de22bcbbacf admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:21.855315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 897/1787] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:21.855315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a0f8b-7fcf-4d2d-8c5f-166aee429b8b None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.855315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a0f8b-7fcf-4d2d-8c5f-166aee429b8b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.855315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a0f8b-7fcf-4d2d-8c5f-166aee429b8b None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.855315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 898/1788] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 23 13:13:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:13:21.855315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a0f8b-7fcf-4d2d-8c5f-166aee429b8b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:21.863871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-dd2b40ad-7b1b-4b00-af08-76829403b826 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:21.865304 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dd2b40ad-7b1b-4b00-af08-76829403b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:21.888750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 891/1789] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:21.897168 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b40ad-7b1b-4b00-af08-76829403b826 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:21.899723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dd2b40ad-7b1b-4b00-af08-76829403b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:21.908314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a0f8b-7fcf-4d2d-8c5f-166aee429b8b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:21.927634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b40ad-7b1b-4b00-af08-76829403b826 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:21.927794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4420aa5-8c3f-4b4f-aacb-c3c6e4e340cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:21.927794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4420aa5-8c3f-4b4f-aacb-c3c6e4e340cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.927794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4420aa5-8c3f-4b4f-aacb-c3c6e4e340cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.927794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4420aa5-8c3f-4b4f-aacb-c3c6e4e340cc admin admin] PATH_INFO: `/v3/projects/940558be8f6047889b222dab428ce1cf/users/e1573115cdcd4a7fb44791853ffd37d7/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.928129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050ec27-f505-4eba-b6f5-bfbe5f9d29c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:21.928129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050ec27-f505-4eba-b6f5-bfbe5f9d29c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.928129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050ec27-f505-4eba-b6f5-bfbe5f9d29c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.928129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050ec27-f505-4eba-b6f5-bfbe5f9d29c5 admin admin] PATH_INFO: `/v3/users/41e91aff6d5a48438ca3015d12d50c6f` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.928447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050ec27-f505-4eba-b6f5-bfbe5f9d29c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e91aff6d5a48438ca3015d12d50c6f)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:21.928447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050ec27-f505-4eba-b6f5-bfbe5f9d29c5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:21.967771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4420aa5-8c3f-4b4f-aacb-c3c6e4e340cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=940558be8f6047889b222dab428ce1cf, user_id=e1573115cdcd4a7fb44791853ffd37d7, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:21.967771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4420aa5-8c3f-4b4f-aacb-c3c6e4e340cc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:21.998977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:22.134870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 899/1790] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:21 2022] PUT /identity/v3/projects/940558be8f6047889b222dab428ce1cf/users/e1573115cdcd4a7fb44791853ffd37d7/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:22.136651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ff7d6-b56c-4de3-8f07-419b3a69005d None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.137102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ff7d6-b56c-4de3-8f07-419b3a69005d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.137796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ff7d6-b56c-4de3-8f07-419b3a69005d None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.139177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 900/1791] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 23 13:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:13:22.139972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ff7d6-b56c-4de3-8f07-419b3a69005d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:22.262530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9050ec27-f505-4eba-b6f5-bfbe5f9d29c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e91aff6d5a48438ca3015d12d50c6f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:22.263210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9050ec27-f505-4eba-b6f5-bfbe5f9d29c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e91aff6d5a48438ca3015d12d50c6f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:22.264014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9050ec27-f505-4eba-b6f5-bfbe5f9d29c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e91aff6d5a48438ca3015d12d50c6f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:22.277720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ff7d6-b56c-4de3-8f07-419b3a69005d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:22.295276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9050ec27-f505-4eba-b6f5-bfbe5f9d29c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e91aff6d5a48438ca3015d12d50c6f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:22.295484 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692710d-9920-40ce-b581-b6618219b55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:22.296491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692710d-9920-40ce-b581-b6618219b55d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.296968 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692710d-9920-40ce-b581-b6618219b55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.297354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692710d-9920-40ce-b581-b6618219b55d admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.298251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692710d-9920-40ce-b581-b6618219b55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:22.300295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692710d-9920-40ce-b581-b6618219b55d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:22.304901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9050ec27-f505-4eba-b6f5-bfbe5f9d29c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e91aff6d5a48438ca3015d12d50c6f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:22.323364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:22.325121 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 901/1792] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:22.326955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a387788-2f28-49e3-bb79-be204ca22716 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.330622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a387788-2f28-49e3-bb79-be204ca22716 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.330622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a387788-2f28-49e3-bb79-be204ca22716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.360996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0a387788-2f28-49e3-bb79-be204ca22716 None None] MFA Rules not processed for user `5874e98df57242028c0f9983dee3b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:22.363122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0a387788-2f28-49e3-bb79-be204ca22716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:22.388110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 892/1793] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:21 2022] DELETE /identity/v3/users/41e91aff6d5a48438ca3015d12d50c6f => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:22.389656 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a86d8-1f0c-4019-83b0-84e8b1636d7e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.390426 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a86d8-1f0c-4019-83b0-84e8b1636d7e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.391055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a86d8-1f0c-4019-83b0-84e8b1636d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.451336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-bb2a86d8-1f0c-4019-83b0-84e8b1636d7e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:22.454095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bb2a86d8-1f0c-4019-83b0-84e8b1636d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:22.487362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 902/1794] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 23 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:22.493268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0bbd-047f-455c-8474-9da559f0aaf2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.493897 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0bbd-047f-455c-8474-9da559f0aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.494615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0bbd-047f-455c-8474-9da559f0aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.559862 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b2bf0bbd-047f-455c-8474-9da559f0aaf2 None None] MFA Rules not processed for user `e1573115cdcd4a7fb44791853ffd37d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:22.565245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b2bf0bbd-047f-455c-8474-9da559f0aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:22.640189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 893/1795] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:22.654295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d67e-235a-4946-aec6-52110a8ba6bd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.655358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d67e-235a-4946-aec6-52110a8ba6bd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.657202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d67e-235a-4946-aec6-52110a8ba6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.726740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3871d67e-235a-4946-aec6-52110a8ba6bd None None] MFA Rules not processed for user `5874e98df57242028c0f9983dee3b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:22.728456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3871d67e-235a-4946-aec6-52110a8ba6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:22.762476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 903/1796] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:22.762476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0bbd-047f-455c-8474-9da559f0aaf2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:22.765575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b2bf0bbd-047f-455c-8474-9da559f0aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:22.842280 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0bbd-047f-455c-8474-9da559f0aaf2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:22.864351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c06d3-a3e3-413a-b848-bba293e0d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:22.871858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c06d3-a3e3-413a-b848-bba293e0d8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.871858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c06d3-a3e3-413a-b848-bba293e0d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.871858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c06d3-a3e3-413a-b848-bba293e0d8aa admin admin] PATH_INFO: `/v3/projects/9f658a3f68604e9cbc7f0a97eee2803f/users/63f54f886796496da9dc8cdccaeebe2c/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.927129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c06d3-a3e3-413a-b848-bba293e0d8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f658a3f68604e9cbc7f0a97eee2803f, user_id=63f54f886796496da9dc8cdccaeebe2c, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:22.927303 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 894/1797] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 23 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:22.936542 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c06d3-a3e3-413a-b848-bba293e0d8aa admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:22.943317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2245c-b047-426d-bc28-50d485eac504 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.943862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2245c-b047-426d-bc28-50d485eac504 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.945010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2245c-b047-426d-bc28-50d485eac504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.990165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f7e2245c-b047-426d-bc28-50d485eac504 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:22.996791 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f7e2245c-b047-426d-bc28-50d485eac504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:23.021519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 895/1798] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:23.036072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2245c-b047-426d-bc28-50d485eac504 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:23.036416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 904/1799] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:22 2022] PUT /identity/v3/projects/9f658a3f68604e9cbc7f0a97eee2803f/users/63f54f886796496da9dc8cdccaeebe2c/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:23.036416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c06d3-a3e3-413a-b848-bba293e0d8aa admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:23.036416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1c6c06d3-a3e3-413a-b848-bba293e0d8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:23.063916 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2245c-b047-426d-bc28-50d485eac504 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:23.187327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f85ac-aa0e-4b90-a964-3ed2e1740b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:23.188219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f85ac-aa0e-4b90-a964-3ed2e1740b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:23.188507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f85ac-aa0e-4b90-a964-3ed2e1740b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:23.190917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f85ac-aa0e-4b90-a964-3ed2e1740b93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:23.192407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f85ac-aa0e-4b90-a964-3ed2e1740b93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:23.192756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f85ac-aa0e-4b90-a964-3ed2e1740b93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:23.198289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f85ac-aa0e-4b90-a964-3ed2e1740b93 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:23.216537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 896/1800] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:23.219803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f85ac-aa0e-4b90-a964-3ed2e1740b93 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:23.224222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-411f85ac-aa0e-4b90-a964-3ed2e1740b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:23.249618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c06d3-a3e3-413a-b848-bba293e0d8aa admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:23.256076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1436ade-a8d7-4675-8af3-75683dedbd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:23.258360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1436ade-a8d7-4675-8af3-75683dedbd68 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:23.258762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1436ade-a8d7-4675-8af3-75683dedbd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:23.259318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1436ade-a8d7-4675-8af3-75683dedbd68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:23.261200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1436ade-a8d7-4675-8af3-75683dedbd68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:23.264610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1436ade-a8d7-4675-8af3-75683dedbd68 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:23.277829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:23.329600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f85ac-aa0e-4b90-a964-3ed2e1740b93 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:23.340731 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfbc3f-24aa-42fb-b64c-fe20697bf40d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:23.343386 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfbc3f-24aa-42fb-b64c-fe20697bf40d service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:23.343386 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfbc3f-24aa-42fb-b64c-fe20697bf40d service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:23.343386 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfbc3f-24aa-42fb-b64c-fe20697bf40d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:23.355057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfbc3f-24aa-42fb-b64c-fe20697bf40d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:23.357132 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfbc3f-24aa-42fb-b64c-fe20697bf40d service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:23.371636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 897/1801] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:23.372901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfbc3f-24aa-42fb-b64c-fe20697bf40d service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:23.374577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-abbfbc3f-24aa-42fb-b64c-fe20697bf40d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:23.392881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfbc3f-24aa-42fb-b64c-fe20697bf40d service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:23.402440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 905/1802] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:23 2022] POST /identity/v3/projects => generated 371 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:23.403970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1ce6-1641-4b57-bd27-179f3153faf9 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:23.404271 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1ce6-1641-4b57-bd27-179f3153faf9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:23.404555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1ce6-1641-4b57-bd27-179f3153faf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:23.405425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a3e9d-e1b0-415f-b709-3f0ff0b1f883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:23.406878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3e9d-e1b0-415f-b709-3f0ff0b1f883 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:23.407438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3e9d-e1b0-415f-b709-3f0ff0b1f883 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:23.408227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3e9d-e1b0-415f-b709-3f0ff0b1f883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:23.423010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a3e9d-e1b0-415f-b709-3f0ff0b1f883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:23.425168 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a3e9d-e1b0-415f-b709-3f0ff0b1f883 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:23.450375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 898/1803] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:23.453130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a3e9d-e1b0-415f-b709-3f0ff0b1f883 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:23.481335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a3e9d-e1b0-415f-b709-3f0ff0b1f883 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:23.503120 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-388e1ce6-1641-4b57-bd27-179f3153faf9 None None] MFA Rules not processed for user `63f54f886796496da9dc8cdccaeebe2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:23.504831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-388e1ce6-1641-4b57-bd27-179f3153faf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:23.648059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a6241-e8c6-48f1-baeb-7d5f547a400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:23.648770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a6241-e8c6-48f1-baeb-7d5f547a400a admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:23.649058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a6241-e8c6-48f1-baeb-7d5f547a400a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:23.649338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a6241-e8c6-48f1-baeb-7d5f547a400a admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:23.652454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a6241-e8c6-48f1-baeb-7d5f547a400a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:23.659517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a6241-e8c6-48f1-baeb-7d5f547a400a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:23.715826 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 906/1804] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:23.717472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1ce6-1641-4b57-bd27-179f3153faf9 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:23.719788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-388e1ce6-1641-4b57-bd27-179f3153faf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:23.817349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1ce6-1641-4b57-bd27-179f3153faf9 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:23.823226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e75f28-45b4-4e0e-ab13-7b665528d197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:23.824118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e75f28-45b4-4e0e-ab13-7b665528d197 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:23.824601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e75f28-45b4-4e0e-ab13-7b665528d197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:23.824968 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e75f28-45b4-4e0e-ab13-7b665528d197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:23.836095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e75f28-45b4-4e0e-ab13-7b665528d197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:23.837789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e75f28-45b4-4e0e-ab13-7b665528d197 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:23.838179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 899/1805] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:23 2022] POST /identity/v3/projects => generated 377 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:23.839371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a6241-e8c6-48f1-baeb-7d5f547a400a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:23.860826 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 907/1806] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:23.862285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e75f28-45b4-4e0e-ab13-7b665528d197 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:23.886942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e75f28-45b4-4e0e-ab13-7b665528d197 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:24.030373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a6241-e8c6-48f1-baeb-7d5f547a400a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:24.040235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecf450-2877-4929-b7db-97f18908a5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:24.041626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecf450-2877-4929-b7db-97f18908a5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:24.041926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecf450-2877-4929-b7db-97f18908a5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:24.042313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4e938-6f3e-4344-bffe-a25819ca7fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:24.042450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecf450-2877-4929-b7db-97f18908a5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:24.043761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecf450-2877-4929-b7db-97f18908a5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:24.044011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4e938-6f3e-4344-bffe-a25819ca7fcf admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:24.044391 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4e938-6f3e-4344-bffe-a25819ca7fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:24.044804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4e938-6f3e-4344-bffe-a25819ca7fcf admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:24.045629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4e938-6f3e-4344-bffe-a25819ca7fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:24.049533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecf450-2877-4929-b7db-97f18908a5f7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:24.050214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4e938-6f3e-4344-bffe-a25819ca7fcf admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:24.162017 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 900/1807] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:23 2022] POST /identity/v3/users => generated 292 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:24.166364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4e938-6f3e-4344-bffe-a25819ca7fcf admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:24.184696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 908/1808] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:23 2022] POST /identity/v3/projects => generated 379 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:24.229779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecf450-2877-4929-b7db-97f18908a5f7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:24.230065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4e938-6f3e-4344-bffe-a25819ca7fcf admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:24.263557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecf450-2877-4929-b7db-97f18908a5f7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:24.276967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180a065-21c1-4229-858f-8d888e310142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:24.277964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180a065-21c1-4229-858f-8d888e310142 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:24.278260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180a065-21c1-4229-858f-8d888e310142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:24.278828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180a065-21c1-4229-858f-8d888e310142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:24.279464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180a065-21c1-4229-858f-8d888e310142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:24.281132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180a065-21c1-4229-858f-8d888e310142 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:24.308684 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 909/1809] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:24.309769 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180a065-21c1-4229-858f-8d888e310142 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:24.333916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180a065-21c1-4229-858f-8d888e310142 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:24.342599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fa327-6558-4c1b-ac7c-2cd7ffd6c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:24.343378 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fa327-6558-4c1b-ac7c-2cd7ffd6c924 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:24.343705 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fa327-6558-4c1b-ac7c-2cd7ffd6c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:24.345018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6eff0-eeb7-47c4-adcd-5803023d0e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:24.345712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6eff0-eeb7-47c4-adcd-5803023d0e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:24.345889 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fa327-6558-4c1b-ac7c-2cd7ffd6c924 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:24.346000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6eff0-eeb7-47c4-adcd-5803023d0e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:24.346322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6eff0-eeb7-47c4-adcd-5803023d0e2b admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:24.346667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fa327-6558-4c1b-ac7c-2cd7ffd6c924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:24.347018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6eff0-eeb7-47c4-adcd-5803023d0e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:24.348882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fa327-6558-4c1b-ac7c-2cd7ffd6c924 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:24.349223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6eff0-eeb7-47c4-adcd-5803023d0e2b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:24.478172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 910/1810] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:24 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:24.483477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 901/1811] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:24 2022] POST /identity/v3/users => generated 289 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:24.484537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6eff0-eeb7-47c4-adcd-5803023d0e2b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:24.485397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fa327-6558-4c1b-ac7c-2cd7ffd6c924 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:24.529006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fa327-6558-4c1b-ac7c-2cd7ffd6c924 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:24.531042 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6eff0-eeb7-47c4-adcd-5803023d0e2b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:24.562922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049035f-7b5c-4e33-b39a-c06cd5da85c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:24.563949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff65bd-d9fb-4c5b-8296-0e470153b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:24.570326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049035f-7b5c-4e33-b39a-c06cd5da85c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:24.570618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049035f-7b5c-4e33-b39a-c06cd5da85c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:24.570904 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049035f-7b5c-4e33-b39a-c06cd5da85c2 admin admin] PATH_INFO: `/v3/projects/bdf4164bf2c94c2a8deccf6901770ea9/users/5a433a7d7bfd4eb999179ea955b16454/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:24.571934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff65bd-d9fb-4c5b-8296-0e470153b24d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:24.572226 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff65bd-d9fb-4c5b-8296-0e470153b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:24.576289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff65bd-d9fb-4c5b-8296-0e470153b24d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:24.577209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff65bd-d9fb-4c5b-8296-0e470153b24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:24.581283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff65bd-d9fb-4c5b-8296-0e470153b24d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:24.619963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 902/1812] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:24.622112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff65bd-d9fb-4c5b-8296-0e470153b24d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:24.627845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049035f-7b5c-4e33-b39a-c06cd5da85c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf4164bf2c94c2a8deccf6901770ea9, user_id=5a433a7d7bfd4eb999179ea955b16454, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:24.637664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049035f-7b5c-4e33-b39a-c06cd5da85c2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:24.640471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff65bd-d9fb-4c5b-8296-0e470153b24d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:24.645860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11380d98-082d-4a55-a794-64c15bbea9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:24.646898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11380d98-082d-4a55-a794-64c15bbea9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:24.655540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11380d98-082d-4a55-a794-64c15bbea9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:24.655540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11380d98-082d-4a55-a794-64c15bbea9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:24.655540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11380d98-082d-4a55-a794-64c15bbea9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:24.655540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11380d98-082d-4a55-a794-64c15bbea9ab admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:24.673435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 903/1813] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:24.677875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11380d98-082d-4a55-a794-64c15bbea9ab admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:24.680212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-11380d98-082d-4a55-a794-64c15bbea9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:24.694662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11380d98-082d-4a55-a794-64c15bbea9ab admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:24.703890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:24.704899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:24.705241 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:24.705623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] PATH_INFO: `/v3/projects/db402ca32d8b4c8097848132281fed01` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:24.707628 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db402ca32d8b4c8097848132281fed01)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:24.710358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:24.758549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 911/1814] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:24 2022] PUT /identity/v3/projects/bdf4164bf2c94c2a8deccf6901770ea9/users/5a433a7d7bfd4eb999179ea955b16454/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:24.759513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049035f-7b5c-4e33-b39a-c06cd5da85c2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:24.872794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049035f-7b5c-4e33-b39a-c06cd5da85c2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:24.883436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db402ca32d8b4c8097848132281fed01', 'request_id': 'req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:24.984960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c58746-fa58-472e-8f0f-9055bbb7ab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:24.986297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c58746-fa58-472e-8f0f-9055bbb7ab60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:24.986771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c58746-fa58-472e-8f0f-9055bbb7ab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:24.987203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c58746-fa58-472e-8f0f-9055bbb7ab60 admin admin] PATH_INFO: `/v3/projects/3bd389c4576d4a2a80517646b2004114/users/d177d5f20d4a406ebd3115c66af7b515/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.012941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c58746-fa58-472e-8f0f-9055bbb7ab60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd389c4576d4a2a80517646b2004114, user_id=d177d5f20d4a406ebd3115c66af7b515, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:25.015950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c58746-fa58-472e-8f0f-9055bbb7ab60 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:25.020171 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db402ca32d8b4c8097848132281fed01', 'request_id': 'req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.029696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db402ca32d8b4c8097848132281fed01', 'request_id': 'req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.043882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] The token cache is being invalidate because project db402ca32d8b4c8097848132281fed01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:25.044309 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.045154 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.049844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 904/1815] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:24 2022] DELETE /identity/v3/projects/db402ca32d8b4c8097848132281fed01 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:25.049844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:25.049844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:25.083361 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b77ee2-173f-43a0-8162-fd79f3b4d07d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:25.100273 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 912/1816] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:24 2022] PUT /identity/v3/projects/3bd389c4576d4a2a80517646b2004114/users/d177d5f20d4a406ebd3115c66af7b515/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:25.102060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c58746-fa58-472e-8f0f-9055bbb7ab60 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:25.105003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-20c58746-fa58-472e-8f0f-9055bbb7ab60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:25.110569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcaff6a-5b51-4a8b-bbdb-75971b4e97c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:25.111398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaff6a-5b51-4a8b-bbdb-75971b4e97c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.111866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaff6a-5b51-4a8b-bbdb-75971b4e97c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.111969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:25.112286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaff6a-5b51-4a8b-bbdb-75971b4e97c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.116401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcaff6a-5b51-4a8b-bbdb-75971b4e97c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:25.135394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcaff6a-5b51-4a8b-bbdb-75971b4e97c8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:25.166133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 905/1817] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:25.167539 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcaff6a-5b51-4a8b-bbdb-75971b4e97c8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:25.170595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bfcaff6a-5b51-4a8b-bbdb-75971b4e97c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:25.191675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcaff6a-5b51-4a8b-bbdb-75971b4e97c8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:25.296793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c58746-fa58-472e-8f0f-9055bbb7ab60 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:25.303101 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bebd8-a119-425a-961f-bdbd2af87044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:25.304281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bebd8-a119-425a-961f-bdbd2af87044 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.304566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bebd8-a119-425a-961f-bdbd2af87044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.304895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bebd8-a119-425a-961f-bdbd2af87044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.305914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bebd8-a119-425a-961f-bdbd2af87044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:25.307787 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bebd8-a119-425a-961f-bdbd2af87044 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:25.311822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:25.313943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.314274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.314631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] PATH_INFO: `/v3/users/d60f996df09b42e1b5daa12c54e40f58` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.316071 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60f996df09b42e1b5daa12c54e40f58)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:25.318675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:25.320625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 913/1818] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:25.321753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bebd8-a119-425a-961f-bdbd2af87044 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:25.324857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f72bebd8-a119-425a-961f-bdbd2af87044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:25.342409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bebd8-a119-425a-961f-bdbd2af87044 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:25.351608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c10b85-40e8-4800-a29b-a78f9d8736be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:25.352469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c10b85-40e8-4800-a29b-a78f9d8736be admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.352965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c10b85-40e8-4800-a29b-a78f9d8736be admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.353389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c10b85-40e8-4800-a29b-a78f9d8736be admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.354338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c10b85-40e8-4800-a29b-a78f9d8736be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:25.367640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c10b85-40e8-4800-a29b-a78f9d8736be admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:25.388178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 914/1819] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:25.388178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c10b85-40e8-4800-a29b-a78f9d8736be admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:25.405957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c10b85-40e8-4800-a29b-a78f9d8736be admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:25.414171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbc0d8-586f-4c3d-a734-2b348a370ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:25.414171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbc0d8-586f-4c3d-a734-2b348a370ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.414171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbc0d8-586f-4c3d-a734-2b348a370ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.414171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbc0d8-586f-4c3d-a734-2b348a370ecd admin admin] PATH_INFO: `/v3/projects/a640a512fab142e4afa20342e1946154/users/4b3f54c4a1fe4e978433e6a90259015a/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.430777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbc0d8-586f-4c3d-a734-2b348a370ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a640a512fab142e4afa20342e1946154, user_id=4b3f54c4a1fe4e978433e6a90259015a, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:25.434166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbc0d8-586f-4c3d-a734-2b348a370ecd admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:25.458669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:25.552096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 915/1820] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:25 2022] PUT /identity/v3/projects/a640a512fab142e4afa20342e1946154/users/4b3f54c4a1fe4e978433e6a90259015a/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:25.554441 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60f996df09b42e1b5daa12c54e40f58'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.555077 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60f996df09b42e1b5daa12c54e40f58'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.555784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60f996df09b42e1b5daa12c54e40f58'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.564059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbc0d8-586f-4c3d-a734-2b348a370ecd admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:25.570001 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2cdbc0d8-586f-4c3d-a734-2b348a370ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:25.606711 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60f996df09b42e1b5daa12c54e40f58'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.650547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60f996df09b42e1b5daa12c54e40f58'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.739712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 906/1821] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:25 2022] DELETE /identity/v3/users/d60f996df09b42e1b5daa12c54e40f58 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:25.743948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:25.745903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:25.779220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbc0d8-586f-4c3d-a734-2b348a370ecd admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:25.834253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99e3b2-5e76-45b0-b646-80e07d9a726a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:25.840761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2ffd3-3f9a-458d-a07b-9af6d345a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:25.842243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2ffd3-3f9a-458d-a07b-9af6d345a611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.842764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2ffd3-3f9a-458d-a07b-9af6d345a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.843252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2ffd3-3f9a-458d-a07b-9af6d345a611 admin admin] PATH_INFO: `/v3/projects/bdf4164bf2c94c2a8deccf6901770ea9/users/5a433a7d7bfd4eb999179ea955b16454/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.845610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2ffd3-3f9a-458d-a07b-9af6d345a611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf4164bf2c94c2a8deccf6901770ea9, user_id=5a433a7d7bfd4eb999179ea955b16454, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:25.849261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2ffd3-3f9a-458d-a07b-9af6d345a611 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:25.863152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 907/1822] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:25 2022] PUT /identity/v3/projects/bdf4164bf2c94c2a8deccf6901770ea9/users/5a433a7d7bfd4eb999179ea955b16454/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:25.867684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2ffd3-3f9a-458d-a07b-9af6d345a611 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:25.867684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-29e2ffd3-3f9a-458d-a07b-9af6d345a611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:25.908155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5148e-d696-4e8e-86ad-214d6adb9869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:25.911516 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5148e-d696-4e8e-86ad-214d6adb9869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.911921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5148e-d696-4e8e-86ad-214d6adb9869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.912190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5148e-d696-4e8e-86ad-214d6adb9869 admin admin] PATH_INFO: `/v3/projects/e098255eead5458c8c95e6c5b569988b` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.920103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5148e-d696-4e8e-86ad-214d6adb9869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e098255eead5458c8c95e6c5b569988b)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:25.922025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5148e-d696-4e8e-86ad-214d6adb9869 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:25.982601 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2ffd3-3f9a-458d-a07b-9af6d345a611 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:25.993614 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d43692-ce8d-453a-85db-d2d75c456e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:25.996314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d43692-ce8d-453a-85db-d2d75c456e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.997382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d43692-ce8d-453a-85db-d2d75c456e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.998105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d43692-ce8d-453a-85db-d2d75c456e3f admin admin] PATH_INFO: `/v3/projects/3bd389c4576d4a2a80517646b2004114/users/d177d5f20d4a406ebd3115c66af7b515/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.006317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d43692-ce8d-453a-85db-d2d75c456e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd389c4576d4a2a80517646b2004114, user_id=d177d5f20d4a406ebd3115c66af7b515, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:26.011049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d43692-ce8d-453a-85db-d2d75c456e3f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:26.038873 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 908/1823] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:25 2022] PUT /identity/v3/projects/3bd389c4576d4a2a80517646b2004114/users/d177d5f20d4a406ebd3115c66af7b515/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:26.043200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f526c7-c58f-41e3-8634-2a3d668b5b07 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:26.043200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f526c7-c58f-41e3-8634-2a3d668b5b07 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:26.043200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f526c7-c58f-41e3-8634-2a3d668b5b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.089215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-11f5148e-d696-4e8e-86ad-214d6adb9869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e098255eead5458c8c95e6c5b569988b', 'request_id': 'req-11f5148e-d696-4e8e-86ad-214d6adb9869'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:26.092418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-17f526c7-c58f-41e3-8634-2a3d668b5b07 None None] MFA Rules not processed for user `4b3f54c4a1fe4e978433e6a90259015a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:26.098279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-17f526c7-c58f-41e3-8634-2a3d668b5b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:26.098965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-11f5148e-d696-4e8e-86ad-214d6adb9869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e098255eead5458c8c95e6c5b569988b', 'request_id': 'req-11f5148e-d696-4e8e-86ad-214d6adb9869'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:26.110897 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-11f5148e-d696-4e8e-86ad-214d6adb9869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e098255eead5458c8c95e6c5b569988b', 'request_id': 'req-11f5148e-d696-4e8e-86ad-214d6adb9869'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:26.190724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 909/1824] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:26.200690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb4ea-b7fd-4cde-a096-cd9ea3385bd4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:26.207393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb4ea-b7fd-4cde-a096-cd9ea3385bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:26.207393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb4ea-b7fd-4cde-a096-cd9ea3385bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.243778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-11f5148e-d696-4e8e-86ad-214d6adb9869 admin admin] The token cache is being invalidate because project e098255eead5458c8c95e6c5b569988b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:26.244479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-11f5148e-d696-4e8e-86ad-214d6adb9869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:26.245838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-11f5148e-d696-4e8e-86ad-214d6adb9869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:26.246900 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-0b7fb4ea-b7fd-4cde-a096-cd9ea3385bd4 None None] MFA Rules not processed for user `5a433a7d7bfd4eb999179ea955b16454`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:26.248650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0b7fb4ea-b7fd-4cde-a096-cd9ea3385bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:26.255407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 916/1825] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:25 2022] DELETE /identity/v3/projects/e098255eead5458c8c95e6c5b569988b => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:26.261544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b128444-2f66-4d83-afa2-967d7a107bda None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:26.265241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b128444-2f66-4d83-afa2-967d7a107bda None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:26.265548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b128444-2f66-4d83-afa2-967d7a107bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.332865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4b128444-2f66-4d83-afa2-967d7a107bda None None] MFA Rules not processed for user `d177d5f20d4a406ebd3115c66af7b515`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:26.334962 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4b128444-2f66-4d83-afa2-967d7a107bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:26.407796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 910/1826] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:26.407796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fb4ea-b7fd-4cde-a096-cd9ea3385bd4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:26.407796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0b7fb4ea-b7fd-4cde-a096-cd9ea3385bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:26.493762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 917/1827] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:26.494861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b128444-2f66-4d83-afa2-967d7a107bda None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:26.496447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4b128444-2f66-4d83-afa2-967d7a107bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:26.516789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fb4ea-b7fd-4cde-a096-cd9ea3385bd4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:26.525829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeded9a-2310-4e86-ae37-a3d514ab3ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:26.526823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeded9a-2310-4e86-ae37-a3d514ab3ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:26.527136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeded9a-2310-4e86-ae37-a3d514ab3ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:26.527423 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeded9a-2310-4e86-ae37-a3d514ab3ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.528321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeded9a-2310-4e86-ae37-a3d514ab3ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:26.530135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeded9a-2310-4e86-ae37-a3d514ab3ab5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:26.603068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b128444-2f66-4d83-afa2-967d7a107bda None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:26.607949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:26.608895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:26.609185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:26.609604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] PATH_INFO: `/v3/users/4018520205f8493d89c567db50f3ded9` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.611509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4018520205f8493d89c567db50f3ded9)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:26.621218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 911/1828] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:26 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:26.622081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeded9a-2310-4e86-ae37-a3d514ab3ab5 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:26.623271 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:26.625065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7eeded9a-2310-4e86-ae37-a3d514ab3ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:26.756065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeded9a-2310-4e86-ae37-a3d514ab3ab5 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:26.761145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625275b-5163-4292-be4c-4826948ebc69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:26.762124 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625275b-5163-4292-be4c-4826948ebc69 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:26.762555 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625275b-5163-4292-be4c-4826948ebc69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:26.763025 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625275b-5163-4292-be4c-4826948ebc69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.892953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625275b-5163-4292-be4c-4826948ebc69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:26.895691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625275b-5163-4292-be4c-4826948ebc69 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:26.924048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 912/1829] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:26.925035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625275b-5163-4292-be4c-4826948ebc69 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:26.932939 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e625275b-5163-4292-be4c-4826948ebc69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:26.962975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625275b-5163-4292-be4c-4826948ebc69 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:26.969163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391574b9-8d6c-48b6-9e0e-c1a6a906c717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:26.970385 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4018520205f8493d89c567db50f3ded9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:26.972541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391574b9-8d6c-48b6-9e0e-c1a6a906c717 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:26.973324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391574b9-8d6c-48b6-9e0e-c1a6a906c717 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:26.974081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4018520205f8493d89c567db50f3ded9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:26.974498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391574b9-8d6c-48b6-9e0e-c1a6a906c717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.982290 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-391574b9-8d6c-48b6-9e0e-c1a6a906c717 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:27.119316 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391574b9-8d6c-48b6-9e0e-c1a6a906c717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:27.121069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391574b9-8d6c-48b6-9e0e-c1a6a906c717 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:27.132769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 913/1830] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:27.133437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391574b9-8d6c-48b6-9e0e-c1a6a906c717 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:27.134833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-391574b9-8d6c-48b6-9e0e-c1a6a906c717 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:27.157300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4018520205f8493d89c567db50f3ded9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:27.177958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4018520205f8493d89c567db50f3ded9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:27.187208 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4018520205f8493d89c567db50f3ded9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:27.219994 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 918/1831] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:26 2022] DELETE /identity/v3/users/4018520205f8493d89c567db50f3ded9 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:27.221155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:27.223030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:27.246080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391574b9-8d6c-48b6-9e0e-c1a6a906c717 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:27.346315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17040fee-d9f5-4882-899b-fb4cf58c2e94 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:27.352010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:27.353010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:27.353292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:27.353537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] PATH_INFO: `/v3/projects/c8aa204b06cb48e6ba04d4c0d239054a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:27.355334 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8aa204b06cb48e6ba04d4c0d239054a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:27.358275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:27.415477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335d610-43d2-4f13-a737-9e67bc181862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:27.416232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335d610-43d2-4f13-a737-9e67bc181862 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:27.416507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335d610-43d2-4f13-a737-9e67bc181862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:27.416833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335d610-43d2-4f13-a737-9e67bc181862 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:27.417524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335d610-43d2-4f13-a737-9e67bc181862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:27.419714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335d610-43d2-4f13-a737-9e67bc181862 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:27.532333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8aa204b06cb48e6ba04d4c0d239054a', 'request_id': 'req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:27.546415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 914/1832] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:27 2022] POST /identity/v3/users => generated 297 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:27.547652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335d610-43d2-4f13-a737-9e67bc181862 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:27.549522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4335d610-43d2-4f13-a737-9e67bc181862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:27.549641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8aa204b06cb48e6ba04d4c0d239054a', 'request_id': 'req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:27.557064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8aa204b06cb48e6ba04d4c0d239054a', 'request_id': 'req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:27.620119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:27.626446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335d610-43d2-4f13-a737-9e67bc181862 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:27.676467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] The token cache is being invalidate because project c8aa204b06cb48e6ba04d4c0d239054a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:27.676778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:27.677932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:27.684483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 919/1833] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:27 2022] DELETE /identity/v3/projects/c8aa204b06cb48e6ba04d4c0d239054a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:27.685608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:27.687114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:27.693315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d99e-c9f7-4dca-bd3e-505ddd663ca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:27.695690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d99e-c9f7-4dca-bd3e-505ddd663ca1 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:27.695881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d99e-c9f7-4dca-bd3e-505ddd663ca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:27.696202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d99e-c9f7-4dca-bd3e-505ddd663ca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:27.699533 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9203d99e-c9f7-4dca-bd3e-505ddd663ca1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:27.710560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43cc8e-ea1d-4f90-b7f1-978af09fb896 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:27.723068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d8ef0-a58e-45f4-8009-8adc5f1b1bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:27.723548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d8ef0-a58e-45f4-8009-8adc5f1b1bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:27.723906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d8ef0-a58e-45f4-8009-8adc5f1b1bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:27.724123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d8ef0-a58e-45f4-8009-8adc5f1b1bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:27.728145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c86d8ef0-a58e-45f4-8009-8adc5f1b1bd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:27.799363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203d99e-c9f7-4dca-bd3e-505ddd663ca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:27.801138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203d99e-c9f7-4dca-bd3e-505ddd663ca1 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:27.812030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 915/1834] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:27.813186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d99e-c9f7-4dca-bd3e-505ddd663ca1 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:27.814647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9203d99e-c9f7-4dca-bd3e-505ddd663ca1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:27.828301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d8ef0-a58e-45f4-8009-8adc5f1b1bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:27.829863 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d8ef0-a58e-45f4-8009-8adc5f1b1bd5 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:27.840896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 920/1835] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:27.842413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244f3f0-7c13-4ee4-b33c-7158c5303cf4 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:27.842705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244f3f0-7c13-4ee4-b33c-7158c5303cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:27.842987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244f3f0-7c13-4ee4-b33c-7158c5303cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:27.867937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7244f3f0-7c13-4ee4-b33c-7158c5303cf4 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:27.867937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7244f3f0-7c13-4ee4-b33c-7158c5303cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:27.918245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d99e-c9f7-4dca-bd3e-505ddd663ca1 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:27.924092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b570747-b300-4f04-986b-d11075d23765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:27.924988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b570747-b300-4f04-986b-d11075d23765 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:27.925420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b570747-b300-4f04-986b-d11075d23765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:27.929698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b570747-b300-4f04-986b-d11075d23765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:27.929698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b570747-b300-4f04-986b-d11075d23765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:27.929698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b570747-b300-4f04-986b-d11075d23765 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:27.940069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 916/1836] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:27.940929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b570747-b300-4f04-986b-d11075d23765 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:27.941946 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 921/1837] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:27.945084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7b570747-b300-4f04-986b-d11075d23765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:27.949734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244f3f0-7c13-4ee4-b33c-7158c5303cf4 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:27.958688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b570747-b300-4f04-986b-d11075d23765 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:27.960757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244f3f0-7c13-4ee4-b33c-7158c5303cf4 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:27.963912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:27.964711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ad2ea-ab22-4cfb-a56a-e70c3844b29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:27.964937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:27.965193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:27.965473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] PATH_INFO: `/v3/projects/b9b12534bed5481281f07a68b42c8c74` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:27.965635 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ad2ea-ab22-4cfb-a56a-e70c3844b29d admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:27.965878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ad2ea-ab22-4cfb-a56a-e70c3844b29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:27.966150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ad2ea-ab22-4cfb-a56a-e70c3844b29d admin admin] PATH_INFO: `/v3/projects/01e4c70f64fa4f729bcff09243c71231/users/16e4c40bfc0145e1a3ef7352815a1e3e/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:27.966741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b12534bed5481281f07a68b42c8c74)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:27.968654 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:27.981322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ad2ea-ab22-4cfb-a56a-e70c3844b29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e4c70f64fa4f729bcff09243c71231, user_id=16e4c40bfc0145e1a3ef7352815a1e3e, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:27.983973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ad2ea-ab22-4cfb-a56a-e70c3844b29d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.063263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 922/1838] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:27 2022] PUT /identity/v3/projects/01e4c70f64fa4f729bcff09243c71231/users/16e4c40bfc0145e1a3ef7352815a1e3e/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:28.063263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a7958-6cba-4581-908a-e89928964239 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.063263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a7958-6cba-4581-908a-e89928964239 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.063263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a7958-6cba-4581-908a-e89928964239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.083049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b64a7958-6cba-4581-908a-e89928964239 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:28.084240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b64a7958-6cba-4581-908a-e89928964239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:28.110069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b12534bed5481281f07a68b42c8c74', 'request_id': 'req-cae9b651-6ee9-4135-800c-d30d50649ec8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:28.175870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 923/1839] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:28.176920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a7958-6cba-4581-908a-e89928964239 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.180961 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:28.188343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a7958-6cba-4581-908a-e89928964239 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.212110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b12534bed5481281f07a68b42c8c74', 'request_id': 'req-cae9b651-6ee9-4135-800c-d30d50649ec8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:28.221925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b12534bed5481281f07a68b42c8c74', 'request_id': 'req-cae9b651-6ee9-4135-800c-d30d50649ec8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:28.240068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] The token cache is being invalidate because project b9b12534bed5481281f07a68b42c8c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:28.240388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:28.260733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:28.260733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 917/1840] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:27 2022] DELETE /identity/v3/projects/b9b12534bed5481281f07a68b42c8c74 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:28.260733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.260733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:28.273910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860addbe-8078-4ccd-8d8f-eb8fc2a63059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:28.274579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860addbe-8078-4ccd-8d8f-eb8fc2a63059 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.274858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860addbe-8078-4ccd-8d8f-eb8fc2a63059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.275135 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860addbe-8078-4ccd-8d8f-eb8fc2a63059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.275901 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860addbe-8078-4ccd-8d8f-eb8fc2a63059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:28.277555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860addbe-8078-4ccd-8d8f-eb8fc2a63059 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.288622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 924/1841] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:28.290019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51d5a-828a-4e4e-a7ef-a978394ff341 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.290303 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51d5a-828a-4e4e-a7ef-a978394ff341 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.290579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51d5a-828a-4e4e-a7ef-a978394ff341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.310396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-53a51d5a-828a-4e4e-a7ef-a978394ff341 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:28.312201 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-53a51d5a-828a-4e4e-a7ef-a978394ff341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:28.321287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 925/1842] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:28.322064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51d5a-828a-4e4e-a7ef-a978394ff341 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.323303 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-53a51d5a-828a-4e4e-a7ef-a978394ff341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:28.330995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9b651-6ee9-4135-800c-d30d50649ec8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.335320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51d5a-828a-4e4e-a7ef-a978394ff341 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.335952 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc5464-09d8-4989-981b-a6eb9450132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:28.336559 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc5464-09d8-4989-981b-a6eb9450132e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.336899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc5464-09d8-4989-981b-a6eb9450132e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.337285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc5464-09d8-4989-981b-a6eb9450132e admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.338043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc5464-09d8-4989-981b-a6eb9450132e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:28.338655 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc5464-09d8-4989-981b-a6eb9450132e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:28.343058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f41885-eef3-4596-8dba-686ace752288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:28.343937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f41885-eef3-4596-8dba-686ace752288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.344244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f41885-eef3-4596-8dba-686ace752288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.344572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f41885-eef3-4596-8dba-686ace752288 admin admin] PATH_INFO: `/v3/projects/01e4c70f64fa4f729bcff09243c71231/users/16e4c40bfc0145e1a3ef7352815a1e3e/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.346581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f41885-eef3-4596-8dba-686ace752288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e4c70f64fa4f729bcff09243c71231, user_id=16e4c40bfc0145e1a3ef7352815a1e3e, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:28.347871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc5464-09d8-4989-981b-a6eb9450132e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.349502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f41885-eef3-4596-8dba-686ace752288 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.361996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 926/1843] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:28 2022] PUT /identity/v3/projects/01e4c70f64fa4f729bcff09243c71231/users/16e4c40bfc0145e1a3ef7352815a1e3e/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:28.363373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dabb14-f64b-423d-bbc4-4bbb27f75f7b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.363665 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dabb14-f64b-423d-bbc4-4bbb27f75f7b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.363945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dabb14-f64b-423d-bbc4-4bbb27f75f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.374115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 918/1844] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:28.375316 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264d0f1-0986-4fb1-aa64-f138cc4be342 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.375763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264d0f1-0986-4fb1-aa64-f138cc4be342 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.376045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264d0f1-0986-4fb1-aa64-f138cc4be342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.386272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a5dabb14-f64b-423d-bbc4-4bbb27f75f7b None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:28.387666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a5dabb14-f64b-423d-bbc4-4bbb27f75f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:28.403411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6264d0f1-0986-4fb1-aa64-f138cc4be342 None None] MFA Rules not processed for user `16e4c40bfc0145e1a3ef7352815a1e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:28.404759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6264d0f1-0986-4fb1-aa64-f138cc4be342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:28.455431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 927/1845] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:28.455431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dabb14-f64b-423d-bbc4-4bbb27f75f7b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.465161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dabb14-f64b-423d-bbc4-4bbb27f75f7b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.469759 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b7b23-211f-41d9-a214-e3b954636fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:28.470445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b7b23-211f-41d9-a214-e3b954636fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.470806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b7b23-211f-41d9-a214-e3b954636fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.471089 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b7b23-211f-41d9-a214-e3b954636fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.471818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b7b23-211f-41d9-a214-e3b954636fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:28.473870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b7b23-211f-41d9-a214-e3b954636fcc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.479479 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 919/1846] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:28.480499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264d0f1-0986-4fb1-aa64-f138cc4be342 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.493957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264d0f1-0986-4fb1-aa64-f138cc4be342 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.498882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c222c-40f7-4bab-805a-602d21d12b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:28.499815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c222c-40f7-4bab-805a-602d21d12b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.500110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c222c-40f7-4bab-805a-602d21d12b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.500392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c222c-40f7-4bab-805a-602d21d12b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.501163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c222c-40f7-4bab-805a-602d21d12b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:28.501476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c222c-40f7-4bab-805a-602d21d12b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:28.503080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c222c-40f7-4bab-805a-602d21d12b19 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.514871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 920/1847] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:28.515899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c222c-40f7-4bab-805a-602d21d12b19 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.517864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9e6c222c-40f7-4bab-805a-602d21d12b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:28.572742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c222c-40f7-4bab-805a-602d21d12b19 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.576461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a3e34-5acb-490e-87c4-b8e9442c5323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:28.577142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a3e34-5acb-490e-87c4-b8e9442c5323 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.577428 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a3e34-5acb-490e-87c4-b8e9442c5323 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.577707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a3e34-5acb-490e-87c4-b8e9442c5323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.581671 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:28.590290 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a3e34-5acb-490e-87c4-b8e9442c5323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:28.591730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a3e34-5acb-490e-87c4-b8e9442c5323 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.594172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 928/1848] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:28 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:28.594974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b7b23-211f-41d9-a214-e3b954636fcc admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.603761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 921/1849] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:28.604641 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a3e34-5acb-490e-87c4-b8e9442c5323 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.617474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a3e34-5acb-490e-87c4-b8e9442c5323 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.687329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c4a7c-5ed4-429f-8bd5-29847138f2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:28.688405 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c4a7c-5ed4-429f-8bd5-29847138f2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.688801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c4a7c-5ed4-429f-8bd5-29847138f2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.689160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c4a7c-5ed4-429f-8bd5-29847138f2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.690273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c4a7c-5ed4-429f-8bd5-29847138f2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:28.692284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c4a7c-5ed4-429f-8bd5-29847138f2a9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.696316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b7b23-211f-41d9-a214-e3b954636fcc admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.706330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1df5a-a09d-4282-8837-0740f3fe861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:28.707282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1df5a-a09d-4282-8837-0740f3fe861c admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.707565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1df5a-a09d-4282-8837-0740f3fe861c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.708950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1df5a-a09d-4282-8837-0740f3fe861c admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.710831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1df5a-a09d-4282-8837-0740f3fe861c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:28.714953 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1df5a-a09d-4282-8837-0740f3fe861c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.841169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 922/1850] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:28 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:28.842743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c4a7c-5ed4-429f-8bd5-29847138f2a9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.860338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c4a7c-5ed4-429f-8bd5-29847138f2a9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.865733 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 929/1851] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:28 2022] POST /identity/v3/projects => generated 399 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:28.867217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da400ff-540c-4fc6-b5b9-fcf0a629c4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:28.868077 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da400ff-540c-4fc6-b5b9-fcf0a629c4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.868579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da400ff-540c-4fc6-b5b9-fcf0a629c4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.869142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da400ff-540c-4fc6-b5b9-fcf0a629c4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.869953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da400ff-540c-4fc6-b5b9-fcf0a629c4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:28.870087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1df5a-a09d-4282-8837-0740f3fe861c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.871573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da400ff-540c-4fc6-b5b9-fcf0a629c4cf admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.886589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 923/1852] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:28.887541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da400ff-540c-4fc6-b5b9-fcf0a629c4cf admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.899268 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da400ff-540c-4fc6-b5b9-fcf0a629c4cf admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.942031 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1df5a-a09d-4282-8837-0740f3fe861c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.949503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c15d2-b2e0-4671-b7db-842a4ae9bfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:28.950184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c15d2-b2e0-4671-b7db-842a4ae9bfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.950476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c15d2-b2e0-4671-b7db-842a4ae9bfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.950762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c15d2-b2e0-4671-b7db-842a4ae9bfb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.951588 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c15d2-b2e0-4671-b7db-842a4ae9bfb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:28.953625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c15d2-b2e0-4671-b7db-842a4ae9bfb9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.965874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb62be-7251-4774-87df-feb2fe534c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:28.966592 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb62be-7251-4774-87df-feb2fe534c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.966878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb62be-7251-4774-87df-feb2fe534c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.967150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb62be-7251-4774-87df-feb2fe534c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.967865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb62be-7251-4774-87df-feb2fe534c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:28.970377 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb62be-7251-4774-87df-feb2fe534c36 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.980908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 924/1853] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:28.989462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb62be-7251-4774-87df-feb2fe534c36 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.994720 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb62be-7251-4774-87df-feb2fe534c36 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.999512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de43891-b4ba-4cc7-b7cb-7ab91eac5def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:29.000401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de43891-b4ba-4cc7-b7cb-7ab91eac5def admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.000792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de43891-b4ba-4cc7-b7cb-7ab91eac5def admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.001011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de43891-b4ba-4cc7-b7cb-7ab91eac5def admin admin] PATH_INFO: `/v3/projects/6302e0f7fda84bd9bfd9425595ef95e0/users/aff1258496574b40b85bf2dfcec8a10e/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.017041 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de43891-b4ba-4cc7-b7cb-7ab91eac5def admin admin] RBAC: Authorizing `identity:create_grant(project_id=6302e0f7fda84bd9bfd9425595ef95e0, user_id=aff1258496574b40b85bf2dfcec8a10e, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:29.020076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de43891-b4ba-4cc7-b7cb-7ab91eac5def admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:29.065806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 930/1854] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:28 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:29.070099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c15d2-b2e0-4671-b7db-842a4ae9bfb9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:29.080830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c15d2-b2e0-4671-b7db-842a4ae9bfb9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:29.219679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4a7d6-51e0-4de9-b8ff-a22d5b5660c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:29.219679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4a7d6-51e0-4de9-b8ff-a22d5b5660c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.219679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4a7d6-51e0-4de9-b8ff-a22d5b5660c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.219679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4a7d6-51e0-4de9-b8ff-a22d5b5660c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.220025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4a7d6-51e0-4de9-b8ff-a22d5b5660c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:29.220025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4a7d6-51e0-4de9-b8ff-a22d5b5660c3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:29.220025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 931/1855] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:29.220025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4a7d6-51e0-4de9-b8ff-a22d5b5660c3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:29.220025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4a7d6-51e0-4de9-b8ff-a22d5b5660c3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:29.220404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ede8c3-d10c-4cd5-9f61-4b49583bff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:29.220404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ede8c3-d10c-4cd5-9f61-4b49583bff51 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.220404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ede8c3-d10c-4cd5-9f61-4b49583bff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.220404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ede8c3-d10c-4cd5-9f61-4b49583bff51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.220828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ede8c3-d10c-4cd5-9f61-4b49583bff51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:29.220828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ede8c3-d10c-4cd5-9f61-4b49583bff51 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:29.220828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 932/1856] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:29.220828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ede8c3-d10c-4cd5-9f61-4b49583bff51 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:29.220828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ede8c3-d10c-4cd5-9f61-4b49583bff51 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:29.221215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192c193-219f-4be5-9418-e7201bc5339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:29.221215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c193-219f-4be5-9418-e7201bc5339d admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.221215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c193-219f-4be5-9418-e7201bc5339d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.221215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c193-219f-4be5-9418-e7201bc5339d admin admin] PATH_INFO: `/v3/projects/2654ebb93bf749acb24527d025ea2a7b/users/20f326ef67134224b248c99fa4942637/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.221525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192c193-219f-4be5-9418-e7201bc5339d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2654ebb93bf749acb24527d025ea2a7b, user_id=20f326ef67134224b248c99fa4942637, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:29.221525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192c193-219f-4be5-9418-e7201bc5339d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:29.266669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 925/1857] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:28 2022] PUT /identity/v3/projects/6302e0f7fda84bd9bfd9425595ef95e0/users/aff1258496574b40b85bf2dfcec8a10e/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:29.277588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d4f3b-9132-4cf2-a3be-412fb30c3b32 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.277908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d4f3b-9132-4cf2-a3be-412fb30c3b32 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.278187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d4f3b-9132-4cf2-a3be-412fb30c3b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.304866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-528d4f3b-9132-4cf2-a3be-412fb30c3b32 None None] MFA Rules not processed for user `aff1258496574b40b85bf2dfcec8a10e`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:29.306190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-528d4f3b-9132-4cf2-a3be-412fb30c3b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:29.332957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 933/1858] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:29 2022] PUT /identity/v3/projects/2654ebb93bf749acb24527d025ea2a7b/users/20f326ef67134224b248c99fa4942637/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:29.335103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794c83-ecc7-4e95-bcfa-d24d693f017d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.335496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794c83-ecc7-4e95-bcfa-d24d693f017d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.335876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794c83-ecc7-4e95-bcfa-d24d693f017d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.379473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4d794c83-ecc7-4e95-bcfa-d24d693f017d None None] MFA Rules not processed for user `20f326ef67134224b248c99fa4942637`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:29.381131 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4d794c83-ecc7-4e95-bcfa-d24d693f017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:29.396233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 926/1859] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:29.401083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d4f3b-9132-4cf2-a3be-412fb30c3b32 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:29.478426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 934/1860] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:29.482628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d794c83-ecc7-4e95-bcfa-d24d693f017d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:29.536057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d4f3b-9132-4cf2-a3be-412fb30c3b32 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:29.564482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d794c83-ecc7-4e95-bcfa-d24d693f017d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:29.570346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7312d-576d-45e8-adf1-2f05acf636dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:29.581761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7312d-576d-45e8-adf1-2f05acf636dc admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.581761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7312d-576d-45e8-adf1-2f05acf636dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.581761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7312d-576d-45e8-adf1-2f05acf636dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.581761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7312d-576d-45e8-adf1-2f05acf636dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:29.582553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ba904-6d19-481b-8275-a10974b8a801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:29.582553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ba904-6d19-481b-8275-a10974b8a801 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.582553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ba904-6d19-481b-8275-a10974b8a801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.582553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ba904-6d19-481b-8275-a10974b8a801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.582903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7312d-576d-45e8-adf1-2f05acf636dc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:29.582991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ba904-6d19-481b-8275-a10974b8a801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:29.582991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ba904-6d19-481b-8275-a10974b8a801 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:29.701150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 935/1861] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:29 2022] POST /identity/v3/projects => generated 401 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:29.701832 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 927/1862] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:29 2022] POST /identity/v3/projects => generated 387 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:29.705076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ba904-6d19-481b-8275-a10974b8a801 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:29.705985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7312d-576d-45e8-adf1-2f05acf636dc admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:29.775107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7312d-576d-45e8-adf1-2f05acf636dc admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:29.781122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67611664-2d58-48d3-9417-637d84954cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:29.781816 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67611664-2d58-48d3-9417-637d84954cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.782106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67611664-2d58-48d3-9417-637d84954cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.782392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67611664-2d58-48d3-9417-637d84954cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.783098 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67611664-2d58-48d3-9417-637d84954cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:29.783434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ba904-6d19-481b-8275-a10974b8a801 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:29.785247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67611664-2d58-48d3-9417-637d84954cf7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:29.791934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a8f69-d0ce-440f-80c5-13dbd838dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:29.793365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a8f69-d0ce-440f-80c5-13dbd838dc7a admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.793663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a8f69-d0ce-440f-80c5-13dbd838dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.794192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a8f69-d0ce-440f-80c5-13dbd838dc7a admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.795474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a8f69-d0ce-440f-80c5-13dbd838dc7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:29.798211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a8f69-d0ce-440f-80c5-13dbd838dc7a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:29.944805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 928/1864] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:29 2022] POST /identity/v3/users => generated 300 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:29.945065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 936/1864] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:29 2022] POST /identity/v3/users => generated 307 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:29.947900 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67611664-2d58-48d3-9417-637d84954cf7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:29.949035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a8f69-d0ce-440f-80c5-13dbd838dc7a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:29.960747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a8f69-d0ce-440f-80c5-13dbd838dc7a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:29.967137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684afd54-5e5b-4f0d-a10c-a58da24f5688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:29.968020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67611664-2d58-48d3-9417-637d84954cf7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:29.968474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684afd54-5e5b-4f0d-a10c-a58da24f5688 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.969041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684afd54-5e5b-4f0d-a10c-a58da24f5688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.969540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684afd54-5e5b-4f0d-a10c-a58da24f5688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.976453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684afd54-5e5b-4f0d-a10c-a58da24f5688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:29.980047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684afd54-5e5b-4f0d-a10c-a58da24f5688 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:29.983954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92adab0-bec5-4ec8-961d-4057f03b3781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:29.984765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92adab0-bec5-4ec8-961d-4057f03b3781 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.985061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92adab0-bec5-4ec8-961d-4057f03b3781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.985344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92adab0-bec5-4ec8-961d-4057f03b3781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.986180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92adab0-bec5-4ec8-961d-4057f03b3781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:29.989128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92adab0-bec5-4ec8-961d-4057f03b3781 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.001586 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 937/1865] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:30.006613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 929/1866] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:30.006806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684afd54-5e5b-4f0d-a10c-a58da24f5688 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.007238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92adab0-bec5-4ec8-961d-4057f03b3781 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.016867 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684afd54-5e5b-4f0d-a10c-a58da24f5688 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.020713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92adab0-bec5-4ec8-961d-4057f03b3781 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.022868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20169665-2cfd-4a98-a435-f4db4f13fc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.023935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20169665-2cfd-4a98-a435-f4db4f13fc4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.024227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20169665-2cfd-4a98-a435-f4db4f13fc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.024551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20169665-2cfd-4a98-a435-f4db4f13fc4a admin admin] PATH_INFO: `/v3/projects/6f0ca1e48ec0404b9bb1cd17594f2fae/users/3bf6294bcd634856b46fb85c4bc3b0c4/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.029111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e52af-23a2-42eb-a564-a0833ddc56d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.030446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e52af-23a2-42eb-a564-a0833ddc56d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.030967 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e52af-23a2-42eb-a564-a0833ddc56d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.031458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e52af-23a2-42eb-a564-a0833ddc56d5 admin admin] PATH_INFO: `/v3/projects/3f875ef093c5447e8a8a4ad95d545eae/users/c367bddc46e74a8db26b574666ba130f/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.052235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20169665-2cfd-4a98-a435-f4db4f13fc4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0ca1e48ec0404b9bb1cd17594f2fae, user_id=3bf6294bcd634856b46fb85c4bc3b0c4, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.057348 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e52af-23a2-42eb-a564-a0833ddc56d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f875ef093c5447e8a8a4ad95d545eae, user_id=c367bddc46e74a8db26b574666ba130f, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.057579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20169665-2cfd-4a98-a435-f4db4f13fc4a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.062040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e52af-23a2-42eb-a564-a0833ddc56d5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.197918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 938/1867] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:30 2022] PUT /identity/v3/projects/6f0ca1e48ec0404b9bb1cd17594f2fae/users/3bf6294bcd634856b46fb85c4bc3b0c4/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:30.198801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20169665-2cfd-4a98-a435-f4db4f13fc4a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.231618 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 930/1868] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:30 2022] PUT /identity/v3/projects/3f875ef093c5447e8a8a4ad95d545eae/users/c367bddc46e74a8db26b574666ba130f/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:30.232649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e52af-23a2-42eb-a564-a0833ddc56d5 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.269751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20169665-2cfd-4a98-a435-f4db4f13fc4a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.300986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e52af-23a2-42eb-a564-a0833ddc56d5 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.306288 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaf42b-44a8-4574-a283-264027f84bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.306946 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaf42b-44a8-4574-a283-264027f84bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.307323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaf42b-44a8-4574-a283-264027f84bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.307593 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaf42b-44a8-4574-a283-264027f84bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.308317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eaf42b-44a8-4574-a283-264027f84bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.309953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eaf42b-44a8-4574-a283-264027f84bbc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.324391 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 931/1869] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:30.324391 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaf42b-44a8-4574-a283-264027f84bbc admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.332400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaf42b-44a8-4574-a283-264027f84bbc admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.349980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979dcf9-2802-40c3-94d6-3ab500114751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.349980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979dcf9-2802-40c3-94d6-3ab500114751 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.349980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979dcf9-2802-40c3-94d6-3ab500114751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.349980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979dcf9-2802-40c3-94d6-3ab500114751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.351086 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979dcf9-2802-40c3-94d6-3ab500114751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.351086 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979dcf9-2802-40c3-94d6-3ab500114751 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.351249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c6c0a-db31-4dc6-8196-e91abd5c19a6 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e4c40bfc0145e1a3ef7352815a1e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e4c70f64fa4f729bcff09243c71231', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.351249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6c0a-db31-4dc6-8196-e91abd5c19a6 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.351249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6c0a-db31-4dc6-8196-e91abd5c19a6 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.351469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6c0a-db31-4dc6-8196-e91abd5c19a6 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.351469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6c0a-db31-4dc6-8196-e91abd5c19a6 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:30.351469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6c0a-db31-4dc6-8196-e91abd5c19a6 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.351469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6c0a-db31-4dc6-8196-e91abd5c19a6 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.356826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 932/1870] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:30.356826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979dcf9-2802-40c3-94d6-3ab500114751 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.362456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 939/1871] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:30.366010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c6c0a-db31-4dc6-8196-e91abd5c19a6 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.369715 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979dcf9-2802-40c3-94d6-3ab500114751 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.375041 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b558e79-bcef-453e-814d-329da3460fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.375950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b558e79-bcef-453e-814d-329da3460fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.376235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b558e79-bcef-453e-814d-329da3460fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.376509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b558e79-bcef-453e-814d-329da3460fc8 admin admin] PATH_INFO: `/v3/projects/6f0ca1e48ec0404b9bb1cd17594f2fae/users/3bf6294bcd634856b46fb85c4bc3b0c4/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.378548 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b558e79-bcef-453e-814d-329da3460fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0ca1e48ec0404b9bb1cd17594f2fae, user_id=3bf6294bcd634856b46fb85c4bc3b0c4, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.380312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c6c0a-db31-4dc6-8196-e91abd5c19a6 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.381799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b558e79-bcef-453e-814d-329da3460fc8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.394127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 933/1872] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:30 2022] PUT /identity/v3/projects/6f0ca1e48ec0404b9bb1cd17594f2fae/users/3bf6294bcd634856b46fb85c4bc3b0c4/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:30.395015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b558e79-bcef-453e-814d-329da3460fc8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.396261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32655e-89ac-4905-bc17-16733cb66c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.397022 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32655e-89ac-4905-bc17-16733cb66c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.397368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32655e-89ac-4905-bc17-16733cb66c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.397630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32655e-89ac-4905-bc17-16733cb66c87 admin admin] PATH_INFO: `/v3/projects/3f875ef093c5447e8a8a4ad95d545eae/users/c367bddc46e74a8db26b574666ba130f/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.399839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32655e-89ac-4905-bc17-16733cb66c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f875ef093c5447e8a8a4ad95d545eae, user_id=c367bddc46e74a8db26b574666ba130f, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.402514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32655e-89ac-4905-bc17-16733cb66c87 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.416138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 940/1873] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:30 2022] PUT /identity/v3/projects/3f875ef093c5447e8a8a4ad95d545eae/users/c367bddc46e74a8db26b574666ba130f/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:30.417549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448d294-57b0-4598-810a-9f7219e8e6f9 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.417549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448d294-57b0-4598-810a-9f7219e8e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.417829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448d294-57b0-4598-810a-9f7219e8e6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.444232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a448d294-57b0-4598-810a-9f7219e8e6f9 None None] MFA Rules not processed for user `3bf6294bcd634856b46fb85c4bc3b0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:30.445699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a448d294-57b0-4598-810a-9f7219e8e6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:30.461285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b558e79-bcef-453e-814d-329da3460fc8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.520344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 941/1874] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:30.521336 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a95d22-a805-4b69-9e59-c57c8921cd73 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.521631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a95d22-a805-4b69-9e59-c57c8921cd73 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.521947 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a95d22-a805-4b69-9e59-c57c8921cd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.526655 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a0371-ab22-41e6-9ca3-8b0dca4e5d93 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e4c40bfc0145e1a3ef7352815a1e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e4c70f64fa4f729bcff09243c71231', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.527338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a0371-ab22-41e6-9ca3-8b0dca4e5d93 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.527634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a0371-ab22-41e6-9ca3-8b0dca4e5d93 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.527922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a0371-ab22-41e6-9ca3-8b0dca4e5d93 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.528955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a0371-ab22-41e6-9ca3-8b0dca4e5d93 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.531305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a0371-ab22-41e6-9ca3-8b0dca4e5d93 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.581731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-93a95d22-a805-4b69-9e59-c57c8921cd73 None None] MFA Rules not processed for user `c367bddc46e74a8db26b574666ba130f`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:30.583202 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-93a95d22-a805-4b69-9e59-c57c8921cd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:30.649235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 934/1875] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:30 2022] POST /identity/v3/projects => generated 354 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:30.649235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a0371-ab22-41e6-9ca3-8b0dca4e5d93 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.658223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ba6a0371-ab22-41e6-9ca3-8b0dca4e5d93 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:30.677435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 942/1876] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:30.680781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a95d22-a805-4b69-9e59-c57c8921cd73 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.690868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a95d22-a805-4b69-9e59-c57c8921cd73 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.727618 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a0371-ab22-41e6-9ca3-8b0dca4e5d93 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.731988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727b83e-058b-42ed-b977-b2315f67fc19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.737693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727b83e-058b-42ed-b977-b2315f67fc19 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.737693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727b83e-058b-42ed-b977-b2315f67fc19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.737995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727b83e-058b-42ed-b977-b2315f67fc19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.753222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112db66-0ae6-407a-9a40-830ac00ef0f2 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e4c40bfc0145e1a3ef7352815a1e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e4c70f64fa4f729bcff09243c71231', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.761150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112db66-0ae6-407a-9a40-830ac00ef0f2 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.761150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112db66-0ae6-407a-9a40-830ac00ef0f2 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.761150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112db66-0ae6-407a-9a40-830ac00ef0f2 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.761150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112db66-0ae6-407a-9a40-830ac00ef0f2 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:30.761150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112db66-0ae6-407a-9a40-830ac00ef0f2 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.761595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112db66-0ae6-407a-9a40-830ac00ef0f2 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.773878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 943/1877] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:30.773878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112db66-0ae6-407a-9a40-830ac00ef0f2 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.782869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112db66-0ae6-407a-9a40-830ac00ef0f2 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.786477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7e37-339b-4641-a8bf-69acb57143bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.787103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7e37-339b-4641-a8bf-69acb57143bb service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.787419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7e37-339b-4641-a8bf-69acb57143bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.787699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7e37-339b-4641-a8bf-69acb57143bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.800136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727b83e-058b-42ed-b977-b2315f67fc19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.803608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727b83e-058b-42ed-b977-b2315f67fc19 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.811765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 935/1878] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:30.841995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727b83e-058b-42ed-b977-b2315f67fc19 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.851370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e7e37-339b-4641-a8bf-69acb57143bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.853015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e7e37-339b-4641-a8bf-69acb57143bb service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.863909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 944/1879] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:30.875192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7e37-339b-4641-a8bf-69acb57143bb service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.886752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7e37-339b-4641-a8bf-69acb57143bb service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.891395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e4c40bfc0145e1a3ef7352815a1e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e4c70f64fa4f729bcff09243c71231', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.892285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.906526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.906526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] PATH_INFO: `/v3/projects/f07663eb60ea42139868b457cff8ba4e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.906526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f07663eb60ea42139868b457cff8ba4e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.906526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.910181 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727b83e-058b-42ed-b977-b2315f67fc19 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.914904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.915781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.916066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.916346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] PATH_INFO: `/v3/users/aff1258496574b40b85bf2dfcec8a10e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.917577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff1258496574b40b85bf2dfcec8a10e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.919613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:31.001017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07663eb60ea42139868b457cff8ba4e', 'request_id': 'req-6dfc184f-a047-4ac7-8b97-0715f6a60305'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.007665 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07663eb60ea42139868b457cff8ba4e', 'request_id': 'req-6dfc184f-a047-4ac7-8b97-0715f6a60305'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.013099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07663eb60ea42139868b457cff8ba4e', 'request_id': 'req-6dfc184f-a047-4ac7-8b97-0715f6a60305'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.119719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] The token cache is being invalidate because project f07663eb60ea42139868b457cff8ba4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:31.120007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.120646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.122354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 945/1880] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:30 2022] DELETE /identity/v3/projects/f07663eb60ea42139868b457cff8ba4e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:31.123259 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:31.124528 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:31.153089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff1258496574b40b85bf2dfcec8a10e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.153754 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff1258496574b40b85bf2dfcec8a10e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.154340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff1258496574b40b85bf2dfcec8a10e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.166547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff1258496574b40b85bf2dfcec8a10e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.173580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff1258496574b40b85bf2dfcec8a10e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.184570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc184f-a047-4ac7-8b97-0715f6a60305 tempest-VolumeQuotaClassesTest-2078322615 tempest-VolumeQuotaClassesTest-2078322615-project-admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:31.188414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87df56a-07df-43be-b8fe-ead18d56eb03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:31.189093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87df56a-07df-43be-b8fe-ead18d56eb03 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:31.189376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87df56a-07df-43be-b8fe-ead18d56eb03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:31.189650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87df56a-07df-43be-b8fe-ead18d56eb03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:31.191474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c87df56a-07df-43be-b8fe-ead18d56eb03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:31.261333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87df56a-07df-43be-b8fe-ead18d56eb03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:31.262857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87df56a-07df-43be-b8fe-ead18d56eb03 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:31.272759 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 946/1881] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:31.297210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 936/1882] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:30 2022] DELETE /identity/v3/users/aff1258496574b40b85bf2dfcec8a10e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:31.303776 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935393d-0d21-475b-97bb-25aa1bb55906 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:31.304306 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935393d-0d21-475b-97bb-25aa1bb55906 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:31.304587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935393d-0d21-475b-97bb-25aa1bb55906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:31.327773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a935393d-0d21-475b-97bb-25aa1bb55906 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:31.329081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a935393d-0d21-475b-97bb-25aa1bb55906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:31.385971 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:31.393255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 947/1883] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:31.403285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:31.404726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:31.461544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3651d7-7a7b-45fb-a5a6-6f57b30913d2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:31.465140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27ea4b-df15-43df-92ee-4ec47f5c6995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:31.465791 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27ea4b-df15-43df-92ee-4ec47f5c6995 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:31.466080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27ea4b-df15-43df-92ee-4ec47f5c6995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:31.466360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27ea4b-df15-43df-92ee-4ec47f5c6995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:31.477480 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27ea4b-df15-43df-92ee-4ec47f5c6995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:31.478986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27ea4b-df15-43df-92ee-4ec47f5c6995 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:31.488937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 937/1884] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:31.886534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:32.090568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935393d-0d21-475b-97bb-25aa1bb55906 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:32.091993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a935393d-0d21-475b-97bb-25aa1bb55906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:32.105963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935393d-0d21-475b-97bb-25aa1bb55906 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:32.113804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:32.116543 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:32.117043 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:32.117480 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] PATH_INFO: `/v3/projects/6302e0f7fda84bd9bfd9425595ef95e0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:32.129679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6302e0f7fda84bd9bfd9425595ef95e0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:32.132211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:32.270000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6302e0f7fda84bd9bfd9425595ef95e0', 'request_id': 'req-6fdbda1b-19e1-44bd-80d8-d1957485d445'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.276970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6302e0f7fda84bd9bfd9425595ef95e0', 'request_id': 'req-6fdbda1b-19e1-44bd-80d8-d1957485d445'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.282503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6302e0f7fda84bd9bfd9425595ef95e0', 'request_id': 'req-6fdbda1b-19e1-44bd-80d8-d1957485d445'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.324117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27ea4b-df15-43df-92ee-4ec47f5c6995 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:32.325695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0f27ea4b-df15-43df-92ee-4ec47f5c6995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:32.339179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27ea4b-df15-43df-92ee-4ec47f5c6995 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:32.401232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] The token cache is being invalidate because project 6302e0f7fda84bd9bfd9425595ef95e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:32.401537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.402279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:32.402420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.403159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:32.403442 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:32.403722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] PATH_INFO: `/v3/users/4b3f54c4a1fe4e978433e6a90259015a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:32.404764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 948/1885] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:32 2022] DELETE /identity/v3/projects/6302e0f7fda84bd9bfd9425595ef95e0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:32.407806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3f54c4a1fe4e978433e6a90259015a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:32.408990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:32.410031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:32.410691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:32.428564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbda1b-19e1-44bd-80d8-d1957485d445 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:32.433612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdadc72-903d-4445-ac60-6ccc4cede53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:32.434600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdadc72-903d-4445-ac60-6ccc4cede53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:32.434874 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdadc72-903d-4445-ac60-6ccc4cede53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:32.435163 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdadc72-903d-4445-ac60-6ccc4cede53d admin admin] PATH_INFO: `/v3/users/3bf6294bcd634856b46fb85c4bc3b0c4` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:32.436520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdadc72-903d-4445-ac60-6ccc4cede53d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf6294bcd634856b46fb85c4bc3b0c4)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:32.438484 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdadc72-903d-4445-ac60-6ccc4cede53d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:32.644851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3fdadc72-903d-4445-ac60-6ccc4cede53d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf6294bcd634856b46fb85c4bc3b0c4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.645048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3f54c4a1fe4e978433e6a90259015a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.645449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3fdadc72-903d-4445-ac60-6ccc4cede53d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf6294bcd634856b46fb85c4bc3b0c4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.645622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3f54c4a1fe4e978433e6a90259015a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.646232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3f54c4a1fe4e978433e6a90259015a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.658378 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3f54c4a1fe4e978433e6a90259015a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.666108 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3f54c4a1fe4e978433e6a90259015a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.727651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3fdadc72-903d-4445-ac60-6ccc4cede53d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf6294bcd634856b46fb85c4bc3b0c4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.739892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3fdadc72-903d-4445-ac60-6ccc4cede53d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf6294bcd634856b46fb85c4bc3b0c4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.747376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3fdadc72-903d-4445-ac60-6ccc4cede53d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf6294bcd634856b46fb85c4bc3b0c4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.753374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 949/1886] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:32 2022] DELETE /identity/v3/users/3bf6294bcd634856b46fb85c4bc3b0c4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:32.871711 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 938/1887] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:32 2022] DELETE /identity/v3/users/4b3f54c4a1fe4e978433e6a90259015a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:32.876260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39717b91-bf88-4775-8c09-1d4e1cc4abdd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:32.876552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39717b91-bf88-4775-8c09-1d4e1cc4abdd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:32.876863 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39717b91-bf88-4775-8c09-1d4e1cc4abdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:32.898885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-39717b91-bf88-4775-8c09-1d4e1cc4abdd None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:32.898885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-39717b91-bf88-4775-8c09-1d4e1cc4abdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:32.963035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 950/1888] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:32.980162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:32.982868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:33.064560 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df8e30-c3e8-4c22-9e14-151455070673 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:33.068153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1ca22-637e-4eea-ab11-8cb45c922576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:33.068865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1ca22-637e-4eea-ab11-8cb45c922576 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:33.069152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1ca22-637e-4eea-ab11-8cb45c922576 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:33.069516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1ca22-637e-4eea-ab11-8cb45c922576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:33.079069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1ca22-637e-4eea-ab11-8cb45c922576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:33.080524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1ca22-637e-4eea-ab11-8cb45c922576 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:33.094016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 939/1889] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:33.409979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39717b91-bf88-4775-8c09-1d4e1cc4abdd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:33.412168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-39717b91-bf88-4775-8c09-1d4e1cc4abdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:33.424803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39717b91-bf88-4775-8c09-1d4e1cc4abdd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:33.436503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20424a1-ac28-4876-80df-edeaa88e5424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:33.436503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20424a1-ac28-4876-80df-edeaa88e5424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:33.436503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20424a1-ac28-4876-80df-edeaa88e5424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:33.436503 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20424a1-ac28-4876-80df-edeaa88e5424 admin admin] PATH_INFO: `/v3/projects/6f0ca1e48ec0404b9bb1cd17594f2fae` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:33.437115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20424a1-ac28-4876-80df-edeaa88e5424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0ca1e48ec0404b9bb1cd17594f2fae)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:33.437115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20424a1-ac28-4876-80df-edeaa88e5424 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:33.603287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e20424a1-ac28-4876-80df-edeaa88e5424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0ca1e48ec0404b9bb1cd17594f2fae', 'request_id': 'req-e20424a1-ac28-4876-80df-edeaa88e5424'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:33.609423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e20424a1-ac28-4876-80df-edeaa88e5424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0ca1e48ec0404b9bb1cd17594f2fae', 'request_id': 'req-e20424a1-ac28-4876-80df-edeaa88e5424'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:33.614960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e20424a1-ac28-4876-80df-edeaa88e5424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0ca1e48ec0404b9bb1cd17594f2fae', 'request_id': 'req-e20424a1-ac28-4876-80df-edeaa88e5424'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:33.779858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e20424a1-ac28-4876-80df-edeaa88e5424 admin admin] The token cache is being invalidate because project 6f0ca1e48ec0404b9bb1cd17594f2fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:33.779858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e20424a1-ac28-4876-80df-edeaa88e5424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:33.779858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e20424a1-ac28-4876-80df-edeaa88e5424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:33.780075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1ca22-637e-4eea-ab11-8cb45c922576 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:33.781073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 951/1890] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:33 2022] DELETE /identity/v3/projects/6f0ca1e48ec0404b9bb1cd17594f2fae => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:33.782105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e2a1ca22-637e-4eea-ab11-8cb45c922576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:33.786038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409476f6-e588-4cf6-8a3a-9a0d8542d797 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:33.786498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409476f6-e588-4cf6-8a3a-9a0d8542d797 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:33.786950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409476f6-e588-4cf6-8a3a-9a0d8542d797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:33.811038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:33.811519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-409476f6-e588-4cf6-8a3a-9a0d8542d797 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:33.811519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-409476f6-e588-4cf6-8a3a-9a0d8542d797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:33.813529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1ca22-637e-4eea-ab11-8cb45c922576 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:33.870193 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 952/1891] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:33.873028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:33.873904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:33.883158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:33.883158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] PATH_INFO: `/v3/projects/a640a512fab142e4afa20342e1946154` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:33.883158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a640a512fab142e4afa20342e1946154)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:33.883158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:33.883525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a131cb-69fe-4ef2-81b1-f419d1999df5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:33.883525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a131cb-69fe-4ef2-81b1-f419d1999df5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:33.883525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a131cb-69fe-4ef2-81b1-f419d1999df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:33.902300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b4a131cb-69fe-4ef2-81b1-f419d1999df5 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:33.904985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b4a131cb-69fe-4ef2-81b1-f419d1999df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:33.916548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 953/1892] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:33.921783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a131cb-69fe-4ef2-81b1-f419d1999df5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:33.931642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a131cb-69fe-4ef2-81b1-f419d1999df5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:33.936519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312094a-487b-4d79-8f93-f0f7995f1217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:33.937203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312094a-487b-4d79-8f93-f0f7995f1217 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:33.937497 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312094a-487b-4d79-8f93-f0f7995f1217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:33.937771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312094a-487b-4d79-8f93-f0f7995f1217 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:33.938500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312094a-487b-4d79-8f93-f0f7995f1217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:33.938808 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312094a-487b-4d79-8f93-f0f7995f1217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:33.940613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312094a-487b-4d79-8f93-f0f7995f1217 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:33.952669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 954/1893] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:33.958635 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312094a-487b-4d79-8f93-f0f7995f1217 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:33.969320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312094a-487b-4d79-8f93-f0f7995f1217 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:33.974045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9c29c-7b1d-4ae2-8184-ba863eb532e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:33.975241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9c29c-7b1d-4ae2-8184-ba863eb532e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:33.975558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9c29c-7b1d-4ae2-8184-ba863eb532e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:33.976993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9c29c-7b1d-4ae2-8184-ba863eb532e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:33.976993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9c29c-7b1d-4ae2-8184-ba863eb532e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:33.978463 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9c29c-7b1d-4ae2-8184-ba863eb532e3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:34.013722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a640a512fab142e4afa20342e1946154', 'request_id': 'req-147ed4b8-8388-4c21-af7c-0826e0422e2b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:34.109960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 955/1894] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:33 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:34.111300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9c29c-7b1d-4ae2-8184-ba863eb532e3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:34.135450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a640a512fab142e4afa20342e1946154', 'request_id': 'req-147ed4b8-8388-4c21-af7c-0826e0422e2b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:34.144272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a640a512fab142e4afa20342e1946154', 'request_id': 'req-147ed4b8-8388-4c21-af7c-0826e0422e2b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:34.156983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] The token cache is being invalidate because project a640a512fab142e4afa20342e1946154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:34.157347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:34.158029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:34.159890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 940/1895] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:33 2022] DELETE /identity/v3/projects/a640a512fab142e4afa20342e1946154 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:34.164286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:34.165877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:34.181104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9c29c-7b1d-4ae2-8184-ba863eb532e3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:34.186673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803871a-5d13-4d77-912e-2b1a7e388bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:34.187313 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803871a-5d13-4d77-912e-2b1a7e388bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:34.187748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803871a-5d13-4d77-912e-2b1a7e388bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:34.188011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803871a-5d13-4d77-912e-2b1a7e388bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:34.188898 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803871a-5d13-4d77-912e-2b1a7e388bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:34.190925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803871a-5d13-4d77-912e-2b1a7e388bc6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:34.231014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ed4b8-8388-4c21-af7c-0826e0422e2b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:34.235905 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:34.236900 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:34.237180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:34.237454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] PATH_INFO: `/v3/users/16e4c40bfc0145e1a3ef7352815a1e3e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:34.238649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e4c40bfc0145e1a3ef7352815a1e3e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:34.240942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:34.317135 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 956/1896] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:34 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:34.329299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803871a-5d13-4d77-912e-2b1a7e388bc6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:34.330972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c803871a-5d13-4d77-912e-2b1a7e388bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:34.343842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803871a-5d13-4d77-912e-2b1a7e388bc6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:34.348916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770045a-0c81-4bf9-a52e-18e276e0a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:34.349637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770045a-0c81-4bf9-a52e-18e276e0a335 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:34.353978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770045a-0c81-4bf9-a52e-18e276e0a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:34.353978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770045a-0c81-4bf9-a52e-18e276e0a335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:34.353978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770045a-0c81-4bf9-a52e-18e276e0a335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:34.353978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770045a-0c81-4bf9-a52e-18e276e0a335 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:34.362587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 957/1897] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:34.366299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770045a-0c81-4bf9-a52e-18e276e0a335 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:34.375851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770045a-0c81-4bf9-a52e-18e276e0a335 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:34.382300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249297c-8575-4c8b-9245-88f0be125e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:34.383080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249297c-8575-4c8b-9245-88f0be125e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:34.383419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249297c-8575-4c8b-9245-88f0be125e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:34.386590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249297c-8575-4c8b-9245-88f0be125e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:34.386590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249297c-8575-4c8b-9245-88f0be125e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:34.386590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249297c-8575-4c8b-9245-88f0be125e56 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:34.399226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 958/1898] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:34.403253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249297c-8575-4c8b-9245-88f0be125e56 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:34.413911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249297c-8575-4c8b-9245-88f0be125e56 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:34.418711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c7364-f511-4918-95d2-39b180d2fdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:34.419654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c7364-f511-4918-95d2-39b180d2fdd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:34.419945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c7364-f511-4918-95d2-39b180d2fdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:34.420225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c7364-f511-4918-95d2-39b180d2fdd0 admin admin] PATH_INFO: `/v3/projects/80d4f256b41e4d8d8d7e15e2fafe7f9d/users/5b084cfcdf1e4b36bec7e1330f30ab39/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:34.435395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c7364-f511-4918-95d2-39b180d2fdd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d4f256b41e4d8d8d7e15e2fafe7f9d, user_id=5b084cfcdf1e4b36bec7e1330f30ab39, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:34.438866 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c7364-f511-4918-95d2-39b180d2fdd0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:34.501026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e4c40bfc0145e1a3ef7352815a1e3e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:34.501682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e4c40bfc0145e1a3ef7352815a1e3e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:34.502312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e4c40bfc0145e1a3ef7352815a1e3e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:34.514495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e4c40bfc0145e1a3ef7352815a1e3e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:34.521545 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e4c40bfc0145e1a3ef7352815a1e3e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:34.526610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 959/1899] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:34 2022] PUT /identity/v3/projects/80d4f256b41e4d8d8d7e15e2fafe7f9d/users/5b084cfcdf1e4b36bec7e1330f30ab39/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:34.536868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d703fa-b0b9-402d-b67f-7b2b9a10424d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:34.537155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d703fa-b0b9-402d-b67f-7b2b9a10424d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:34.537431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d703fa-b0b9-402d-b67f-7b2b9a10424d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:34.562921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a7d703fa-b0b9-402d-b67f-7b2b9a10424d None None] MFA Rules not processed for user `5b084cfcdf1e4b36bec7e1330f30ab39`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:34.564205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a7d703fa-b0b9-402d-b67f-7b2b9a10424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:34.625564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 960/1900] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:34.630177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d703fa-b0b9-402d-b67f-7b2b9a10424d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:34.632118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a7d703fa-b0b9-402d-b67f-7b2b9a10424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:34.634716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 941/1901] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:34 2022] DELETE /identity/v3/users/16e4c40bfc0145e1a3ef7352815a1e3e => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:34.697083 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d703fa-b0b9-402d-b67f-7b2b9a10424d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:34.755584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9a373-048f-4506-9408-be29b3e0b19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:34.756812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9a373-048f-4506-9408-be29b3e0b19d admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:34.757098 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9a373-048f-4506-9408-be29b3e0b19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:34.757373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9a373-048f-4506-9408-be29b3e0b19d admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:34.758061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9a373-048f-4506-9408-be29b3e0b19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:34.759951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9a373-048f-4506-9408-be29b3e0b19d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:34.820132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:34.862314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 961/1902] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:34 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:34.864128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:34.885273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcfdc6-2b64-4ccb-bbe9-b331d2269a1d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:34.946256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9f9e1-ffae-48de-9af2-7459b5f7df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:34.946967 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9f9e1-ffae-48de-9af2-7459b5f7df73 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:34.947301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9f9e1-ffae-48de-9af2-7459b5f7df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:34.947523 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9f9e1-ffae-48de-9af2-7459b5f7df73 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:34.948202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9f9e1-ffae-48de-9af2-7459b5f7df73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:34.950313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9f9e1-ffae-48de-9af2-7459b5f7df73 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:35.131082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9a373-048f-4506-9408-be29b3e0b19d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:35.133003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b3f9a373-048f-4506-9408-be29b3e0b19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:35.133223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 942/1903] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:34 2022] POST /identity/v3/users => generated 300 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:35.137061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9f9e1-ffae-48de-9af2-7459b5f7df73 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:35.149941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9a373-048f-4506-9408-be29b3e0b19d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:35.156419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9f9e1-ffae-48de-9af2-7459b5f7df73 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:35.164042 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860739f0-62d1-44e4-b247-302ca691c9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:35.164150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397daa4c-1b32-4857-b0c9-11f3f2bf05b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:35.164244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860739f0-62d1-44e4-b247-302ca691c9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.164333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397daa4c-1b32-4857-b0c9-11f3f2bf05b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.164333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397daa4c-1b32-4857-b0c9-11f3f2bf05b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.164485 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860739f0-62d1-44e4-b247-302ca691c9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.164564 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397daa4c-1b32-4857-b0c9-11f3f2bf05b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.164690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860739f0-62d1-44e4-b247-302ca691c9b3 admin admin] PATH_INFO: `/v3/projects/01e4c70f64fa4f729bcff09243c71231` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.164836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397daa4c-1b32-4857-b0c9-11f3f2bf05b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:35.165342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860739f0-62d1-44e4-b247-302ca691c9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e4c70f64fa4f729bcff09243c71231)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:35.166642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397daa4c-1b32-4857-b0c9-11f3f2bf05b3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:35.167252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860739f0-62d1-44e4-b247-302ca691c9b3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:35.177576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 943/1904] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:35.182251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397daa4c-1b32-4857-b0c9-11f3f2bf05b3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:35.192067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397daa4c-1b32-4857-b0c9-11f3f2bf05b3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:35.196772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e6d54-35c9-4245-a4ec-973d1da151f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:35.198186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e6d54-35c9-4245-a4ec-973d1da151f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.198186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e6d54-35c9-4245-a4ec-973d1da151f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.198186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e6d54-35c9-4245-a4ec-973d1da151f2 admin admin] PATH_INFO: `/v3/projects/a66b809e10954d9986120206bb6f5c19/users/b1655b5606814533804c80e98f44ecbc/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.212348 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e6d54-35c9-4245-a4ec-973d1da151f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66b809e10954d9986120206bb6f5c19, user_id=b1655b5606814533804c80e98f44ecbc, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:35.215088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e6d54-35c9-4245-a4ec-973d1da151f2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:35.387871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 944/1905] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:35 2022] PUT /identity/v3/projects/a66b809e10954d9986120206bb6f5c19/users/b1655b5606814533804c80e98f44ecbc/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:35.393226 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e6d54-35c9-4245-a4ec-973d1da151f2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:35.411414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-860739f0-62d1-44e4-b247-302ca691c9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e4c70f64fa4f729bcff09243c71231', 'request_id': 'req-860739f0-62d1-44e4-b247-302ca691c9b3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:35.419364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-860739f0-62d1-44e4-b247-302ca691c9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e4c70f64fa4f729bcff09243c71231', 'request_id': 'req-860739f0-62d1-44e4-b247-302ca691c9b3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:35.425317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-860739f0-62d1-44e4-b247-302ca691c9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e4c70f64fa4f729bcff09243c71231', 'request_id': 'req-860739f0-62d1-44e4-b247-302ca691c9b3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:35.472193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e6d54-35c9-4245-a4ec-973d1da151f2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:35.529530 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-860739f0-62d1-44e4-b247-302ca691c9b3 admin admin] The token cache is being invalidate because project 01e4c70f64fa4f729bcff09243c71231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:35.529895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-860739f0-62d1-44e4-b247-302ca691c9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:35.530699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-860739f0-62d1-44e4-b247-302ca691c9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:35.532831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 962/1906] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:35 2022] DELETE /identity/v3/projects/01e4c70f64fa4f729bcff09243c71231 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:35.538916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fdf05-f8dd-4795-be33-76eb6e920c1e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.539457 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fdf05-f8dd-4795-be33-76eb6e920c1e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.539896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fdf05-f8dd-4795-be33-76eb6e920c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.547107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66230b94-d44a-4708-a46e-9b6af207fe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:35.547879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66230b94-d44a-4708-a46e-9b6af207fe9b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.548235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66230b94-d44a-4708-a46e-9b6af207fe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.548586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66230b94-d44a-4708-a46e-9b6af207fe9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.549425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66230b94-d44a-4708-a46e-9b6af207fe9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:35.551103 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66230b94-d44a-4708-a46e-9b6af207fe9b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:35.558559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-555fdf05-f8dd-4795-be33-76eb6e920c1e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:35.559954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-555fdf05-f8dd-4795-be33-76eb6e920c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:35.565095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 945/1907] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:35.566265 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66230b94-d44a-4708-a46e-9b6af207fe9b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:35.568039 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-66230b94-d44a-4708-a46e-9b6af207fe9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:35.571152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 963/1908] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:35.578744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00514cd-c6dc-4dc0-bf86-bca69285b743 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.579031 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00514cd-c6dc-4dc0-bf86-bca69285b743 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.579308 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00514cd-c6dc-4dc0-bf86-bca69285b743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.582019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66230b94-d44a-4708-a46e-9b6af207fe9b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:35.591208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59480ef6-bba6-41c8-9c10-41e81821cd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:35.591208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480ef6-bba6-41c8-9c10-41e81821cd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.591208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480ef6-bba6-41c8-9c10-41e81821cd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.591208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480ef6-bba6-41c8-9c10-41e81821cd5d admin admin] PATH_INFO: `/v3/projects/a66b809e10954d9986120206bb6f5c19/users/b1655b5606814533804c80e98f44ecbc/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.592901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59480ef6-bba6-41c8-9c10-41e81821cd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66b809e10954d9986120206bb6f5c19, user_id=b1655b5606814533804c80e98f44ecbc, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:35.595696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59480ef6-bba6-41c8-9c10-41e81821cd5d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:35.598851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f00514cd-c6dc-4dc0-bf86-bca69285b743 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:35.601467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f00514cd-c6dc-4dc0-bf86-bca69285b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:35.608026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 946/1909] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:35 2022] PUT /identity/v3/projects/a66b809e10954d9986120206bb6f5c19/users/b1655b5606814533804c80e98f44ecbc/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:35.617848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68d839-e549-4b6c-9047-412af7ae84fe None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.618147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68d839-e549-4b6c-9047-412af7ae84fe None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.618988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68d839-e549-4b6c-9047-412af7ae84fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.621847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:35.658345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ed68d839-e549-4b6c-9047-412af7ae84fe None None] MFA Rules not processed for user `b1655b5606814533804c80e98f44ecbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:35.659774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ed68d839-e549-4b6c-9047-412af7ae84fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:35.681422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 964/1910] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:35.687506 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00514cd-c6dc-4dc0-bf86-bca69285b743 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:35.697338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00514cd-c6dc-4dc0-bf86-bca69285b743 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:35.702055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb143fa1-94c2-47d1-9a14-34a13c21fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:35.702772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb143fa1-94c2-47d1-9a14-34a13c21fd51 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.703052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb143fa1-94c2-47d1-9a14-34a13c21fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.703326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb143fa1-94c2-47d1-9a14-34a13c21fd51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.704053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb143fa1-94c2-47d1-9a14-34a13c21fd51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:35.704364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb143fa1-94c2-47d1-9a14-34a13c21fd51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:35.706016 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb143fa1-94c2-47d1-9a14-34a13c21fd51 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:35.718661 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 965/1911] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:13:35.728318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb143fa1-94c2-47d1-9a14-34a13c21fd51 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:35.732178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb143fa1-94c2-47d1-9a14-34a13c21fd51 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:35.737143 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e4fa8-d03a-41cf-8277-ca7460280956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:35.737874 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e4fa8-d03a-41cf-8277-ca7460280956 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.738157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e4fa8-d03a-41cf-8277-ca7460280956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.738479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e4fa8-d03a-41cf-8277-ca7460280956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.739162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e4fa8-d03a-41cf-8277-ca7460280956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:35.741172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e4fa8-d03a-41cf-8277-ca7460280956 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:35.744398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 947/1912] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:35.754838 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68d839-e549-4b6c-9047-412af7ae84fe None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:35.756900 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ed68d839-e549-4b6c-9047-412af7ae84fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:35.810170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68d839-e549-4b6c-9047-412af7ae84fe None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:35.813721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1b3e1-285d-426e-b773-684b4b064076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:35.814357 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1b3e1-285d-426e-b773-684b4b064076 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.814639 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1b3e1-285d-426e-b773-684b4b064076 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.814912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1b3e1-285d-426e-b773-684b4b064076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.824190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1b3e1-285d-426e-b773-684b4b064076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:35.825642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1b3e1-285d-426e-b773-684b4b064076 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:35.835528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 948/1913] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:35.861504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 966/1914] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:35 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:35.865636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1b3e1-285d-426e-b773-684b4b064076 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:35.877429 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1b3e1-285d-426e-b773-684b4b064076 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:35.944651 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00ae08-5ea9-480c-8cea-c98312fd02bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:35.945360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00ae08-5ea9-480c-8cea-c98312fd02bb admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.945645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00ae08-5ea9-480c-8cea-c98312fd02bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.945925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00ae08-5ea9-480c-8cea-c98312fd02bb admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.946676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00ae08-5ea9-480c-8cea-c98312fd02bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:35.948771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00ae08-5ea9-480c-8cea-c98312fd02bb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:35.977190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e4fa8-d03a-41cf-8277-ca7460280956 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:35.988501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e4fa8-d03a-41cf-8277-ca7460280956 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:35.993155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df63b8-c0ca-47ee-b030-c168a325928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:35.994021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df63b8-c0ca-47ee-b030-c168a325928a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:35.994298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df63b8-c0ca-47ee-b030-c168a325928a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:35.994574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df63b8-c0ca-47ee-b030-c168a325928a admin admin] PATH_INFO: `/v3/users/5b084cfcdf1e4b36bec7e1330f30ab39` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:35.995806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df63b8-c0ca-47ee-b030-c168a325928a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b084cfcdf1e4b36bec7e1330f30ab39)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:35.997740 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df63b8-c0ca-47ee-b030-c168a325928a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:36.043697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 949/1915] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:35 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:36.044548 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00ae08-5ea9-480c-8cea-c98312fd02bb admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:36.054767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00ae08-5ea9-480c-8cea-c98312fd02bb admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:36.059853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3acde-7892-4888-9e37-0bd553738855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:36.060524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3acde-7892-4888-9e37-0bd553738855 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:36.060844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3acde-7892-4888-9e37-0bd553738855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:36.061251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3acde-7892-4888-9e37-0bd553738855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:36.062003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3acde-7892-4888-9e37-0bd553738855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:36.063600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3acde-7892-4888-9e37-0bd553738855 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:36.074642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 950/1916] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:36.079955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3acde-7892-4888-9e37-0bd553738855 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:36.090142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3acde-7892-4888-9e37-0bd553738855 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:36.094766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e62a97-9fba-4233-8500-85c1f1233c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:36.095418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e62a97-9fba-4233-8500-85c1f1233c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:36.095702 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e62a97-9fba-4233-8500-85c1f1233c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:36.095979 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e62a97-9fba-4233-8500-85c1f1233c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:36.096746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e62a97-9fba-4233-8500-85c1f1233c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:36.098330 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e62a97-9fba-4233-8500-85c1f1233c74 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:36.108207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 951/1917] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:36.111864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e62a97-9fba-4233-8500-85c1f1233c74 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:36.122333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e62a97-9fba-4233-8500-85c1f1233c74 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:36.127120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637129c-943a-4c18-851d-b517661ff484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:36.128112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637129c-943a-4c18-851d-b517661ff484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:36.128535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637129c-943a-4c18-851d-b517661ff484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:36.128730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637129c-943a-4c18-851d-b517661ff484 admin admin] PATH_INFO: `/v3/projects/1e14b9c1803f4d5186aa53a930182945/users/5f7d00775d63445d85ce42ef0c74de6e/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:36.144618 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637129c-943a-4c18-851d-b517661ff484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e14b9c1803f4d5186aa53a930182945, user_id=5f7d00775d63445d85ce42ef0c74de6e, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:36.147252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637129c-943a-4c18-851d-b517661ff484 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:36.210146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-00df63b8-c0ca-47ee-b030-c168a325928a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b084cfcdf1e4b36bec7e1330f30ab39'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:36.210786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-00df63b8-c0ca-47ee-b030-c168a325928a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b084cfcdf1e4b36bec7e1330f30ab39'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:36.299123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 952/1918] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:36 2022] PUT /identity/v3/projects/1e14b9c1803f4d5186aa53a930182945/users/5f7d00775d63445d85ce42ef0c74de6e/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:36.310707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d2102-4307-4374-98d7-a2316f5e653d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:36.310994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d2102-4307-4374-98d7-a2316f5e653d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:36.311273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d2102-4307-4374-98d7-a2316f5e653d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:36.327907 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-00df63b8-c0ca-47ee-b030-c168a325928a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b084cfcdf1e4b36bec7e1330f30ab39'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:36.338035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3f5d2102-4307-4374-98d7-a2316f5e653d None None] MFA Rules not processed for user `5f7d00775d63445d85ce42ef0c74de6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:36.339277 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3f5d2102-4307-4374-98d7-a2316f5e653d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:36.341153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-00df63b8-c0ca-47ee-b030-c168a325928a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b084cfcdf1e4b36bec7e1330f30ab39'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:36.348132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-00df63b8-c0ca-47ee-b030-c168a325928a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b084cfcdf1e4b36bec7e1330f30ab39'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:36.354188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 967/1919] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:35 2022] DELETE /identity/v3/users/5b084cfcdf1e4b36bec7e1330f30ab39 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:36.359104 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304394-bc53-49f7-877a-4f649a778862 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:36.359396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304394-bc53-49f7-877a-4f649a778862 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:36.361233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304394-bc53-49f7-877a-4f649a778862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:36.377354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-39304394-bc53-49f7-877a-4f649a778862 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:36.378541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-39304394-bc53-49f7-877a-4f649a778862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:36.403217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 953/1920] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:36.407665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d2102-4307-4374-98d7-a2316f5e653d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:36.409100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3f5d2102-4307-4374-98d7-a2316f5e653d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:36.441484 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 968/1921] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:36.450867 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304394-bc53-49f7-877a-4f649a778862 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:36.454901 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-39304394-bc53-49f7-877a-4f649a778862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:36.499809 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d2102-4307-4374-98d7-a2316f5e653d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:36.504881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162bc09-8fad-4610-81bc-81ffac494eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:36.505808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162bc09-8fad-4610-81bc-81ffac494eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:36.506100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162bc09-8fad-4610-81bc-81ffac494eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:36.506381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162bc09-8fad-4610-81bc-81ffac494eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:36.507094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162bc09-8fad-4610-81bc-81ffac494eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:36.509028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162bc09-8fad-4610-81bc-81ffac494eb2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:36.521329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304394-bc53-49f7-877a-4f649a778862 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:36.526367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312652d-97d6-45ef-9bb6-a76ae79bf950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:36.527035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312652d-97d6-45ef-9bb6-a76ae79bf950 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:36.527326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312652d-97d6-45ef-9bb6-a76ae79bf950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:36.527613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312652d-97d6-45ef-9bb6-a76ae79bf950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:36.539482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312652d-97d6-45ef-9bb6-a76ae79bf950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:36.541138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312652d-97d6-45ef-9bb6-a76ae79bf950 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:36.551652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 969/1922] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:36.687336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 954/1923] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:36 2022] POST /identity/v3/projects => generated 381 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:36.694802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312652d-97d6-45ef-9bb6-a76ae79bf950 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:36.700687 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312652d-97d6-45ef-9bb6-a76ae79bf950 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:36.760059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138cf0c-8725-4a32-87f1-1d84b6f7a645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:36.760768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138cf0c-8725-4a32-87f1-1d84b6f7a645 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:36.761063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138cf0c-8725-4a32-87f1-1d84b6f7a645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:36.761336 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138cf0c-8725-4a32-87f1-1d84b6f7a645 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:36.762038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138cf0c-8725-4a32-87f1-1d84b6f7a645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:36.763944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138cf0c-8725-4a32-87f1-1d84b6f7a645 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:36.838603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 970/1924] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:36 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:36.843417 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162bc09-8fad-4610-81bc-81ffac494eb2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:36.855839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162bc09-8fad-4610-81bc-81ffac494eb2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:36.862413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e85bb-df55-439e-86fc-fdca3262f20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:36.863509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e85bb-df55-439e-86fc-fdca3262f20c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:36.863509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e85bb-df55-439e-86fc-fdca3262f20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:36.863681 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e85bb-df55-439e-86fc-fdca3262f20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:36.864418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e85bb-df55-439e-86fc-fdca3262f20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:36.866083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e85bb-df55-439e-86fc-fdca3262f20c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:36.877396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 955/1925] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:36.881590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138cf0c-8725-4a32-87f1-1d84b6f7a645 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:36.891334 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138cf0c-8725-4a32-87f1-1d84b6f7a645 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:36.896191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1dcf2-3af2-4b8f-8d70-3c9795750985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:36.897643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1dcf2-3af2-4b8f-8d70-3c9795750985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:36.897925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1dcf2-3af2-4b8f-8d70-3c9795750985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:36.898200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1dcf2-3af2-4b8f-8d70-3c9795750985 admin admin] PATH_INFO: `/v3/projects/d61d25b1071146b282499851aacecc54/users/9607e9d0197244c9a8e0bf0a9a2af2cc/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:36.914138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1dcf2-3af2-4b8f-8d70-3c9795750985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61d25b1071146b282499851aacecc54, user_id=9607e9d0197244c9a8e0bf0a9a2af2cc, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:36.916890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1dcf2-3af2-4b8f-8d70-3c9795750985 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:36.990604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 971/1926] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:36 2022] PUT /identity/v3/projects/d61d25b1071146b282499851aacecc54/users/9607e9d0197244c9a8e0bf0a9a2af2cc/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:36.995443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e85bb-df55-439e-86fc-fdca3262f20c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:37.005344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e85bb-df55-439e-86fc-fdca3262f20c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:37.020991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1dcf2-3af2-4b8f-8d70-3c9795750985 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:37.023488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-83d1dcf2-3af2-4b8f-8d70-3c9795750985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:37.066593 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc80eb-ce59-42dc-b742-7dd66a9f9992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:37.067293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc80eb-ce59-42dc-b742-7dd66a9f9992 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:37.067582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc80eb-ce59-42dc-b742-7dd66a9f9992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:37.067864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc80eb-ce59-42dc-b742-7dd66a9f9992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:37.068653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc80eb-ce59-42dc-b742-7dd66a9f9992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:37.070307 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc80eb-ce59-42dc-b742-7dd66a9f9992 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:37.080922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 956/1927] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:37.085578 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc80eb-ce59-42dc-b742-7dd66a9f9992 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:37.097250 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc80eb-ce59-42dc-b742-7dd66a9f9992 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:37.102828 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22393770-7129-48ed-ab8c-1c5c0ad42bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:37.103861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22393770-7129-48ed-ab8c-1c5c0ad42bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:37.104284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22393770-7129-48ed-ab8c-1c5c0ad42bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:37.104639 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22393770-7129-48ed-ab8c-1c5c0ad42bc9 admin admin] PATH_INFO: `/v3/projects/d61d25b1071146b282499851aacecc54/users/9607e9d0197244c9a8e0bf0a9a2af2cc/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:37.107555 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22393770-7129-48ed-ab8c-1c5c0ad42bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61d25b1071146b282499851aacecc54, user_id=9607e9d0197244c9a8e0bf0a9a2af2cc, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:37.109168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1dcf2-3af2-4b8f-8d70-3c9795750985 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:37.110958 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22393770-7129-48ed-ab8c-1c5c0ad42bc9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:37.121749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:37.121749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:37.121749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:37.121749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] PATH_INFO: `/v3/projects/80d4f256b41e4d8d8d7e15e2fafe7f9d` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:37.122129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d4f256b41e4d8d8d7e15e2fafe7f9d)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:37.122129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:37.125510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 957/1928] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:37 2022] PUT /identity/v3/projects/d61d25b1071146b282499851aacecc54/users/9607e9d0197244c9a8e0bf0a9a2af2cc/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:37.135517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84963977-22ff-4b58-83ba-575ca65eef72 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:37.135814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84963977-22ff-4b58-83ba-575ca65eef72 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:37.136095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84963977-22ff-4b58-83ba-575ca65eef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:37.166980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-84963977-22ff-4b58-83ba-575ca65eef72 None None] MFA Rules not processed for user `9607e9d0197244c9a8e0bf0a9a2af2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:37.168338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-84963977-22ff-4b58-83ba-575ca65eef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:37.255156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:37.256451 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 958/1929] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:37.267799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84963977-22ff-4b58-83ba-575ca65eef72 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:37.269230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-84963977-22ff-4b58-83ba-575ca65eef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:37.284752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d4f256b41e4d8d8d7e15e2fafe7f9d', 'request_id': 'req-f0902543-8dc4-48c7-97da-4f95499ecb46'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:37.290928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d4f256b41e4d8d8d7e15e2fafe7f9d', 'request_id': 'req-f0902543-8dc4-48c7-97da-4f95499ecb46'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:37.296420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d4f256b41e4d8d8d7e15e2fafe7f9d', 'request_id': 'req-f0902543-8dc4-48c7-97da-4f95499ecb46'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:37.327204 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84963977-22ff-4b58-83ba-575ca65eef72 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:37.373810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdad8b-a443-4ff2-b9d0-37808b1ca344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:37.374458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdad8b-a443-4ff2-b9d0-37808b1ca344 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:37.374761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdad8b-a443-4ff2-b9d0-37808b1ca344 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:37.375039 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdad8b-a443-4ff2-b9d0-37808b1ca344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:37.435359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdad8b-a443-4ff2-b9d0-37808b1ca344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:37.436455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] The token cache is being invalidate because project 80d4f256b41e4d8d8d7e15e2fafe7f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:37.436931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdad8b-a443-4ff2-b9d0-37808b1ca344 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:37.437094 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:37.438005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:37.442433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 972/1930] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:37 2022] DELETE /identity/v3/projects/80d4f256b41e4d8d8d7e15e2fafe7f9d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:37.444513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:37.446003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:37.447725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 959/1931] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:37.513083 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0902543-8dc4-48c7-97da-4f95499ecb46 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:37.518220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:37.519114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:37.519400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:37.519686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] PATH_INFO: `/v3/users/b1655b5606814533804c80e98f44ecbc` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:37.521138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1655b5606814533804c80e98f44ecbc)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:37.523651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:37.761383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1655b5606814533804c80e98f44ecbc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:37.762377 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1655b5606814533804c80e98f44ecbc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:37.869269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1655b5606814533804c80e98f44ecbc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:37.880910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1655b5606814533804c80e98f44ecbc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:37.889548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1655b5606814533804c80e98f44ecbc'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:37.896734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 973/1932] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:37 2022] DELETE /identity/v3/users/b1655b5606814533804c80e98f44ecbc => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:37.899743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:38.147821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdad8b-a443-4ff2-b9d0-37808b1ca344 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:38.158665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdad8b-a443-4ff2-b9d0-37808b1ca344 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:38.221574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:38.222854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:38.223546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:38.224004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] PATH_INFO: `/v3/users/5f7d00775d63445d85ce42ef0c74de6e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:38.226183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7d00775d63445d85ce42ef0c74de6e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:38.228265 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:38.411660 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:38.413937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:38.431055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212816d-624e-4f5d-bf54-c6665d6ccd22 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:38.432705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a577d5-e4ca-45e4-ade0-016a13a91501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:38.433650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a577d5-e4ca-45e4-ade0-016a13a91501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:38.434052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a577d5-e4ca-45e4-ade0-016a13a91501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:38.434440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a577d5-e4ca-45e4-ade0-016a13a91501 admin admin] PATH_INFO: `/v3/users/daf07074f155449aa5e39c5b4253db2e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:38.435782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a577d5-e4ca-45e4-ade0-016a13a91501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf07074f155449aa5e39c5b4253db2e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:38.438627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a577d5-e4ca-45e4-ade0-016a13a91501 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:38.492319 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7d00775d63445d85ce42ef0c74de6e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:38.493115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7d00775d63445d85ce42ef0c74de6e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:38.493783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7d00775d63445d85ce42ef0c74de6e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:38.506277 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7d00775d63445d85ce42ef0c74de6e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:38.513523 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7d00775d63445d85ce42ef0c74de6e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:38.607675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 960/1933] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:38 2022] DELETE /identity/v3/users/5f7d00775d63445d85ce42ef0c74de6e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:38.608835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:38.610567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:38.631658 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:38.650780 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e6a577d5-e4ca-45e4-ade0-016a13a91501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf07074f155449aa5e39c5b4253db2e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:38.651371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e6a577d5-e4ca-45e4-ade0-016a13a91501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf07074f155449aa5e39c5b4253db2e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:38.697696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754927aa-352c-4099-b955-684dc1beb72c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:38.702282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b659d8f-57cd-42d1-a546-8836de15aa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:38.703148 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b659d8f-57cd-42d1-a546-8836de15aa19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:38.703437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b659d8f-57cd-42d1-a546-8836de15aa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:38.703716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b659d8f-57cd-42d1-a546-8836de15aa19 admin admin] PATH_INFO: `/v3/projects/a66b809e10954d9986120206bb6f5c19` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:38.704929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b659d8f-57cd-42d1-a546-8836de15aa19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a66b809e10954d9986120206bb6f5c19)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:38.706837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b659d8f-57cd-42d1-a546-8836de15aa19 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:38.722282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e6a577d5-e4ca-45e4-ade0-016a13a91501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf07074f155449aa5e39c5b4253db2e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:38.740275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e6a577d5-e4ca-45e4-ade0-016a13a91501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf07074f155449aa5e39c5b4253db2e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:38.757439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e6a577d5-e4ca-45e4-ade0-016a13a91501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf07074f155449aa5e39c5b4253db2e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:38.767577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 974/1934] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:38 2022] DELETE /identity/v3/users/daf07074f155449aa5e39c5b4253db2e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:38.770864 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361fb5a-8091-4061-a7c6-29b1a5fd90bf None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:38.771167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361fb5a-8091-4061-a7c6-29b1a5fd90bf None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:38.772092 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361fb5a-8091-4061-a7c6-29b1a5fd90bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:38.809821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a361fb5a-8091-4061-a7c6-29b1a5fd90bf None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:38.811006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a361fb5a-8091-4061-a7c6-29b1a5fd90bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:38.864508 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0b659d8f-57cd-42d1-a546-8836de15aa19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66b809e10954d9986120206bb6f5c19', 'request_id': 'req-0b659d8f-57cd-42d1-a546-8836de15aa19'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:38.885169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 975/1935] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:38.886762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807e9f-999a-4236-b9ef-fd1918984368 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:38.887047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807e9f-999a-4236-b9ef-fd1918984368 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:38.887322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807e9f-999a-4236-b9ef-fd1918984368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:38.906247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c9807e9f-999a-4236-b9ef-fd1918984368 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:38.907792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c9807e9f-999a-4236-b9ef-fd1918984368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:38.981829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 976/1936] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:38.981829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9807e9f-999a-4236-b9ef-fd1918984368 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:38.981829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c9807e9f-999a-4236-b9ef-fd1918984368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.006267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0b659d8f-57cd-42d1-a546-8836de15aa19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66b809e10954d9986120206bb6f5c19', 'request_id': 'req-0b659d8f-57cd-42d1-a546-8836de15aa19'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:39.017494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0b659d8f-57cd-42d1-a546-8836de15aa19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66b809e10954d9986120206bb6f5c19', 'request_id': 'req-0b659d8f-57cd-42d1-a546-8836de15aa19'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:39.031438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0b659d8f-57cd-42d1-a546-8836de15aa19 admin admin] The token cache is being invalidate because project a66b809e10954d9986120206bb6f5c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:39.031822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0b659d8f-57cd-42d1-a546-8836de15aa19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:39.032846 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0b659d8f-57cd-42d1-a546-8836de15aa19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:39.035358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 961/1937] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:38 2022] DELETE /identity/v3/projects/a66b809e10954d9986120206bb6f5c19 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:39.040266 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b4eb6-281c-47ac-847b-1e1ec9e93c7f None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.044683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b4eb6-281c-47ac-847b-1e1ec9e93c7f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.045074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b4eb6-281c-47ac-847b-1e1ec9e93c7f None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.045587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9807e9f-999a-4236-b9ef-fd1918984368 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:39.047116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 962/1938] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 23 13:13:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:13:39.048212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b4eb6-281c-47ac-847b-1e1ec9e93c7f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:39.050194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b07e1b-f702-49fb-99a3-92f12791d8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:39.051175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b07e1b-f702-49fb-99a3-92f12791d8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.051175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b07e1b-f702-49fb-99a3-92f12791d8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.051520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b07e1b-f702-49fb-99a3-92f12791d8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.053635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-315b4eb6-281c-47ac-847b-1e1ec9e93c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.057081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-01b07e1b-f702-49fb-99a3-92f12791d8a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.069293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b4eb6-281c-47ac-847b-1e1ec9e93c7f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:39.079658 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce51036-529b-410e-a80d-b277b6e7587d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:39.079869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b07e1b-f702-49fb-99a3-92f12791d8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:39.079987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce51036-529b-410e-a80d-b277b6e7587d service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.079987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce51036-529b-410e-a80d-b277b6e7587d service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.079987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce51036-529b-410e-a80d-b277b6e7587d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.080216 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b07e1b-f702-49fb-99a3-92f12791d8a8 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:39.082494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dce51036-529b-410e-a80d-b277b6e7587d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.088272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 977/1939] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:39.089437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b07e1b-f702-49fb-99a3-92f12791d8a8 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:39.105475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-01b07e1b-f702-49fb-99a3-92f12791d8a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.121651 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce51036-529b-410e-a80d-b277b6e7587d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:39.123113 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce51036-529b-410e-a80d-b277b6e7587d service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:39.123545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b07e1b-f702-49fb-99a3-92f12791d8a8 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:39.131952 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49538d-60db-4acc-a9d9-6a3863fe1a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:39.133473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49538d-60db-4acc-a9d9-6a3863fe1a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.133883 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49538d-60db-4acc-a9d9-6a3863fe1a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.134380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49538d-60db-4acc-a9d9-6a3863fe1a7b admin admin] PATH_INFO: `/v3/users/20f326ef67134224b248c99fa4942637` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.136623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49538d-60db-4acc-a9d9-6a3863fe1a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f326ef67134224b248c99fa4942637)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:39.139557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49538d-60db-4acc-a9d9-6a3863fe1a7b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:39.147611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 963/1940] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:39.149168 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bfe60-2e7b-49e7-bc25-1b12c982792e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.149460 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bfe60-2e7b-49e7-bc25-1b12c982792e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.149741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bfe60-2e7b-49e7-bc25-1b12c982792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.201929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-935bfe60-2e7b-49e7-bc25-1b12c982792e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:39.203269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-935bfe60-2e7b-49e7-bc25-1b12c982792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.214780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 964/1941] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:39.216402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f8791-0701-4c88-a8c4-ffcbeee1b5be None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.216989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f8791-0701-4c88-a8c4-ffcbeee1b5be None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.217439 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f8791-0701-4c88-a8c4-ffcbeee1b5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.247924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f12f8791-0701-4c88-a8c4-ffcbeee1b5be None None] MFA Rules not processed for user `5874e98df57242028c0f9983dee3b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:39.250234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f12f8791-0701-4c88-a8c4-ffcbeee1b5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.339821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 965/1942] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 23 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:39.345195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827d2b0-787a-4852-91bb-13e0cc159038 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.348750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827d2b0-787a-4852-91bb-13e0cc159038 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.349111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827d2b0-787a-4852-91bb-13e0cc159038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.383286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f827d2b0-787a-4852-91bb-13e0cc159038 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:39.384510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f827d2b0-787a-4852-91bb-13e0cc159038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.392900 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 966/1943] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:39.393823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827d2b0-787a-4852-91bb-13e0cc159038 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:39.395055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f827d2b0-787a-4852-91bb-13e0cc159038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.411635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827d2b0-787a-4852-91bb-13e0cc159038 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:39.420770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf179591-3cff-43eb-934c-6aec66714e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:39.420770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf179591-3cff-43eb-934c-6aec66714e71 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.420770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf179591-3cff-43eb-934c-6aec66714e71 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.420770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf179591-3cff-43eb-934c-6aec66714e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.429633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf179591-3cff-43eb-934c-6aec66714e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:39.431230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf179591-3cff-43eb-934c-6aec66714e71 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:39.442031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 967/1944] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:39.442780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf179591-3cff-43eb-934c-6aec66714e71 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:39.453568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf179591-3cff-43eb-934c-6aec66714e71 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:39.459686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da95ee6-9ad0-4457-8340-f76e5137bb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:39.460871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da95ee6-9ad0-4457-8340-f76e5137bb5b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.461383 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da95ee6-9ad0-4457-8340-f76e5137bb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.461600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da95ee6-9ad0-4457-8340-f76e5137bb5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.485570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da95ee6-9ad0-4457-8340-f76e5137bb5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:39.485570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da95ee6-9ad0-4457-8340-f76e5137bb5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:39.485570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da95ee6-9ad0-4457-8340-f76e5137bb5b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:39.486226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7e49538d-60db-4acc-a9d9-6a3863fe1a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f326ef67134224b248c99fa4942637'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:39.487107 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7e49538d-60db-4acc-a9d9-6a3863fe1a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f326ef67134224b248c99fa4942637'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:39.500516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 968/1945] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:39.505183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da95ee6-9ad0-4457-8340-f76e5137bb5b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:39.507814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3da95ee6-9ad0-4457-8340-f76e5137bb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.526601 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da95ee6-9ad0-4457-8340-f76e5137bb5b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:39.531520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573450d-8280-49a8-9a92-f0f64e940d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:39.532214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573450d-8280-49a8-9a92-f0f64e940d30 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.532521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573450d-8280-49a8-9a92-f0f64e940d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.532818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573450d-8280-49a8-9a92-f0f64e940d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.533506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573450d-8280-49a8-9a92-f0f64e940d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:39.535422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573450d-8280-49a8-9a92-f0f64e940d30 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:39.668492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7e49538d-60db-4acc-a9d9-6a3863fe1a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f326ef67134224b248c99fa4942637'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:39.685397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 969/1946] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:39 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:39.685397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573450d-8280-49a8-9a92-f0f64e940d30 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:39.686912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7e49538d-60db-4acc-a9d9-6a3863fe1a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f326ef67134224b248c99fa4942637'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:39.698988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7e49538d-60db-4acc-a9d9-6a3863fe1a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f326ef67134224b248c99fa4942637'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:39.717809 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 978/1947] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:39 2022] DELETE /identity/v3/users/20f326ef67134224b248c99fa4942637 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:39.722570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad803-74b4-4fbe-a6fe-a9272d766ea7 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.731495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad803-74b4-4fbe-a6fe-a9272d766ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.731495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad803-74b4-4fbe-a6fe-a9272d766ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.741457 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-582ad803-74b4-4fbe-a6fe-a9272d766ea7 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:39.742692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-582ad803-74b4-4fbe-a6fe-a9272d766ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.772600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573450d-8280-49a8-9a92-f0f64e940d30 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:39.801391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 979/1948] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:39.811363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ad803-74b4-4fbe-a6fe-a9272d766ea7 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:39.813123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-582ad803-74b4-4fbe-a6fe-a9272d766ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.828878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca12bc-0862-4c71-9f43-fdab4f83f74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:39.829581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca12bc-0862-4c71-9f43-fdab4f83f74f admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.829873 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca12bc-0862-4c71-9f43-fdab4f83f74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.830164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca12bc-0862-4c71-9f43-fdab4f83f74f admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.830854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca12bc-0862-4c71-9f43-fdab4f83f74f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:39.832904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca12bc-0862-4c71-9f43-fdab4f83f74f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:39.882182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ad803-74b4-4fbe-a6fe-a9272d766ea7 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:39.886000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d51fde-6362-479f-9b4d-58478c9133fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:39.886657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d51fde-6362-479f-9b4d-58478c9133fe service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.886947 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d51fde-6362-479f-9b4d-58478c9133fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.887228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d51fde-6362-479f-9b4d-58478c9133fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.897420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d51fde-6362-479f-9b4d-58478c9133fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:39.899520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d51fde-6362-479f-9b4d-58478c9133fe service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:39.911013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 980/1949] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:39.911882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d51fde-6362-479f-9b4d-58478c9133fe service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:39.913304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-71d51fde-6362-479f-9b4d-58478c9133fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.926693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d51fde-6362-479f-9b4d-58478c9133fe service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:39.932413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:39.933376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.933670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.933954 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] PATH_INFO: `/v3/projects/1e14b9c1803f4d5186aa53a930182945` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.935252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e14b9c1803f4d5186aa53a930182945)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:39.937487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:39.950868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 970/1950] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:39 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:39.956741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca12bc-0862-4c71-9f43-fdab4f83f74f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:39.958771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-aeca12bc-0862-4c71-9f43-fdab4f83f74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:39.974432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca12bc-0862-4c71-9f43-fdab4f83f74f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:39.979345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:39.980221 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:39.980691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:39.980981 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] PATH_INFO: `/v3/projects/7224a6550f1042a4bedb8ec3b19ed7bb` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:39.982178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7224a6550f1042a4bedb8ec3b19ed7bb)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:39.984143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:40.321302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e14b9c1803f4d5186aa53a930182945', 'request_id': 'req-7a71648f-678d-4829-9166-e02b9e00d03a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:40.330293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e14b9c1803f4d5186aa53a930182945', 'request_id': 'req-7a71648f-678d-4829-9166-e02b9e00d03a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:40.331381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7224a6550f1042a4bedb8ec3b19ed7bb', 'request_id': 'req-6c01a2d8-8b36-45ef-a126-b583d84bafb2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:40.337263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e14b9c1803f4d5186aa53a930182945', 'request_id': 'req-7a71648f-678d-4829-9166-e02b9e00d03a'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:40.464869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7224a6550f1042a4bedb8ec3b19ed7bb', 'request_id': 'req-6c01a2d8-8b36-45ef-a126-b583d84bafb2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:40.477051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7224a6550f1042a4bedb8ec3b19ed7bb', 'request_id': 'req-6c01a2d8-8b36-45ef-a126-b583d84bafb2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:40.481760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:40.509250 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] The token cache is being invalidate because project 7224a6550f1042a4bedb8ec3b19ed7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:40.509417 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:40.510104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:40.514657 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 971/1951] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:39 2022] DELETE /identity/v3/projects/7224a6550f1042a4bedb8ec3b19ed7bb => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:40.514657 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:40.515763 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:40.567289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] The token cache is being invalidate because project 1e14b9c1803f4d5186aa53a930182945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:40.567933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:40.568778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:40.570575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 981/1952] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:39 2022] DELETE /identity/v3/projects/1e14b9c1803f4d5186aa53a930182945 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:40.571511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:40.575627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:40.592980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01a2d8-8b36-45ef-a126-b583d84bafb2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:40.597696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd7fa6-d10f-48bb-add9-a054e3955297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:40.598634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd7fa6-d10f-48bb-add9-a054e3955297 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:40.598988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd7fa6-d10f-48bb-add9-a054e3955297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:40.599960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd7fa6-d10f-48bb-add9-a054e3955297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:40.600808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd7fa6-d10f-48bb-add9-a054e3955297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:40.602566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd7fa6-d10f-48bb-add9-a054e3955297 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:40.621691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 972/1953] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:40.621691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd7fa6-d10f-48bb-add9-a054e3955297 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:40.621691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-92fd7fa6-d10f-48bb-add9-a054e3955297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:40.639560 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd7fa6-d10f-48bb-add9-a054e3955297 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:40.649102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71648f-678d-4829-9166-e02b9e00d03a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:40.654646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:40.655673 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:40.656541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:40.656680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:40.657185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:40.657185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] PATH_INFO: `/v3/users/9607e9d0197244c9a8e0bf0a9a2af2cc` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:40.657723 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:40.658152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] PATH_INFO: `/v3/users/63f54f886796496da9dc8cdccaeebe2c` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:40.658462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9607e9d0197244c9a8e0bf0a9a2af2cc)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:40.660095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f54f886796496da9dc8cdccaeebe2c)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:40.660402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:40.671555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:41.000076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f54f886796496da9dc8cdccaeebe2c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.000251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9607e9d0197244c9a8e0bf0a9a2af2cc'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.000849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f54f886796496da9dc8cdccaeebe2c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.000975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9607e9d0197244c9a8e0bf0a9a2af2cc'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.001484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9607e9d0197244c9a8e0bf0a9a2af2cc'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.014215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9607e9d0197244c9a8e0bf0a9a2af2cc'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.022115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9607e9d0197244c9a8e0bf0a9a2af2cc'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.106812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f54f886796496da9dc8cdccaeebe2c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.121023 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f54f886796496da9dc8cdccaeebe2c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.128203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f54f886796496da9dc8cdccaeebe2c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.138488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 982/1954] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:40 2022] DELETE /identity/v3/users/63f54f886796496da9dc8cdccaeebe2c => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:41.138488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:41.141399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:41.176877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 973/1955] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:40 2022] DELETE /identity/v3/users/9607e9d0197244c9a8e0bf0a9a2af2cc => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:41.178489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:41.181434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:41.254344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbfe0e-ab6c-427f-9624-241aec9d2db4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:41.272228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8df993-9433-4815-936d-e9045dbb1c54 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:41.281940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befdf79-530f-40b3-9ea9-34b26696624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:41.282633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befdf79-530f-40b3-9ea9-34b26696624c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:41.282922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befdf79-530f-40b3-9ea9-34b26696624c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:41.283392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befdf79-530f-40b3-9ea9-34b26696624c admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:41.284253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befdf79-530f-40b3-9ea9-34b26696624c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:41.287337 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befdf79-530f-40b3-9ea9-34b26696624c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:41.301954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 974/1956] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:41.306493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befdf79-530f-40b3-9ea9-34b26696624c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:41.318796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befdf79-530f-40b3-9ea9-34b26696624c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:41.324966 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a7320-b510-40bb-a541-b6ecb75be380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:41.326864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a7320-b510-40bb-a541-b6ecb75be380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:41.326864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a7320-b510-40bb-a541-b6ecb75be380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:41.326864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a7320-b510-40bb-a541-b6ecb75be380 admin admin] PATH_INFO: `/v3/projects/891d7445e0724cbf9c7d2008a4dff89d/users/fcbb46bd91b049b4a6bc7fc64416350e/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:41.340389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:41.343333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:41.343790 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:41.343972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a7320-b510-40bb-a541-b6ecb75be380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891d7445e0724cbf9c7d2008a4dff89d, user_id=fcbb46bd91b049b4a6bc7fc64416350e, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:41.344425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] PATH_INFO: `/v3/projects/2654ebb93bf749acb24527d025ea2a7b` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:41.347167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2654ebb93bf749acb24527d025ea2a7b)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:41.347272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a7320-b510-40bb-a541-b6ecb75be380 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:41.348120 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:41.537433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 975/1957] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:41 2022] PUT /identity/v3/projects/891d7445e0724cbf9c7d2008a4dff89d/users/fcbb46bd91b049b4a6bc7fc64416350e/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:41.551224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273376-3ac3-41fe-98bc-96f8632ac19a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:41.551511 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273376-3ac3-41fe-98bc-96f8632ac19a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:41.551794 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273376-3ac3-41fe-98bc-96f8632ac19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:41.557941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2654ebb93bf749acb24527d025ea2a7b', 'request_id': 'req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.566685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2654ebb93bf749acb24527d025ea2a7b', 'request_id': 'req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.572477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2654ebb93bf749acb24527d025ea2a7b', 'request_id': 'req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.584818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c5273376-3ac3-41fe-98bc-96f8632ac19a None None] MFA Rules not processed for user `fcbb46bd91b049b4a6bc7fc64416350e`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:41.586474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c5273376-3ac3-41fe-98bc-96f8632ac19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:41.648242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:41.687266 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 976/1958] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:41.693226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] The token cache is being invalidate because project 2654ebb93bf749acb24527d025ea2a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:41.693792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.694390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:41.694707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5273376-3ac3-41fe-98bc-96f8632ac19a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:41.696807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 983/1959] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:41 2022] DELETE /identity/v3/projects/2654ebb93bf749acb24527d025ea2a7b => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:41.700611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:41.710214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:41.781213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5273376-3ac3-41fe-98bc-96f8632ac19a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:41.787586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0491f-d07d-44fa-b06b-400ed1442c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:41.788259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0491f-d07d-44fa-b06b-400ed1442c28 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:41.788554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0491f-d07d-44fa-b06b-400ed1442c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:41.788865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0491f-d07d-44fa-b06b-400ed1442c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:41.789563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0491f-d07d-44fa-b06b-400ed1442c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:41.791488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0491f-d07d-44fa-b06b-400ed1442c28 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:41.799593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bca3d-ce7b-4479-b5f0-0567bed0d0c5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:41.809652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:41.819288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:41.819288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:41.819288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] PATH_INFO: `/v3/users/c367bddc46e74a8db26b574666ba130f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:41.819288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c367bddc46e74a8db26b574666ba130f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:41.819288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:41.912267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 977/1960] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:41 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:41.913272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0491f-d07d-44fa-b06b-400ed1442c28 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:41.914834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b8a0491f-d07d-44fa-b06b-400ed1442c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:42.000082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0491f-d07d-44fa-b06b-400ed1442c28 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:42.004895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:42.005810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:42.006095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:42.006395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] PATH_INFO: `/v3/projects/9f658a3f68604e9cbc7f0a97eee2803f` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:42.007770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f658a3f68604e9cbc7f0a97eee2803f)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:42.009848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:42.080434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c367bddc46e74a8db26b574666ba130f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.081604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c367bddc46e74a8db26b574666ba130f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.184534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f658a3f68604e9cbc7f0a97eee2803f', 'request_id': 'req-a19a2c64-185f-4135-af66-c2fb443d222d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.196455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c367bddc46e74a8db26b574666ba130f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.209579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c367bddc46e74a8db26b574666ba130f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.216282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c367bddc46e74a8db26b574666ba130f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.222182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 984/1961] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:41 2022] DELETE /identity/v3/users/c367bddc46e74a8db26b574666ba130f => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:42.222934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:42.224845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:42.303134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86e2dc-f991-4fcb-9cde-5380b6cd8965 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:42.310490 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee452b-dddd-46b0-a0f4-0a468335f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:42.311389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee452b-dddd-46b0-a0f4-0a468335f3af admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:42.311678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee452b-dddd-46b0-a0f4-0a468335f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:42.312301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee452b-dddd-46b0-a0f4-0a468335f3af admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:42.313142 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee452b-dddd-46b0-a0f4-0a468335f3af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:42.315453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee452b-dddd-46b0-a0f4-0a468335f3af admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:42.339486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f658a3f68604e9cbc7f0a97eee2803f', 'request_id': 'req-a19a2c64-185f-4135-af66-c2fb443d222d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.347160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f658a3f68604e9cbc7f0a97eee2803f', 'request_id': 'req-a19a2c64-185f-4135-af66-c2fb443d222d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.359929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] The token cache is being invalidate because project 9f658a3f68604e9cbc7f0a97eee2803f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:42.360218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.360929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.362787 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 978/1962] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:41 2022] DELETE /identity/v3/projects/9f658a3f68604e9cbc7f0a97eee2803f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:42.363853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:42.365577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:42.434362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a2c64-185f-4135-af66-c2fb443d222d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:42.439478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:42.440337 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:42.440623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:42.440930 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] PATH_INFO: `/v3/projects/d61d25b1071146b282499851aacecc54` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:42.442124 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61d25b1071146b282499851aacecc54)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:42.444672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:42.472002 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 985/1963] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:42 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:42.473014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee452b-dddd-46b0-a0f4-0a468335f3af admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:42.476879 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d4ee452b-dddd-46b0-a0f4-0a468335f3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:42.496093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee452b-dddd-46b0-a0f4-0a468335f3af admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:42.502354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:42.503245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:42.504712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:42.504942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] PATH_INFO: `/v3/users/d177d5f20d4a406ebd3115c66af7b515` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:42.506755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d177d5f20d4a406ebd3115c66af7b515)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:42.508793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:42.514657 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:42.572456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61d25b1071146b282499851aacecc54', 'request_id': 'req-5558d8e3-47eb-4849-b9f5-34687497fc2a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.640581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61d25b1071146b282499851aacecc54', 'request_id': 'req-5558d8e3-47eb-4849-b9f5-34687497fc2a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.660783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61d25b1071146b282499851aacecc54', 'request_id': 'req-5558d8e3-47eb-4849-b9f5-34687497fc2a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.702083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] The token cache is being invalidate because project d61d25b1071146b282499851aacecc54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:42.702083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.702083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.702083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 979/1964] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:42 2022] DELETE /identity/v3/projects/d61d25b1071146b282499851aacecc54 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:42.702083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:42.703460 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:42.714947 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd177d5f20d4a406ebd3115c66af7b515'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.716212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd177d5f20d4a406ebd3115c66af7b515'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.777870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558d8e3-47eb-4849-b9f5-34687497fc2a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:42.782479 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86466084-db31-42b6-ac7e-30221622b8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:42.783146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86466084-db31-42b6-ac7e-30221622b8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:42.783433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86466084-db31-42b6-ac7e-30221622b8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:42.783712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86466084-db31-42b6-ac7e-30221622b8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:42.784426 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86466084-db31-42b6-ac7e-30221622b8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:42.786057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86466084-db31-42b6-ac7e-30221622b8f5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:42.796299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 980/1965] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:42.797546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa35d60-03ef-47b1-9df2-692c88352ee9 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:42.797835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa35d60-03ef-47b1-9df2-692c88352ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:42.798116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa35d60-03ef-47b1-9df2-692c88352ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:42.815892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-caa35d60-03ef-47b1-9df2-692c88352ee9 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:42.817166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-caa35d60-03ef-47b1-9df2-692c88352ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:42.826001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 981/1966] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:42.826926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa35d60-03ef-47b1-9df2-692c88352ee9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:42.828245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-caa35d60-03ef-47b1-9df2-692c88352ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:42.842259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa35d60-03ef-47b1-9df2-692c88352ee9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:42.848177 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aa77e-4073-4cfa-8f1e-ea2a2c11b5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:42.849658 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aa77e-4073-4cfa-8f1e-ea2a2c11b5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:42.850186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aa77e-4073-4cfa-8f1e-ea2a2c11b5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:42.857023 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd177d5f20d4a406ebd3115c66af7b515'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.857853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aa77e-4073-4cfa-8f1e-ea2a2c11b5e0 admin admin] PATH_INFO: `/v3/projects/e52dfab9d50745748a70773b80432854/users/c365b60c10d246d1a1c38b32b304a0d3/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:42.876531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd177d5f20d4a406ebd3115c66af7b515'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.879198 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aa77e-4073-4cfa-8f1e-ea2a2c11b5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52dfab9d50745748a70773b80432854, user_id=c365b60c10d246d1a1c38b32b304a0d3, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:42.884101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aa77e-4073-4cfa-8f1e-ea2a2c11b5e0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:42.885420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd177d5f20d4a406ebd3115c66af7b515'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:42.894293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 986/1967] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:42 2022] DELETE /identity/v3/users/d177d5f20d4a406ebd3115c66af7b515 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:42.895743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:42.909913 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:42.984084 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8053f-b270-411b-8810-d4b09f001db4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:42.988966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:42.989872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:42.990159 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:42.990623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] PATH_INFO: `/v3/projects/3f875ef093c5447e8a8a4ad95d545eae` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:42.991857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f875ef093c5447e8a8a4ad95d545eae)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:42.994001 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:43.006752 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 982/1968] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:42 2022] PUT /identity/v3/projects/e52dfab9d50745748a70773b80432854/users/c365b60c10d246d1a1c38b32b304a0d3/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:43.010055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a605c77-5cd3-433b-97d4-fac92fa617bb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.010568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a605c77-5cd3-433b-97d4-fac92fa617bb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.011598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a605c77-5cd3-433b-97d4-fac92fa617bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.034464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8a605c77-5cd3-433b-97d4-fac92fa617bb None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:43.035760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8a605c77-5cd3-433b-97d4-fac92fa617bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:43.143589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 983/1969] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:43.144527 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a605c77-5cd3-433b-97d4-fac92fa617bb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:43.156488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a605c77-5cd3-433b-97d4-fac92fa617bb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:43.159394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f875ef093c5447e8a8a4ad95d545eae', 'request_id': 'req-20d9da20-f5a6-4e22-8fc2-186caa11c79b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:43.171040 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f875ef093c5447e8a8a4ad95d545eae', 'request_id': 'req-20d9da20-f5a6-4e22-8fc2-186caa11c79b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:43.181515 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f875ef093c5447e8a8a4ad95d545eae', 'request_id': 'req-20d9da20-f5a6-4e22-8fc2-186caa11c79b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:43.245174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221254a3-b0ea-4711-8779-d1031146dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:43.248760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221254a3-b0ea-4711-8779-d1031146dcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.248760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221254a3-b0ea-4711-8779-d1031146dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.248760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221254a3-b0ea-4711-8779-d1031146dcf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.248760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221254a3-b0ea-4711-8779-d1031146dcf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:43.249189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221254a3-b0ea-4711-8779-d1031146dcf2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:43.260713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 984/1970] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:43.261558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221254a3-b0ea-4711-8779-d1031146dcf2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:43.274331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221254a3-b0ea-4711-8779-d1031146dcf2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:43.279815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97032-ed86-4f28-b625-2a93a8cde0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:43.280632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97032-ed86-4f28-b625-2a93a8cde0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.280952 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97032-ed86-4f28-b625-2a93a8cde0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.281237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97032-ed86-4f28-b625-2a93a8cde0f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.283434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97032-ed86-4f28-b625-2a93a8cde0f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:43.283434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97032-ed86-4f28-b625-2a93a8cde0f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:43.284382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97032-ed86-4f28-b625-2a93a8cde0f5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:43.297979 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 985/1971] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:43.299079 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97032-ed86-4f28-b625-2a93a8cde0f5 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:43.309396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97032-ed86-4f28-b625-2a93a8cde0f5 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:43.316228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9608358-cc24-475d-841b-d70b3de3e7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:43.317007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] The token cache is being invalidate because project 3f875ef093c5447e8a8a4ad95d545eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:43.317302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:43.317411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9608358-cc24-475d-841b-d70b3de3e7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.318286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9608358-cc24-475d-841b-d70b3de3e7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.318628 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9608358-cc24-475d-841b-d70b3de3e7e0 admin admin] PATH_INFO: `/v3/projects/e52dfab9d50745748a70773b80432854/users/c365b60c10d246d1a1c38b32b304a0d3/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.320726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9608358-cc24-475d-841b-d70b3de3e7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52dfab9d50745748a70773b80432854, user_id=c365b60c10d246d1a1c38b32b304a0d3, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:43.321205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:43.323370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9608358-cc24-475d-841b-d70b3de3e7e0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:43.323982 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 987/1972] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:42 2022] DELETE /identity/v3/projects/3f875ef093c5447e8a8a4ad95d545eae => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:43.325326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:43.327357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:43.335608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 986/1973] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:43 2022] PUT /identity/v3/projects/e52dfab9d50745748a70773b80432854/users/c365b60c10d246d1a1c38b32b304a0d3/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:43.336806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703592-9db3-4dc2-98b8-0e5ca640fe48 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.337095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703592-9db3-4dc2-98b8-0e5ca640fe48 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.337481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703592-9db3-4dc2-98b8-0e5ca640fe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.344253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9da20-f5a6-4e22-8fc2-186caa11c79b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:43.365941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c6703592-9db3-4dc2-98b8-0e5ca640fe48 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:43.367267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c6703592-9db3-4dc2-98b8-0e5ca640fe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:43.407537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f54fc-f5a6-4860-8343-451f5ceef1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:43.408212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f54fc-f5a6-4860-8343-451f5ceef1fd admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.408497 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f54fc-f5a6-4860-8343-451f5ceef1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.408810 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f54fc-f5a6-4860-8343-451f5ceef1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.409511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f54fc-f5a6-4860-8343-451f5ceef1fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:43.411450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f54fc-f5a6-4860-8343-451f5ceef1fd admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:43.429100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 987/1974] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:43.430392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26263f-bea7-4f9f-b54b-8750bf3d3c91 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.430681 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26263f-bea7-4f9f-b54b-8750bf3d3c91 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.430963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26263f-bea7-4f9f-b54b-8750bf3d3c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.459256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7b26263f-bea7-4f9f-b54b-8750bf3d3c91 None None] MFA Rules not processed for user `c365b60c10d246d1a1c38b32b304a0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:43.460478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7b26263f-bea7-4f9f-b54b-8750bf3d3c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:43.533689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 988/1975] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:43.534990 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0233f2-e47e-4c6d-8d77-834a4869fc0c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.535278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0233f2-e47e-4c6d-8d77-834a4869fc0c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.535555 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0233f2-e47e-4c6d-8d77-834a4869fc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.554345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7c0233f2-e47e-4c6d-8d77-834a4869fc0c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:43.555526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7c0233f2-e47e-4c6d-8d77-834a4869fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:43.563391 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 989/1976] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:43.564373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0233f2-e47e-4c6d-8d77-834a4869fc0c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:43.565613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7c0233f2-e47e-4c6d-8d77-834a4869fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:43.578694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0233f2-e47e-4c6d-8d77-834a4869fc0c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:43.584996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 988/1977] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:43 2022] POST /identity/v3/projects => generated 373 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:43.584996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f54fc-f5a6-4860-8343-451f5ceef1fd admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:43.584996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7c6f54fc-f5a6-4860-8343-451f5ceef1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:43.586935 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:43.587882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.588164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.588436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] PATH_INFO: `/v3/projects/3bd389c4576d4a2a80517646b2004114` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.589638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd389c4576d4a2a80517646b2004114)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:43.591538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:43.643424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f54fc-f5a6-4860-8343-451f5ceef1fd admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:43.647238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a4abc-6cdc-4da9-8dff-b9305b04347e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:43.647918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a4abc-6cdc-4da9-8dff-b9305b04347e service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.648363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a4abc-6cdc-4da9-8dff-b9305b04347e service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.648731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a4abc-6cdc-4da9-8dff-b9305b04347e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.707672 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a4abc-6cdc-4da9-8dff-b9305b04347e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:43.709211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a4abc-6cdc-4da9-8dff-b9305b04347e service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:43.730329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 989/1978] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:43.733205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a4abc-6cdc-4da9-8dff-b9305b04347e service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:43.742099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd389c4576d4a2a80517646b2004114', 'request_id': 'req-cf1cc720-9e46-430b-917f-7ed4e3b370ff'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:43.815651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a4abc-6cdc-4da9-8dff-b9305b04347e service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:43.836509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd389c4576d4a2a80517646b2004114', 'request_id': 'req-cf1cc720-9e46-430b-917f-7ed4e3b370ff'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:43.844401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd389c4576d4a2a80517646b2004114', 'request_id': 'req-cf1cc720-9e46-430b-917f-7ed4e3b370ff'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:43.856753 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] The token cache is being invalidate because project 3bd389c4576d4a2a80517646b2004114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:43.857106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:43.857883 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:43.865102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 990/1979] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:43 2022] DELETE /identity/v3/projects/3bd389c4576d4a2a80517646b2004114 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:43.866022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:43.867487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:43.901023 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785138e-a6f4-4402-bb95-1c6edb83d1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:43.901610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785138e-a6f4-4402-bb95-1c6edb83d1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.901941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785138e-a6f4-4402-bb95-1c6edb83d1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.902869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785138e-a6f4-4402-bb95-1c6edb83d1f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.903618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785138e-a6f4-4402-bb95-1c6edb83d1f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:43.904501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785138e-a6f4-4402-bb95-1c6edb83d1f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:43.906543 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785138e-a6f4-4402-bb95-1c6edb83d1f8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:43.942728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 990/1980] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:43.944129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62d494-f6db-44d3-bba2-5d5b36738030 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.944498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62d494-f6db-44d3-bba2-5d5b36738030 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.944896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62d494-f6db-44d3-bba2-5d5b36738030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.954481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cc720-9e46-430b-917f-7ed4e3b370ff admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:43.969317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d47319-101e-485d-8608-8b3c77f93248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:43.970209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d47319-101e-485d-8608-8b3c77f93248 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:43.970636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d47319-101e-485d-8608-8b3c77f93248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:43.971121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d47319-101e-485d-8608-8b3c77f93248 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:43.972234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d47319-101e-485d-8608-8b3c77f93248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:43.974846 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d47319-101e-485d-8608-8b3c77f93248 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:43.985180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ba62d494-f6db-44d3-bba2-5d5b36738030 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:43.986416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ba62d494-f6db-44d3-bba2-5d5b36738030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:44.003164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 991/1981] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:44.003164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62d494-f6db-44d3-bba2-5d5b36738030 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:44.010369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ba62d494-f6db-44d3-bba2-5d5b36738030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:44.026010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62d494-f6db-44d3-bba2-5d5b36738030 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:44.031445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5153ef-4bde-4b20-bacd-552c42e4236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:44.032103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5153ef-4bde-4b20-bacd-552c42e4236d admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.032385 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5153ef-4bde-4b20-bacd-552c42e4236d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.033159 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5153ef-4bde-4b20-bacd-552c42e4236d admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.033869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5153ef-4bde-4b20-bacd-552c42e4236d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:44.036159 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5153ef-4bde-4b20-bacd-552c42e4236d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:44.094614 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 991/1982] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:43 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:44.095972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d47319-101e-485d-8608-8b3c77f93248 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:44.097838 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c8d47319-101e-485d-8608-8b3c77f93248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:44.142343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 992/1983] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:43 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:44.143779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0cf96-e1a9-4cfa-8385-24a65b9c1757 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.144159 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0cf96-e1a9-4cfa-8385-24a65b9c1757 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.144495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0cf96-e1a9-4cfa-8385-24a65b9c1757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.168613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1ff0cf96-e1a9-4cfa-8385-24a65b9c1757 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:44.170005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1ff0cf96-e1a9-4cfa-8385-24a65b9c1757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:44.203691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d47319-101e-485d-8608-8b3c77f93248 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:44.215842 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:44.247747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 993/1984] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:44.249066 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0cf96-e1a9-4cfa-8385-24a65b9c1757 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:44.263691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0cf96-e1a9-4cfa-8385-24a65b9c1757 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:44.269798 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb203e-8ce7-4c17-a94b-93138a28dd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:44.271310 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb203e-8ce7-4c17-a94b-93138a28dd7d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.271679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb203e-8ce7-4c17-a94b-93138a28dd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.272077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb203e-8ce7-4c17-a94b-93138a28dd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.272928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb203e-8ce7-4c17-a94b-93138a28dd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:44.274916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb203e-8ce7-4c17-a94b-93138a28dd7d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:44.321177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 994/1985] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:44.322182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb203e-8ce7-4c17-a94b-93138a28dd7d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:44.324782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183878f-d5e5-4e58-9eb6-04fa170b8b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:44.325735 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183878f-d5e5-4e58-9eb6-04fa170b8b25 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.326615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183878f-d5e5-4e58-9eb6-04fa170b8b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.327235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183878f-d5e5-4e58-9eb6-04fa170b8b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.330075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5183878f-d5e5-4e58-9eb6-04fa170b8b25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:44.347060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb203e-8ce7-4c17-a94b-93138a28dd7d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:44.361074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d80c6-4db9-4719-ab60-9c02549db73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:44.363510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d80c6-4db9-4719-ab60-9c02549db73a admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.363805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d80c6-4db9-4719-ab60-9c02549db73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.364090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d80c6-4db9-4719-ab60-9c02549db73a admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.367761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d80c6-4db9-4719-ab60-9c02549db73a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:44.370030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d80c6-4db9-4719-ab60-9c02549db73a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:44.396623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:44.438441 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183878f-d5e5-4e58-9eb6-04fa170b8b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:44.440907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183878f-d5e5-4e58-9eb6-04fa170b8b25 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:44.454357 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 992/1986] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:44.455454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183878f-d5e5-4e58-9eb6-04fa170b8b25 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:44.470743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183878f-d5e5-4e58-9eb6-04fa170b8b25 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:44.476934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954e6cd-2561-43c0-913f-52a8d1f581aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:44.477602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954e6cd-2561-43c0-913f-52a8d1f581aa admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.477889 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954e6cd-2561-43c0-913f-52a8d1f581aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.478168 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954e6cd-2561-43c0-913f-52a8d1f581aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.478896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954e6cd-2561-43c0-913f-52a8d1f581aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:44.479204 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954e6cd-2561-43c0-913f-52a8d1f581aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:44.481300 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954e6cd-2561-43c0-913f-52a8d1f581aa admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:44.508253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 993/1987] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:44.510854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954e6cd-2561-43c0-913f-52a8d1f581aa admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:44.524261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 995/1988] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:44 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:44.528591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d80c6-4db9-4719-ab60-9c02549db73a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:44.530884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954e6cd-2561-43c0-913f-52a8d1f581aa admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:44.536153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e538-0617-4708-b2a0-d10497a814fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:44.537762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e538-0617-4708-b2a0-d10497a814fd admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.538445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e538-0617-4708-b2a0-d10497a814fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.538726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e538-0617-4708-b2a0-d10497a814fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.540679 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2e538-0617-4708-b2a0-d10497a814fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:44.543184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2e538-0617-4708-b2a0-d10497a814fd admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:44.549402 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d80c6-4db9-4719-ab60-9c02549db73a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:44.557276 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f677e-8d23-4a90-a9b5-c1c336b6e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:44.558740 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f677e-8d23-4a90-a9b5-c1c336b6e532 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.559041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f677e-8d23-4a90-a9b5-c1c336b6e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.559344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f677e-8d23-4a90-a9b5-c1c336b6e532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.560044 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f677e-8d23-4a90-a9b5-c1c336b6e532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:44.562119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f677e-8d23-4a90-a9b5-c1c336b6e532 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:44.564748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 994/1989] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:44.565091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e538-0617-4708-b2a0-d10497a814fd admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:44.577376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e538-0617-4708-b2a0-d10497a814fd admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:44.583732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c1e00-c05e-4aeb-9ea7-9deac5c03e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:44.586370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c1e00-c05e-4aeb-9ea7-9deac5c03e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.586370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c1e00-c05e-4aeb-9ea7-9deac5c03e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.586370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c1e00-c05e-4aeb-9ea7-9deac5c03e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.586370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c1e00-c05e-4aeb-9ea7-9deac5c03e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:44.588160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c1e00-c05e-4aeb-9ea7-9deac5c03e74 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:44.600458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 995/1990] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:44.601478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c1e00-c05e-4aeb-9ea7-9deac5c03e74 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:44.611269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c1e00-c05e-4aeb-9ea7-9deac5c03e74 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:44.621640 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce039f4a-1065-4855-8d08-1bdb8ee7d26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:44.622650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce039f4a-1065-4855-8d08-1bdb8ee7d26e admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.622935 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce039f4a-1065-4855-8d08-1bdb8ee7d26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.623214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce039f4a-1065-4855-8d08-1bdb8ee7d26e admin admin] PATH_INFO: `/v3/projects/ea03f37f4e7248a8a02820ce008fa74b/users/c55bb3a1281d40eca6ce81c418acc7b8/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.646531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce039f4a-1065-4855-8d08-1bdb8ee7d26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea03f37f4e7248a8a02820ce008fa74b, user_id=c55bb3a1281d40eca6ce81c418acc7b8, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:44.649260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce039f4a-1065-4855-8d08-1bdb8ee7d26e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:44.712020 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 996/1991] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:44 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:44.713424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f677e-8d23-4a90-a9b5-c1c336b6e532 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:44.780887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f677e-8d23-4a90-a9b5-c1c336b6e532 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:44.785818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 996/1992] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:44 2022] PUT /identity/v3/projects/ea03f37f4e7248a8a02820ce008fa74b/users/c55bb3a1281d40eca6ce81c418acc7b8/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:44.786433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce039f4a-1065-4855-8d08-1bdb8ee7d26e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:44.854024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822766e1-86fe-401e-b07a-78a2a1c183dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:44.854947 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822766e1-86fe-401e-b07a-78a2a1c183dd admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.855484 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822766e1-86fe-401e-b07a-78a2a1c183dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.855780 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822766e1-86fe-401e-b07a-78a2a1c183dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.856515 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822766e1-86fe-401e-b07a-78a2a1c183dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:44.858186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822766e1-86fe-401e-b07a-78a2a1c183dd admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:44.858455 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce039f4a-1065-4855-8d08-1bdb8ee7d26e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:44.863272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ae6ca-9c35-427a-bdd2-28f6fbcb42cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:44.864087 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae6ca-9c35-427a-bdd2-28f6fbcb42cf admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.864250 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae6ca-9c35-427a-bdd2-28f6fbcb42cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.864506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae6ca-9c35-427a-bdd2-28f6fbcb42cf admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.865457 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ae6ca-9c35-427a-bdd2-28f6fbcb42cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:44.867374 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ae6ca-9c35-427a-bdd2-28f6fbcb42cf admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:44.869725 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 997/1993] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:44.870957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614b819-cf01-495e-8fe6-044c8340c3ac None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.871345 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614b819-cf01-495e-8fe6-044c8340c3ac None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.871701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614b819-cf01-495e-8fe6-044c8340c3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:44.900107 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e614b819-cf01-495e-8fe6-044c8340c3ac None None] MFA Rules not processed for user `c55bb3a1281d40eca6ce81c418acc7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:44.901412 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e614b819-cf01-495e-8fe6-044c8340c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:44.967875 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 998/1994] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:44.969263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614b819-cf01-495e-8fe6-044c8340c3ac None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:44.981839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614b819-cf01-495e-8fe6-044c8340c3ac None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:44.986482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4b401-5188-4c19-91a9-32e3f657b4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:44.987362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4b401-5188-4c19-91a9-32e3f657b4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:44.987640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4b401-5188-4c19-91a9-32e3f657b4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:44.987912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4b401-5188-4c19-91a9-32e3f657b4f1 admin admin] PATH_INFO: `/v3/projects/7327e570565941d59c9d630aab4db384/users/76d02b0b9f5f4444a5ad3238bd0dccc1/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:45.010669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4b401-5188-4c19-91a9-32e3f657b4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7327e570565941d59c9d630aab4db384, user_id=76d02b0b9f5f4444a5ad3238bd0dccc1, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:45.010669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4b401-5188-4c19-91a9-32e3f657b4f1 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:45.010835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 997/1995] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:44 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:45.011748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ae6ca-9c35-427a-bdd2-28f6fbcb42cf admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:45.015774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-260ae6ca-9c35-427a-bdd2-28f6fbcb42cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:45.077157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ae6ca-9c35-427a-bdd2-28f6fbcb42cf admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:45.081645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e7bc-fa7a-4661-b157-3da74dc034a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:45.082309 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e7bc-fa7a-4661-b157-3da74dc034a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:45.090690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e7bc-fa7a-4661-b157-3da74dc034a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:45.090690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e7bc-fa7a-4661-b157-3da74dc034a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:45.092345 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689e7bc-fa7a-4661-b157-3da74dc034a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:45.093596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689e7bc-fa7a-4661-b157-3da74dc034a0 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:45.103932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 998/1996] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:45.104878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e7bc-fa7a-4661-b157-3da74dc034a0 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:45.117290 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e7bc-fa7a-4661-b157-3da74dc034a0 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:45.122765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5193f0a-1755-4e08-882a-d7b5380bdb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:45.123563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5193f0a-1755-4e08-882a-d7b5380bdb43 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:45.123910 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5193f0a-1755-4e08-882a-d7b5380bdb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:45.124198 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5193f0a-1755-4e08-882a-d7b5380bdb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:45.124960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5193f0a-1755-4e08-882a-d7b5380bdb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:45.126788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5193f0a-1755-4e08-882a-d7b5380bdb43 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:45.137659 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 999/1997] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:45.138446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5193f0a-1755-4e08-882a-d7b5380bdb43 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:45.140139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d5193f0a-1755-4e08-882a-d7b5380bdb43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:45.153375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5193f0a-1755-4e08-882a-d7b5380bdb43 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:45.156528 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 999/1998] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:44 2022] PUT /identity/v3/projects/7327e570565941d59c9d630aab4db384/users/76d02b0b9f5f4444a5ad3238bd0dccc1/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:45.157867 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4b401-5188-4c19-91a9-32e3f657b4f1 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:45.213574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:45.214487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:45.214903 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:45.215186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] PATH_INFO: `/v3/users/fcbb46bd91b049b4a6bc7fc64416350e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:45.216376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcbb46bd91b049b4a6bc7fc64416350e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:45.218634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:45.221909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4b401-5188-4c19-91a9-32e3f657b4f1 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:45.226768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:45.227642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:45.227931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:45.228603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] PATH_INFO: `/v3/users/c55bb3a1281d40eca6ce81c418acc7b8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:45.229508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c55bb3a1281d40eca6ce81c418acc7b8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:45.231467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:45.303422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:45.524469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c55bb3a1281d40eca6ce81c418acc7b8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:45.525560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c55bb3a1281d40eca6ce81c418acc7b8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:45.527358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcbb46bd91b049b4a6bc7fc64416350e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:45.528241 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcbb46bd91b049b4a6bc7fc64416350e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:45.529541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcbb46bd91b049b4a6bc7fc64416350e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:45.545059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcbb46bd91b049b4a6bc7fc64416350e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:45.554010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcbb46bd91b049b4a6bc7fc64416350e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:45.642404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c55bb3a1281d40eca6ce81c418acc7b8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:45.655235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c55bb3a1281d40eca6ce81c418acc7b8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:45.662589 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c55bb3a1281d40eca6ce81c418acc7b8'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:45.668574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1000/1999] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:45 2022] DELETE /identity/v3/users/c55bb3a1281d40eca6ce81c418acc7b8 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:45.669411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:45.670875 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:45.742019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f7ec2-a3b8-4e00-a5ab-13088b589a45 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:45.746604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b9cd4-1f8e-42ca-b7ac-4abd58c01996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:45.747265 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b9cd4-1f8e-42ca-b7ac-4abd58c01996 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:45.747551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b9cd4-1f8e-42ca-b7ac-4abd58c01996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:45.747835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b9cd4-1f8e-42ca-b7ac-4abd58c01996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:45.748597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b9cd4-1f8e-42ca-b7ac-4abd58c01996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:45.750259 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b9cd4-1f8e-42ca-b7ac-4abd58c01996 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:45.760794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1001/2000] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:45.762064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ec4bf-3198-4078-b250-875c392d31ca None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:45.764869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ec4bf-3198-4078-b250-875c392d31ca None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:45.765184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ec4bf-3198-4078-b250-875c392d31ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:45.791756 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a04ec4bf-3198-4078-b250-875c392d31ca None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:45.793134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a04ec4bf-3198-4078-b250-875c392d31ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:45.800952 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1002/2001] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:45.802203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30d346-e4b1-4555-8270-94aa99a3c507 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:45.802490 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30d346-e4b1-4555-8270-94aa99a3c507 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:45.802769 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30d346-e4b1-4555-8270-94aa99a3c507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:45.821687 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-df30d346-e4b1-4555-8270-94aa99a3c507 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:45.822890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-df30d346-e4b1-4555-8270-94aa99a3c507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:45.831823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1003/2002] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:45.832958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30d346-e4b1-4555-8270-94aa99a3c507 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:45.835019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-df30d346-e4b1-4555-8270-94aa99a3c507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:45.838206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1000/2003] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:45 2022] DELETE /identity/v3/users/fcbb46bd91b049b4a6bc7fc64416350e => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:45.838206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:45.843293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:45.863971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30d346-e4b1-4555-8270-94aa99a3c507 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:45.915647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4e3c1-8916-4b56-9eee-3258074077b9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:45.919366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22190a6-3f2d-4da6-a367-5600d058f5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:45.920015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22190a6-3f2d-4da6-a367-5600d058f5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:45.920296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22190a6-3f2d-4da6-a367-5600d058f5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:45.920688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22190a6-3f2d-4da6-a367-5600d058f5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:45.927449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07dbe8-139b-497d-ae4a-2090550c8c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:45.928339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07dbe8-139b-497d-ae4a-2090550c8c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:45.928622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07dbe8-139b-497d-ae4a-2090550c8c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:45.928941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07dbe8-139b-497d-ae4a-2090550c8c8c admin admin] PATH_INFO: `/v3/projects/2831b75eb8b8420a9b8e317a79f00250/users/8d31e79fd3914794b808038f15653423/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:45.943062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07dbe8-139b-497d-ae4a-2090550c8c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2831b75eb8b8420a9b8e317a79f00250, user_id=8d31e79fd3914794b808038f15653423, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:45.945975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07dbe8-139b-497d-ae4a-2090550c8c8c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:45.980274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22190a6-3f2d-4da6-a367-5600d058f5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:45.981750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22190a6-3f2d-4da6-a367-5600d058f5c1 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:45.991682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1001/2004] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:45.993209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f3dc8-1a97-4fd1-8e36-d550bc51174c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:45.993464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f3dc8-1a97-4fd1-8e36-d550bc51174c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:45.993773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f3dc8-1a97-4fd1-8e36-d550bc51174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:46.011969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-973f3dc8-1a97-4fd1-8e36-d550bc51174c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:46.013231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-973f3dc8-1a97-4fd1-8e36-d550bc51174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:46.021757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1002/2005] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:46.022672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f3dc8-1a97-4fd1-8e36-d550bc51174c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:46.023930 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-973f3dc8-1a97-4fd1-8e36-d550bc51174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:46.035797 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f3dc8-1a97-4fd1-8e36-d550bc51174c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:46.037364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1004/2006] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:45 2022] PUT /identity/v3/projects/2831b75eb8b8420a9b8e317a79f00250/users/8d31e79fd3914794b808038f15653423/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:46.038315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07dbe8-139b-497d-ae4a-2090550c8c8c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:46.091421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acc67f-4604-46fd-b4b3-2005454b07b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:46.092308 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc67f-4604-46fd-b4b3-2005454b07b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:46.092774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc67f-4604-46fd-b4b3-2005454b07b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:46.093051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc67f-4604-46fd-b4b3-2005454b07b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:46.113757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07dbe8-139b-497d-ae4a-2090550c8c8c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:46.120395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dbc1f-e84e-4c73-a382-74b40f9c6b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:46.120395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dbc1f-e84e-4c73-a382-74b40f9c6b29 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:46.120395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dbc1f-e84e-4c73-a382-74b40f9c6b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:46.120395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dbc1f-e84e-4c73-a382-74b40f9c6b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:46.158695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acc67f-4604-46fd-b4b3-2005454b07b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:46.160243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acc67f-4604-46fd-b4b3-2005454b07b9 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:46.172219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1003/2007] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:46.186070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da162456-6fe8-4d2d-a8d2-aa17768635fd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:46.186457 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da162456-6fe8-4d2d-a8d2-aa17768635fd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:46.188754 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da162456-6fe8-4d2d-a8d2-aa17768635fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:46.199195 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dbc1f-e84e-4c73-a382-74b40f9c6b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:46.200857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dbc1f-e84e-4c73-a382-74b40f9c6b29 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:46.217094 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1005/2008] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:46.233774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-da162456-6fe8-4d2d-a8d2-aa17768635fd None None] MFA Rules not processed for user `8d31e79fd3914794b808038f15653423`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:46.236283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-da162456-6fe8-4d2d-a8d2-aa17768635fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:46.330835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1004/2009] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:46.346484 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dbc1f-e84e-4c73-a382-74b40f9c6b29 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:46.348422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1b5dbc1f-e84e-4c73-a382-74b40f9c6b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:46.410549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dbc1f-e84e-4c73-a382-74b40f9c6b29 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:46.415418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898eb3-109e-45ef-b762-5700b87f344e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:46.416108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898eb3-109e-45ef-b762-5700b87f344e service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:46.416392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898eb3-109e-45ef-b762-5700b87f344e service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:46.416688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898eb3-109e-45ef-b762-5700b87f344e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:46.427413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e898eb3-109e-45ef-b762-5700b87f344e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:46.429303 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e898eb3-109e-45ef-b762-5700b87f344e service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:46.443639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1006/2010] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:46.470464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da162456-6fe8-4d2d-a8d2-aa17768635fd None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:46.495637 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da162456-6fe8-4d2d-a8d2-aa17768635fd None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:46.506307 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b125d0b-5639-48d8-802c-dc0f2369c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:46.507528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b125d0b-5639-48d8-802c-dc0f2369c380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:46.507920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b125d0b-5639-48d8-802c-dc0f2369c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:46.508235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b125d0b-5639-48d8-802c-dc0f2369c380 admin admin] PATH_INFO: `/v3/users/8d31e79fd3914794b808038f15653423` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:46.510538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b125d0b-5639-48d8-802c-dc0f2369c380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d31e79fd3914794b808038f15653423)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:46.513288 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b125d0b-5639-48d8-802c-dc0f2369c380 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:46.749085 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0b125d0b-5639-48d8-802c-dc0f2369c380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d31e79fd3914794b808038f15653423'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:46.749799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0b125d0b-5639-48d8-802c-dc0f2369c380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d31e79fd3914794b808038f15653423'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:46.750575 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0b125d0b-5639-48d8-802c-dc0f2369c380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d31e79fd3914794b808038f15653423'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:46.780923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0b125d0b-5639-48d8-802c-dc0f2369c380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d31e79fd3914794b808038f15653423'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:46.788308 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0b125d0b-5639-48d8-802c-dc0f2369c380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d31e79fd3914794b808038f15653423'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:46.875328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898eb3-109e-45ef-b762-5700b87f344e service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:46.876967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3e898eb3-109e-45ef-b762-5700b87f344e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:46.892839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898eb3-109e-45ef-b762-5700b87f344e service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:46.898392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:46.899611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:46.899906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:46.900184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] PATH_INFO: `/v3/projects/ea03f37f4e7248a8a02820ce008fa74b` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:46.902482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea03f37f4e7248a8a02820ce008fa74b)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:46.903970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:46.906823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1005/2011] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:46 2022] DELETE /identity/v3/users/8d31e79fd3914794b808038f15653423 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:46.911762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e5aee-d4b5-42bb-a55d-1aa2bd5fb7b8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:46.912264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e5aee-d4b5-42bb-a55d-1aa2bd5fb7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:46.912590 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e5aee-d4b5-42bb-a55d-1aa2bd5fb7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:46.933621 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-998e5aee-d4b5-42bb-a55d-1aa2bd5fb7b8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:46.935225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-998e5aee-d4b5-42bb-a55d-1aa2bd5fb7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:47.006976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1006/2012] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:47.007664 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e5aee-d4b5-42bb-a55d-1aa2bd5fb7b8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:47.009040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-998e5aee-d4b5-42bb-a55d-1aa2bd5fb7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:47.039159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e5aee-d4b5-42bb-a55d-1aa2bd5fb7b8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:47.058628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea03f37f4e7248a8a02820ce008fa74b', 'request_id': 'req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.063258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea03f37f4e7248a8a02820ce008fa74b', 'request_id': 'req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.073292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea03f37f4e7248a8a02820ce008fa74b', 'request_id': 'req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.132764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57a198-1243-4d8f-b65b-13e0ff628c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:47.133737 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57a198-1243-4d8f-b65b-13e0ff628c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:47.134234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57a198-1243-4d8f-b65b-13e0ff628c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:47.134577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57a198-1243-4d8f-b65b-13e0ff628c21 admin admin] PATH_INFO: `/v3/projects/891d7445e0724cbf9c7d2008a4dff89d` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:47.135926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57a198-1243-4d8f-b65b-13e0ff628c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891d7445e0724cbf9c7d2008a4dff89d)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:47.138115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57a198-1243-4d8f-b65b-13e0ff628c21 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:47.148718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] The token cache is being invalidate because project ea03f37f4e7248a8a02820ce008fa74b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:47.149088 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.149731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.151649 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1007/2013] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:46 2022] DELETE /identity/v3/projects/ea03f37f4e7248a8a02820ce008fa74b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:47.152812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:47.158944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:47.173985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:47.251071 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bd65c-bd0f-47d9-82d4-cafc2aa37269 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:47.255092 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2893e6-8c33-4cb1-ae9c-067d7c7042bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:47.255773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2893e6-8c33-4cb1-ae9c-067d7c7042bc service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:47.256062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2893e6-8c33-4cb1-ae9c-067d7c7042bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:47.256346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2893e6-8c33-4cb1-ae9c-067d7c7042bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:47.261163 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dd2893e6-8c33-4cb1-ae9c-067d7c7042bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:47.281441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2893e6-8c33-4cb1-ae9c-067d7c7042bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:47.283106 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2893e6-8c33-4cb1-ae9c-067d7c7042bc service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:47.302077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:47.316712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ec57a198-1243-4d8f-b65b-13e0ff628c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891d7445e0724cbf9c7d2008a4dff89d', 'request_id': 'req-ec57a198-1243-4d8f-b65b-13e0ff628c21'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.319749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1008/2014] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:47.461975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ec57a198-1243-4d8f-b65b-13e0ff628c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891d7445e0724cbf9c7d2008a4dff89d', 'request_id': 'req-ec57a198-1243-4d8f-b65b-13e0ff628c21'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.470095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ec57a198-1243-4d8f-b65b-13e0ff628c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891d7445e0724cbf9c7d2008a4dff89d', 'request_id': 'req-ec57a198-1243-4d8f-b65b-13e0ff628c21'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.490230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ec57a198-1243-4d8f-b65b-13e0ff628c21 admin admin] The token cache is being invalidate because project 891d7445e0724cbf9c7d2008a4dff89d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:47.491446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ec57a198-1243-4d8f-b65b-13e0ff628c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.492303 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-ec57a198-1243-4d8f-b65b-13e0ff628c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.494088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1007/2015] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:47 2022] DELETE /identity/v3/projects/891d7445e0724cbf9c7d2008a4dff89d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:47.498784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2893e6-8c33-4cb1-ae9c-067d7c7042bc service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:47.500403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dd2893e6-8c33-4cb1-ae9c-067d7c7042bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:47.513546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2893e6-8c33-4cb1-ae9c-067d7c7042bc service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:47.578609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:47.579479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:47.579763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:47.580045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] PATH_INFO: `/v3/users/c365b60c10d246d1a1c38b32b304a0d3` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:47.581419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c365b60c10d246d1a1c38b32b304a0d3)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:47.583941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:47.826840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c365b60c10d246d1a1c38b32b304a0d3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.827575 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c365b60c10d246d1a1c38b32b304a0d3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.995969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c365b60c10d246d1a1c38b32b304a0d3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:48.018068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c365b60c10d246d1a1c38b32b304a0d3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:48.033209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c365b60c10d246d1a1c38b32b304a0d3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:48.035405 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa960f-f0b7-4ca5-a837-55eb0e22ead5 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:48.036732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa960f-f0b7-4ca5-a837-55eb0e22ead5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:48.037232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa960f-f0b7-4ca5-a837-55eb0e22ead5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:48.041836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1009/2016] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:47 2022] DELETE /identity/v3/users/c365b60c10d246d1a1c38b32b304a0d3 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:48.105714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-acaa960f-f0b7-4ca5-a837-55eb0e22ead5 None None] MFA Rules not processed for user `76d02b0b9f5f4444a5ad3238bd0dccc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:48.107342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-acaa960f-f0b7-4ca5-a837-55eb0e22ead5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:48.136471 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:48.138569 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:48.153228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:48.249682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1008/2017] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:48.254101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa960f-f0b7-4ca5-a837-55eb0e22ead5 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:48.258676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-acaa960f-f0b7-4ca5-a837-55eb0e22ead5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:48.259796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5db15-cc2a-4f73-8b46-cecbcb49c905 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:48.268869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:48.270009 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:48.270427 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:48.271008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] PATH_INFO: `/v3/projects/2831b75eb8b8420a9b8e317a79f00250` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:48.272387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2831b75eb8b8420a9b8e317a79f00250)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:48.274767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:48.275581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa960f-f0b7-4ca5-a837-55eb0e22ead5 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:48.282253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f7b34-5faf-409f-9f46-49871c937fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:48.283166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f7b34-5faf-409f-9f46-49871c937fab admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:48.283742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f7b34-5faf-409f-9f46-49871c937fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:48.284163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f7b34-5faf-409f-9f46-49871c937fab admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:48.285332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f7b34-5faf-409f-9f46-49871c937fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:48.288461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f7b34-5faf-409f-9f46-49871c937fab admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:49.318457 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1009/2018] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:48 2022] POST /identity/v3/projects => generated 373 bytes in 948 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:49.320512 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2831b75eb8b8420a9b8e317a79f00250', 'request_id': 'req-13a8b578-d7fe-40c2-8104-8599e9dcf22f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:49.320512 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2831b75eb8b8420a9b8e317a79f00250', 'request_id': 'req-13a8b578-d7fe-40c2-8104-8599e9dcf22f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:49.320512 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2831b75eb8b8420a9b8e317a79f00250', 'request_id': 'req-13a8b578-d7fe-40c2-8104-8599e9dcf22f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:49.332835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f7b34-5faf-409f-9f46-49871c937fab admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:49.332835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f7b34-5faf-409f-9f46-49871c937fab admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:49.335713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a38ab9-c2f3-47a4-9f8b-da8cfc7b2275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:49.336970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a38ab9-c2f3-47a4-9f8b-da8cfc7b2275 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:49.337481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a38ab9-c2f3-47a4-9f8b-da8cfc7b2275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:49.337962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a38ab9-c2f3-47a4-9f8b-da8cfc7b2275 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:49.338454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a38ab9-c2f3-47a4-9f8b-da8cfc7b2275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:49.340604 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a38ab9-c2f3-47a4-9f8b-da8cfc7b2275 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:49.800575 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1010/2019] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:49 2022] POST /identity/v3/users => generated 293 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:49.800700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] The token cache is being invalidate because project 2831b75eb8b8420a9b8e317a79f00250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:49.800700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:49.800700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:49.806328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a38ab9-c2f3-47a4-9f8b-da8cfc7b2275 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:49.807181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1010/2020] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:48 2022] DELETE /identity/v3/projects/2831b75eb8b8420a9b8e317a79f00250 => generated 0 bytes in 1666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:49.808117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:49.809733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-74a38ab9-c2f3-47a4-9f8b-da8cfc7b2275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:49.811632 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:49.831667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a38ab9-c2f3-47a4-9f8b-da8cfc7b2275 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:49.837306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6acb4-31ff-4e1e-b2e5-4284d6fca544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:49.838016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6acb4-31ff-4e1e-b2e5-4284d6fca544 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:49.838309 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6acb4-31ff-4e1e-b2e5-4284d6fca544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:49.838618 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6acb4-31ff-4e1e-b2e5-4284d6fca544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:49.839376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6acb4-31ff-4e1e-b2e5-4284d6fca544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:49.841017 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6acb4-31ff-4e1e-b2e5-4284d6fca544 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:49.855370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1011/2021] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:49.855370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043838e-ca36-487d-babc-bdf851c79ef1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:49.855370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043838e-ca36-487d-babc-bdf851c79ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:49.855370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043838e-ca36-487d-babc-bdf851c79ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:49.875092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4043838e-ca36-487d-babc-bdf851c79ef1 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:49.876317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4043838e-ca36-487d-babc-bdf851c79ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:49.890623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1012/2022] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:49.890623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043838e-ca36-487d-babc-bdf851c79ef1 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:49.899039 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8b578-d7fe-40c2-8104-8599e9dcf22f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:49.899152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043838e-ca36-487d-babc-bdf851c79ef1 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:49.899767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:49.900938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:49.901064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6588d60-21ca-4ee2-a329-c07bd1991773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:49.901387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:49.901733 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] PATH_INFO: `/v3/projects/e52dfab9d50745748a70773b80432854` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:49.902133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588d60-21ca-4ee2-a329-c07bd1991773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:49.902487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588d60-21ca-4ee2-a329-c07bd1991773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:49.902831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588d60-21ca-4ee2-a329-c07bd1991773 admin admin] PATH_INFO: `/v3/projects/445eedfdd7d94cd2b755302139a2cd3c/users/4a76fd6df93545db8ac2c5e08bdcd6fb/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:49.903398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52dfab9d50745748a70773b80432854)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:49.905722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:49.918623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6588d60-21ca-4ee2-a329-c07bd1991773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=445eedfdd7d94cd2b755302139a2cd3c, user_id=4a76fd6df93545db8ac2c5e08bdcd6fb, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:49.921613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6588d60-21ca-4ee2-a329-c07bd1991773 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.045337 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1013/2023] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:49 2022] PUT /identity/v3/projects/445eedfdd7d94cd2b755302139a2cd3c/users/4a76fd6df93545db8ac2c5e08bdcd6fb/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:50.046887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e3627-3d7a-47dd-ae61-1776266df821 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.047177 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e3627-3d7a-47dd-ae61-1776266df821 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.047453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e3627-3d7a-47dd-ae61-1776266df821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.058344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52dfab9d50745748a70773b80432854', 'request_id': 'req-17b50930-87ae-4578-abca-dc5349e2e1e6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:50.064818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52dfab9d50745748a70773b80432854', 'request_id': 'req-17b50930-87ae-4578-abca-dc5349e2e1e6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:50.070646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ff3e3627-3d7a-47dd-ae61-1776266df821 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:50.071042 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52dfab9d50745748a70773b80432854', 'request_id': 'req-17b50930-87ae-4578-abca-dc5349e2e1e6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:50.071858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ff3e3627-3d7a-47dd-ae61-1776266df821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:50.129560 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1014/2024] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:50.130867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e3627-3d7a-47dd-ae61-1776266df821 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.140024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e3627-3d7a-47dd-ae61-1776266df821 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.146283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc12bf-5dda-425e-91cf-a76ec6761cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.146987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc12bf-5dda-425e-91cf-a76ec6761cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.147271 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc12bf-5dda-425e-91cf-a76ec6761cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.147548 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc12bf-5dda-425e-91cf-a76ec6761cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.148272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc12bf-5dda-425e-91cf-a76ec6761cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:50.149962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc12bf-5dda-425e-91cf-a76ec6761cd9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.159670 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1015/2025] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:50.160454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc12bf-5dda-425e-91cf-a76ec6761cd9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.169668 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc12bf-5dda-425e-91cf-a76ec6761cd9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.174287 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd397806-783a-4e12-8b30-21f0d8df1072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.174914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd397806-783a-4e12-8b30-21f0d8df1072 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.175205 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd397806-783a-4e12-8b30-21f0d8df1072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.175488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd397806-783a-4e12-8b30-21f0d8df1072 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.176181 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd397806-783a-4e12-8b30-21f0d8df1072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:50.176508 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd397806-783a-4e12-8b30-21f0d8df1072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:50.178141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd397806-783a-4e12-8b30-21f0d8df1072 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.184217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] The token cache is being invalidate because project e52dfab9d50745748a70773b80432854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:50.184509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:50.185184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:50.186984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1011/2026] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:49 2022] DELETE /identity/v3/projects/e52dfab9d50745748a70773b80432854 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:50.190140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1016/2027] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:50.192034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897d705-d27c-4fea-864b-08fe04291f01 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.193037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897d705-d27c-4fea-864b-08fe04291f01 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.193328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897d705-d27c-4fea-864b-08fe04291f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.194547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.195894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:50.209592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b50930-87ae-4578-abca-dc5349e2e1e6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.213102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9897d705-d27c-4fea-864b-08fe04291f01 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:50.213482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:50.214320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9897d705-d27c-4fea-864b-08fe04291f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:50.217698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701edd9-9a88-4370-9e96-3c1a7d7f45bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.221161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701edd9-9a88-4370-9e96-3c1a7d7f45bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.221161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701edd9-9a88-4370-9e96-3c1a7d7f45bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.221161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701edd9-9a88-4370-9e96-3c1a7d7f45bb admin admin] PATH_INFO: `/v3/projects/445eedfdd7d94cd2b755302139a2cd3c/users/4a76fd6df93545db8ac2c5e08bdcd6fb/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.221645 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701edd9-9a88-4370-9e96-3c1a7d7f45bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=445eedfdd7d94cd2b755302139a2cd3c, user_id=4a76fd6df93545db8ac2c5e08bdcd6fb, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:50.224941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1017/2028] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:50.225521 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701edd9-9a88-4370-9e96-3c1a7d7f45bb admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.225961 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897d705-d27c-4fea-864b-08fe04291f01 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.233196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9897d705-d27c-4fea-864b-08fe04291f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:50.241642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1012/2029] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:50 2022] PUT /identity/v3/projects/445eedfdd7d94cd2b755302139a2cd3c/users/4a76fd6df93545db8ac2c5e08bdcd6fb/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:50.241642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e12d2-0bea-44ba-ab70-3e9d3e2151ac None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.241642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e12d2-0bea-44ba-ab70-3e9d3e2151ac None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.241642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e12d2-0bea-44ba-ab70-3e9d3e2151ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.251270 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897d705-d27c-4fea-864b-08fe04291f01 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.288053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-828e12d2-0bea-44ba-ab70-3e9d3e2151ac None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:50.289535 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-828e12d2-0bea-44ba-ab70-3e9d3e2151ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:50.316509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afe792-3147-4005-9db2-92a0f090a6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.317887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afe792-3147-4005-9db2-92a0f090a6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.318519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afe792-3147-4005-9db2-92a0f090a6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.319079 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afe792-3147-4005-9db2-92a0f090a6b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.319519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afe792-3147-4005-9db2-92a0f090a6b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:50.321530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afe792-3147-4005-9db2-92a0f090a6b9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.355493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1013/2030] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:50.359763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e12d2-0bea-44ba-ab70-3e9d3e2151ac None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.369512 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e12d2-0bea-44ba-ab70-3e9d3e2151ac None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.374996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d1136-c73c-49f0-aa87-6c39063cd926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.375659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d1136-c73c-49f0-aa87-6c39063cd926 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.375948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d1136-c73c-49f0-aa87-6c39063cd926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.376230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d1136-c73c-49f0-aa87-6c39063cd926 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.377087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d1136-c73c-49f0-aa87-6c39063cd926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:50.381776 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d1136-c73c-49f0-aa87-6c39063cd926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:50.381776 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d1136-c73c-49f0-aa87-6c39063cd926 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.392500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1014/2031] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:13:50.397325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d1136-c73c-49f0-aa87-6c39063cd926 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.410356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d1136-c73c-49f0-aa87-6c39063cd926 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.415810 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75fdbb-f155-4c2a-9b54-5f0c6c710eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.416791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75fdbb-f155-4c2a-9b54-5f0c6c710eda admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.417222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75fdbb-f155-4c2a-9b54-5f0c6c710eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.417625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75fdbb-f155-4c2a-9b54-5f0c6c710eda admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.418710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75fdbb-f155-4c2a-9b54-5f0c6c710eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:50.421655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75fdbb-f155-4c2a-9b54-5f0c6c710eda admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.473422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1018/2032] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:50 2022] POST /identity/v3/projects => generated 371 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:50.477670 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afe792-3147-4005-9db2-92a0f090a6b9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.542117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afe792-3147-4005-9db2-92a0f090a6b9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.547276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f050-743c-4c17-b241-177b6d65ce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.552247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f050-743c-4c17-b241-177b6d65ce6f admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.552247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f050-743c-4c17-b241-177b6d65ce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.552247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f050-743c-4c17-b241-177b6d65ce6f admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.552247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57f050-743c-4c17-b241-177b6d65ce6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:50.552247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57f050-743c-4c17-b241-177b6d65ce6f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.602535 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1015/2033] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:50 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:50.603612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75fdbb-f155-4c2a-9b54-5f0c6c710eda admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.693509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75fdbb-f155-4c2a-9b54-5f0c6c710eda admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.698331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9750fc-855a-4119-8199-5e01042f0d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.699007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9750fc-855a-4119-8199-5e01042f0d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.699319 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9750fc-855a-4119-8199-5e01042f0d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.699590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9750fc-855a-4119-8199-5e01042f0d47 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.700284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9750fc-855a-4119-8199-5e01042f0d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:50.702237 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9750fc-855a-4119-8199-5e01042f0d47 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.774756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1019/2034] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:50 2022] POST /identity/v3/users => generated 286 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:50.779451 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f050-743c-4c17-b241-177b6d65ce6f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.815762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f050-743c-4c17-b241-177b6d65ce6f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.827867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2425a-0691-4c4c-9887-972eb6c4da6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.828549 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2425a-0691-4c4c-9887-972eb6c4da6a admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.828872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2425a-0691-4c4c-9887-972eb6c4da6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.829156 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2425a-0691-4c4c-9887-972eb6c4da6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.830016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2425a-0691-4c4c-9887-972eb6c4da6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:50.831632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2425a-0691-4c4c-9887-972eb6c4da6a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.847732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1020/2035] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:50.849672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2425a-0691-4c4c-9887-972eb6c4da6a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.870409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1016/2036] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:50 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:50.876067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9750fc-855a-4119-8199-5e01042f0d47 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.881728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2425a-0691-4c4c-9887-972eb6c4da6a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.894941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9750fc-855a-4119-8199-5e01042f0d47 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.896167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184530d8-c440-4f36-8714-bf2c637dcc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.896879 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184530d8-c440-4f36-8714-bf2c637dcc73 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.897167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184530d8-c440-4f36-8714-bf2c637dcc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.897499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184530d8-c440-4f36-8714-bf2c637dcc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.898239 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184530d8-c440-4f36-8714-bf2c637dcc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:50.898678 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9864148-ff5d-4cc1-96e1-126b91ab4220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.899754 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9864148-ff5d-4cc1-96e1-126b91ab4220 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.899995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184530d8-c440-4f36-8714-bf2c637dcc73 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.901522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9864148-ff5d-4cc1-96e1-126b91ab4220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.901522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9864148-ff5d-4cc1-96e1-126b91ab4220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.904128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9864148-ff5d-4cc1-96e1-126b91ab4220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:50.907099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9864148-ff5d-4cc1-96e1-126b91ab4220 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.912911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1017/2037] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:50.916891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184530d8-c440-4f36-8714-bf2c637dcc73 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.935450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184530d8-c440-4f36-8714-bf2c637dcc73 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.936727 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1021/2038] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:50.939397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9864148-ff5d-4cc1-96e1-126b91ab4220 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.945510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20870159-bbdd-4269-90d0-7688869e08f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.947696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20870159-bbdd-4269-90d0-7688869e08f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.948156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20870159-bbdd-4269-90d0-7688869e08f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.948647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20870159-bbdd-4269-90d0-7688869e08f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.949635 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20870159-bbdd-4269-90d0-7688869e08f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:50.952974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20870159-bbdd-4269-90d0-7688869e08f7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:50.965422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9864148-ff5d-4cc1-96e1-126b91ab4220 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.970628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1018/2039] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:50.971791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20870159-bbdd-4269-90d0-7688869e08f7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:50.977127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed37bf4-fa15-4ac4-b4ce-95fa2d214e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.978947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed37bf4-fa15-4ac4-b4ce-95fa2d214e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.979241 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed37bf4-fa15-4ac4-b4ce-95fa2d214e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.980161 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed37bf4-fa15-4ac4-b4ce-95fa2d214e0c admin admin] PATH_INFO: `/v3/projects/b5dbe532f215440988ae952d8310002e/users/c3cff2d803b84f6cadea85eb0822ba62/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.985221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20870159-bbdd-4269-90d0-7688869e08f7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:50.991270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bd695-4341-4cc6-8502-096c484ab081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:50.992451 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bd695-4341-4cc6-8502-096c484ab081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:50.992875 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bd695-4341-4cc6-8502-096c484ab081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:50.993255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bd695-4341-4cc6-8502-096c484ab081 admin admin] PATH_INFO: `/v3/projects/c06196b077f444f08c0ab4a68bf4bda0/users/9b590901163f4e958f2e40949ff5a320/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:50.998650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed37bf4-fa15-4ac4-b4ce-95fa2d214e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dbe532f215440988ae952d8310002e, user_id=c3cff2d803b84f6cadea85eb0822ba62, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:51.001318 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed37bf4-fa15-4ac4-b4ce-95fa2d214e0c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:51.011616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bd695-4341-4cc6-8502-096c484ab081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06196b077f444f08c0ab4a68bf4bda0, user_id=9b590901163f4e958f2e40949ff5a320, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:51.014693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bd695-4341-4cc6-8502-096c484ab081 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:51.038120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:51.132704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1019/2040] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:50 2022] PUT /identity/v3/projects/c06196b077f444f08c0ab4a68bf4bda0/users/9b590901163f4e958f2e40949ff5a320/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:51.133983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1022/2041] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:50 2022] PUT /identity/v3/projects/b5dbe532f215440988ae952d8310002e/users/c3cff2d803b84f6cadea85eb0822ba62/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:51.139015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c315f5-b215-45a9-84ad-6ffa8dac4b7a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:51.139648 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c315f5-b215-45a9-84ad-6ffa8dac4b7a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:51.140146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c315f5-b215-45a9-84ad-6ffa8dac4b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:51.144415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b38c25-67d6-4e3f-b593-53728e00bcc9 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:51.147238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b38c25-67d6-4e3f-b593-53728e00bcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:51.149127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b38c25-67d6-4e3f-b593-53728e00bcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:51.171316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b5c315f5-b215-45a9-84ad-6ffa8dac4b7a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:51.173065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b5c315f5-b215-45a9-84ad-6ffa8dac4b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:51.198937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-46b38c25-67d6-4e3f-b593-53728e00bcc9 None None] MFA Rules not processed for user `9b590901163f4e958f2e40949ff5a320`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:51.200411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-46b38c25-67d6-4e3f-b593-53728e00bcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:51.299418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1023/2042] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:51.299613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1020/2043] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:51.309780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b38c25-67d6-4e3f-b593-53728e00bcc9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:51.313498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-46b38c25-67d6-4e3f-b593-53728e00bcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:51.340750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c315f5-b215-45a9-84ad-6ffa8dac4b7a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:51.342786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b5c315f5-b215-45a9-84ad-6ffa8dac4b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:51.374646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b38c25-67d6-4e3f-b593-53728e00bcc9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:51.378655 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37938e93-dea0-495d-b083-92c704c65425 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '711d53a7deb94849b577c08dc9165ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:51.379313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37938e93-dea0-495d-b083-92c704c65425 service glance] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:51.380066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37938e93-dea0-495d-b083-92c704c65425 service glance] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:51.380066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37938e93-dea0-495d-b083-92c704c65425 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:51.388807 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37938e93-dea0-495d-b083-92c704c65425 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:51.390257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37938e93-dea0-495d-b083-92c704c65425 service glance] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:51.409232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c315f5-b215-45a9-84ad-6ffa8dac4b7a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:51.416425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1024/2044] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:51.416577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54480f-0821-4db5-9b7a-1c781f3c5d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:51.416577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54480f-0821-4db5-9b7a-1c781f3c5d83 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:51.420857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54480f-0821-4db5-9b7a-1c781f3c5d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:51.421964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54480f-0821-4db5-9b7a-1c781f3c5d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:51.435161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54480f-0821-4db5-9b7a-1c781f3c5d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:51.436060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54480f-0821-4db5-9b7a-1c781f3c5d83 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:51.457076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1021/2045] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:52.026255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:52.670646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3c3f8-f594-4ee4-8d54-e9dd336c0fe9 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:52.670646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3c3f8-f594-4ee4-8d54-e9dd336c0fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:52.670646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3c3f8-f594-4ee4-8d54-e9dd336c0fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:52.682397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-51e3c3f8-f594-4ee4-8d54-e9dd336c0fe9 None None] MFA Rules not processed for user `4a76fd6df93545db8ac2c5e08bdcd6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:52.683760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-51e3c3f8-f594-4ee4-8d54-e9dd336c0fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:52.769743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1025/2046] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:52.782461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54480f-0821-4db5-9b7a-1c781f3c5d83 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:52.784160 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7e54480f-0821-4db5-9b7a-1c781f3c5d83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:52.861012 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54480f-0821-4db5-9b7a-1c781f3c5d83 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:52.871029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b84966-34b9-461c-94f3-4be0121e7b67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:52.871619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b84966-34b9-461c-94f3-4be0121e7b67 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:52.871988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b84966-34b9-461c-94f3-4be0121e7b67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:52.872188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b84966-34b9-461c-94f3-4be0121e7b67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:52.876705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e3b84966-34b9-461c-94f3-4be0121e7b67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:52.953071 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b84966-34b9-461c-94f3-4be0121e7b67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:52.954934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b84966-34b9-461c-94f3-4be0121e7b67 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:52.964200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1022/2047] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:53.689427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:54.336043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d306a1-cf60-4796-b1e7-6194d943bbcc None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:54.336407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d306a1-cf60-4796-b1e7-6194d943bbcc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:54.336791 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d306a1-cf60-4796-b1e7-6194d943bbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:54.370050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-65d306a1-cf60-4796-b1e7-6194d943bbcc None None] MFA Rules not processed for user `c3cff2d803b84f6cadea85eb0822ba62`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:54.371385 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-65d306a1-cf60-4796-b1e7-6194d943bbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:54.468825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1026/2048] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:54.480412 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b84966-34b9-461c-94f3-4be0121e7b67 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:54.488798 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b84966-34b9-461c-94f3-4be0121e7b67 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:54.492956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1512c39-39fb-424c-bfd1-183d7e3bb178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:54.493593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1512c39-39fb-424c-bfd1-183d7e3bb178 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:54.493875 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1512c39-39fb-424c-bfd1-183d7e3bb178 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:54.494190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1512c39-39fb-424c-bfd1-183d7e3bb178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:54.502925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1512c39-39fb-424c-bfd1-183d7e3bb178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:54.504336 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1512c39-39fb-424c-bfd1-183d7e3bb178 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:54.514446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1023/2049] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:54.733478 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:55.205845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d306a1-cf60-4796-b1e7-6194d943bbcc None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:55.207331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-65d306a1-cf60-4796-b1e7-6194d943bbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:55.219852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d306a1-cf60-4796-b1e7-6194d943bbcc None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:55.223496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e96489-9e7c-4563-9411-934a55b94f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:55.224140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e96489-9e7c-4563-9411-934a55b94f15 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:55.224434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e96489-9e7c-4563-9411-934a55b94f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:55.224748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e96489-9e7c-4563-9411-934a55b94f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:55.234022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e96489-9e7c-4563-9411-934a55b94f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:55.235456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e96489-9e7c-4563-9411-934a55b94f15 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:55.245567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1027/2050] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:56.070608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:56.489110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568fd04-eb9d-4b34-8bc8-63134ef733f0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:56.489601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568fd04-eb9d-4b34-8bc8-63134ef733f0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:56.490505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568fd04-eb9d-4b34-8bc8-63134ef733f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:56.508451 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0568fd04-eb9d-4b34-8bc8-63134ef733f0 None None] MFA Rules not processed for user `c3cff2d803b84f6cadea85eb0822ba62`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:56.509747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0568fd04-eb9d-4b34-8bc8-63134ef733f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:56.517236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1024/2051] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:13:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:56.722082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:57.252734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:58.275952 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:59.379051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:59.698898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:00.544566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:01.727048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:01.861740 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:02.618735 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:02.739241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:03.338783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:03.395781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:03.753553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:03.884299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:04.153530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:04.372843 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:04.538344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:04.764943 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:04.970013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:05.201133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:05.344078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:05.429846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:05.690315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:05.724363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:05.845978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.138356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.218646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.463999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.492778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.752746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.841058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.935329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.039109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.070203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.244261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.278282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.450225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.510074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.783797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.857864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:08.067300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:08.178653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:08.381508 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:08.509524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:09.350531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:09.461515 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:09.884479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:09.929871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:10.142229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:10.183546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:10.255896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:10.292240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:10.435419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:10.463938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:10.667006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:10.707204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:10.832609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:10.923937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:10.952442 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:11.040597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:21.009108 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:21.062834 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:28.270959 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06027364-36a1-4bb8-be19-a77dcef5aa9c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:28.271489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06027364-36a1-4bb8-be19-a77dcef5aa9c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:28.271742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06027364-36a1-4bb8-be19-a77dcef5aa9c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:28.274585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1028/2052] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 23 13:14:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:14:28.284982 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fbe8b-79ec-4366-90ea-401c95238221 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:28.285508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fbe8b-79ec-4366-90ea-401c95238221 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:28.285757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fbe8b-79ec-4366-90ea-401c95238221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:28.306833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b79fbe8b-79ec-4366-90ea-401c95238221 None None] MFA Rules not processed for user `8644754798b5439c954c86dc9aa9e7af`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:28.308168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b79fbe8b-79ec-4366-90ea-401c95238221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:28.381361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1025/2053] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 23 13:14:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:28.395818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06027364-36a1-4bb8-be19-a77dcef5aa9c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:28.398126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-06027364-36a1-4bb8-be19-a77dcef5aa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:28.416540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06027364-36a1-4bb8-be19-a77dcef5aa9c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:28.423751 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a5a5e-a3a5-499b-9fe0-402b8382659a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:28.424559 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a5a5e-a3a5-499b-9fe0-402b8382659a service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:28.424875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a5a5e-a3a5-499b-9fe0-402b8382659a service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:28.425712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a5a5e-a3a5-499b-9fe0-402b8382659a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:28.435315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a5a5e-a3a5-499b-9fe0-402b8382659a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:28.437800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a5a5e-a3a5-499b-9fe0-402b8382659a service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:28.452007 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1029/2054] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:29.124283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fbe8b-79ec-4366-90ea-401c95238221 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:29.136281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fbe8b-79ec-4366-90ea-401c95238221 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:29.141687 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:29.142651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:29.142905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:29.143189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] PATH_INFO: `/v3/users/76d02b0b9f5f4444a5ad3238bd0dccc1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:29.144567 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d02b0b9f5f4444a5ad3238bd0dccc1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:29.146532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:29.418027 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d02b0b9f5f4444a5ad3238bd0dccc1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:29.418657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d02b0b9f5f4444a5ad3238bd0dccc1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:29.519524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d02b0b9f5f4444a5ad3238bd0dccc1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:29.532448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d02b0b9f5f4444a5ad3238bd0dccc1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:29.540005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d02b0b9f5f4444a5ad3238bd0dccc1'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:29.545947 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1026/2055] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:14:29 2022] DELETE /identity/v3/users/76d02b0b9f5f4444a5ad3238bd0dccc1 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:29.948048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a5a5e-a3a5-499b-9fe0-402b8382659a service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:29.959228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a5a5e-a3a5-499b-9fe0-402b8382659a service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:30.017943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:30.018882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:30.019109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:30.019404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] PATH_INFO: `/v3/projects/7327e570565941d59c9d630aab4db384` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:30.020777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7327e570565941d59c9d630aab4db384)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:30.022770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:30.137672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7327e570565941d59c9d630aab4db384', 'request_id': 'req-57a567ce-c52c-42cc-a566-511f38d7a662'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:30.228413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7327e570565941d59c9d630aab4db384', 'request_id': 'req-57a567ce-c52c-42cc-a566-511f38d7a662'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:30.235037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7327e570565941d59c9d630aab4db384', 'request_id': 'req-57a567ce-c52c-42cc-a566-511f38d7a662'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:30.247167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] The token cache is being invalidate because project 7327e570565941d59c9d630aab4db384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:14:30.255476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:30.255476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:30.255476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1030/2056] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:14:29 2022] DELETE /identity/v3/projects/7327e570565941d59c9d630aab4db384 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:30.255753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:30.255753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:30.268727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663de9b2-4046-44df-af6d-74d5c622717a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:30.323529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68343952-2b6d-4a0e-9338-4ffb7994932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:30.324392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68343952-2b6d-4a0e-9338-4ffb7994932c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:30.324700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68343952-2b6d-4a0e-9338-4ffb7994932c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:30.324972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68343952-2b6d-4a0e-9338-4ffb7994932c admin admin] PATH_INFO: `/v3/users/4a76fd6df93545db8ac2c5e08bdcd6fb` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:30.326155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68343952-2b6d-4a0e-9338-4ffb7994932c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a76fd6df93545db8ac2c5e08bdcd6fb)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:30.328071 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68343952-2b6d-4a0e-9338-4ffb7994932c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:30.338678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:30.496238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-68343952-2b6d-4a0e-9338-4ffb7994932c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a76fd6df93545db8ac2c5e08bdcd6fb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:30.496958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-68343952-2b6d-4a0e-9338-4ffb7994932c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a76fd6df93545db8ac2c5e08bdcd6fb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:30.628383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-68343952-2b6d-4a0e-9338-4ffb7994932c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a76fd6df93545db8ac2c5e08bdcd6fb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:30.641689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-68343952-2b6d-4a0e-9338-4ffb7994932c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a76fd6df93545db8ac2c5e08bdcd6fb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:30.649026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-68343952-2b6d-4a0e-9338-4ffb7994932c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a76fd6df93545db8ac2c5e08bdcd6fb'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:30.656653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1027/2057] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:14:30 2022] DELETE /identity/v3/users/4a76fd6df93545db8ac2c5e08bdcd6fb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:30.926928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:30.928430 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:30.943537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a567ce-c52c-42cc-a566-511f38d7a662 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:31.001277 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c9082-ad92-4cce-b298-02f15ff5e20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:31.002139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9082-ad92-4cce-b298-02f15ff5e20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:31.002427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9082-ad92-4cce-b298-02f15ff5e20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:31.002707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9082-ad92-4cce-b298-02f15ff5e20d admin admin] PATH_INFO: `/v3/projects/445eedfdd7d94cd2b755302139a2cd3c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:31.003921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c9082-ad92-4cce-b298-02f15ff5e20d admin admin] RBAC: Authorizing `identity:delete_project(project_id=445eedfdd7d94cd2b755302139a2cd3c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:31.005865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c9082-ad92-4cce-b298-02f15ff5e20d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:31.026781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:31.157110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-603c9082-ad92-4cce-b298-02f15ff5e20d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445eedfdd7d94cd2b755302139a2cd3c', 'request_id': 'req-603c9082-ad92-4cce-b298-02f15ff5e20d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:31.268242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-603c9082-ad92-4cce-b298-02f15ff5e20d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445eedfdd7d94cd2b755302139a2cd3c', 'request_id': 'req-603c9082-ad92-4cce-b298-02f15ff5e20d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:31.276951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-603c9082-ad92-4cce-b298-02f15ff5e20d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445eedfdd7d94cd2b755302139a2cd3c', 'request_id': 'req-603c9082-ad92-4cce-b298-02f15ff5e20d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:31.287660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-603c9082-ad92-4cce-b298-02f15ff5e20d admin admin] The token cache is being invalidate because project 445eedfdd7d94cd2b755302139a2cd3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:14:31.287939 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-603c9082-ad92-4cce-b298-02f15ff5e20d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:31.288564 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-603c9082-ad92-4cce-b298-02f15ff5e20d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:31.290131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1031/2058] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:14:30 2022] DELETE /identity/v3/projects/445eedfdd7d94cd2b755302139a2cd3c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:31.295006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77e181-da12-4aca-8003-1b32e032f7ec None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:31.295245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77e181-da12-4aca-8003-1b32e032f7ec None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:31.295525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77e181-da12-4aca-8003-1b32e032f7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:31.314200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7f77e181-da12-4aca-8003-1b32e032f7ec None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:31.315386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7f77e181-da12-4aca-8003-1b32e032f7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:31.372337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1028/2059] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:31.379915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f53d9-cb75-4086-858e-ec0f1038d4bf None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:31.380208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f53d9-cb75-4086-858e-ec0f1038d4bf None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:31.380541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f53d9-cb75-4086-858e-ec0f1038d4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:31.400116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-0c3f53d9-cb75-4086-858e-ec0f1038d4bf None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:31.401317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0c3f53d9-cb75-4086-858e-ec0f1038d4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:31.409290 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1032/2060] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:31.413825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77e181-da12-4aca-8003-1b32e032f7ec None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:31.423450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77e181-da12-4aca-8003-1b32e032f7ec None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:31.428040 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2e965-39fc-43f4-bc92-e2f38cd614a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:31.429384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2e965-39fc-43f4-bc92-e2f38cd614a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:31.429671 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2e965-39fc-43f4-bc92-e2f38cd614a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:31.429953 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2e965-39fc-43f4-bc92-e2f38cd614a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:31.430683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2e965-39fc-43f4-bc92-e2f38cd614a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:14:31.431086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2e965-39fc-43f4-bc92-e2f38cd614a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:31.432561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2e965-39fc-43f4-bc92-e2f38cd614a9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:31.448895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1029/2061] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:14:31.450764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f53d9-cb75-4086-858e-ec0f1038d4bf None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:31.460901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f53d9-cb75-4086-858e-ec0f1038d4bf None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:31.465810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707a2a9-c9e1-4ff3-85ec-e4d675bf2419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:31.466465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707a2a9-c9e1-4ff3-85ec-e4d675bf2419 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:31.466747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707a2a9-c9e1-4ff3-85ec-e4d675bf2419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:31.467021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707a2a9-c9e1-4ff3-85ec-e4d675bf2419 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:31.467702 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707a2a9-c9e1-4ff3-85ec-e4d675bf2419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:31.469703 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707a2a9-c9e1-4ff3-85ec-e4d675bf2419 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:31.656338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1033/2062] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:14:31 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:14:31.660346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2e965-39fc-43f4-bc92-e2f38cd614a9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:31.673710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2e965-39fc-43f4-bc92-e2f38cd614a9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:31.751318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a7d97-a970-41e6-853d-6633e30d84ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:31.752129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a7d97-a970-41e6-853d-6633e30d84ea admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:31.752419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a7d97-a970-41e6-853d-6633e30d84ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:31.752732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a7d97-a970-41e6-853d-6633e30d84ea admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:31.753564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a7d97-a970-41e6-853d-6633e30d84ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:31.755483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a7d97-a970-41e6-853d-6633e30d84ea admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:31.908510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1030/2063] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:14:31 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:14:31.913307 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707a2a9-c9e1-4ff3-85ec-e4d675bf2419 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:31.924208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707a2a9-c9e1-4ff3-85ec-e4d675bf2419 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:31.929517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac3460-a4fe-4860-9f2d-e7cb4752c663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:31.930210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac3460-a4fe-4860-9f2d-e7cb4752c663 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:31.930529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac3460-a4fe-4860-9f2d-e7cb4752c663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:31.930806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac3460-a4fe-4860-9f2d-e7cb4752c663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:31.931554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac3460-a4fe-4860-9f2d-e7cb4752c663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:31.933274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac3460-a4fe-4860-9f2d-e7cb4752c663 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:31.944011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1034/2064] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:14:31.948122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a7d97-a970-41e6-853d-6633e30d84ea admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:31.954614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:31.958968 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a7d97-a970-41e6-853d-6633e30d84ea admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:31.962969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd151331-eb89-4a22-bbb5-79bcd93f505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:31.963623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd151331-eb89-4a22-bbb5-79bcd93f505b admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:31.963903 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd151331-eb89-4a22-bbb5-79bcd93f505b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:31.964176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd151331-eb89-4a22-bbb5-79bcd93f505b admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:31.964929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd151331-eb89-4a22-bbb5-79bcd93f505b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:31.966507 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd151331-eb89-4a22-bbb5-79bcd93f505b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:31.977386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1031/2065] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:14:31.982205 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac3460-a4fe-4860-9f2d-e7cb4752c663 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:31.993106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac3460-a4fe-4860-9f2d-e7cb4752c663 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:31.997814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923f105-03ad-4f1e-8200-0d98c4680872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:31.998709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923f105-03ad-4f1e-8200-0d98c4680872 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:31.999003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923f105-03ad-4f1e-8200-0d98c4680872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:31.999353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923f105-03ad-4f1e-8200-0d98c4680872 admin admin] PATH_INFO: `/v3/projects/f902e0eda77545dcb64a38a6f010007e/users/5f75db436fa04ca5bf0f00091da8ff5f/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:32.013988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923f105-03ad-4f1e-8200-0d98c4680872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f902e0eda77545dcb64a38a6f010007e, user_id=5f75db436fa04ca5bf0f00091da8ff5f, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:32.016987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923f105-03ad-4f1e-8200-0d98c4680872 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:32.094984 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1035/2066] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:14:31 2022] PUT /identity/v3/projects/f902e0eda77545dcb64a38a6f010007e/users/5f75db436fa04ca5bf0f00091da8ff5f/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:32.112643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201cf6e-6807-4b93-9d43-5091067ac5e5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:32.113003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201cf6e-6807-4b93-9d43-5091067ac5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:32.113293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201cf6e-6807-4b93-9d43-5091067ac5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:32.142379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4201cf6e-6807-4b93-9d43-5091067ac5e5 None None] MFA Rules not processed for user `5f75db436fa04ca5bf0f00091da8ff5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:32.143592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4201cf6e-6807-4b93-9d43-5091067ac5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:32.211193 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1032/2067] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:32.222831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923f105-03ad-4f1e-8200-0d98c4680872 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:32.224620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a923f105-03ad-4f1e-8200-0d98c4680872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:32.283928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923f105-03ad-4f1e-8200-0d98c4680872 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:32.290182 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351873b-0805-4e6e-b116-dfa0d97523a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:32.291317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351873b-0805-4e6e-b116-dfa0d97523a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:32.292427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351873b-0805-4e6e-b116-dfa0d97523a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:32.292955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351873b-0805-4e6e-b116-dfa0d97523a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:32.303140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351873b-0805-4e6e-b116-dfa0d97523a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:32.304758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351873b-0805-4e6e-b116-dfa0d97523a3 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:32.314694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1036/2068] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:32.341030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201cf6e-6807-4b93-9d43-5091067ac5e5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:32.406647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201cf6e-6807-4b93-9d43-5091067ac5e5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:32.411455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610733f9-19e7-4241-8d4f-724987662bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:32.412375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610733f9-19e7-4241-8d4f-724987662bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:32.412673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610733f9-19e7-4241-8d4f-724987662bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:32.412970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610733f9-19e7-4241-8d4f-724987662bd7 admin admin] PATH_INFO: `/v3/users/5f75db436fa04ca5bf0f00091da8ff5f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:32.414179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610733f9-19e7-4241-8d4f-724987662bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f75db436fa04ca5bf0f00091da8ff5f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:32.416084 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610733f9-19e7-4241-8d4f-724987662bd7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:32.483297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351873b-0805-4e6e-b116-dfa0d97523a3 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:32.484909 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1351873b-0805-4e6e-b116-dfa0d97523a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:32.500977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351873b-0805-4e6e-b116-dfa0d97523a3 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:32.505860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc7b18-7757-4aba-a282-ea680e349516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:32.507079 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7b18-7757-4aba-a282-ea680e349516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:32.507432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7b18-7757-4aba-a282-ea680e349516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:32.508995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7b18-7757-4aba-a282-ea680e349516 admin admin] PATH_INFO: `/v3/users/9b590901163f4e958f2e40949ff5a320` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:32.512057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc7b18-7757-4aba-a282-ea680e349516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b590901163f4e958f2e40949ff5a320)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:32.512057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc7b18-7757-4aba-a282-ea680e349516 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:32.696824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-610733f9-19e7-4241-8d4f-724987662bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f75db436fa04ca5bf0f00091da8ff5f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:32.697539 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-610733f9-19e7-4241-8d4f-724987662bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f75db436fa04ca5bf0f00091da8ff5f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:32.851613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:32.859733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-78fc7b18-7757-4aba-a282-ea680e349516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b590901163f4e958f2e40949ff5a320'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:32.860484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-78fc7b18-7757-4aba-a282-ea680e349516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b590901163f4e958f2e40949ff5a320'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:32.861472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-78fc7b18-7757-4aba-a282-ea680e349516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b590901163f4e958f2e40949ff5a320'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:32.868504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-610733f9-19e7-4241-8d4f-724987662bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f75db436fa04ca5bf0f00091da8ff5f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:32.903859 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-610733f9-19e7-4241-8d4f-724987662bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f75db436fa04ca5bf0f00091da8ff5f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:32.904097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-78fc7b18-7757-4aba-a282-ea680e349516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b590901163f4e958f2e40949ff5a320'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:32.904508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-610733f9-19e7-4241-8d4f-724987662bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f75db436fa04ca5bf0f00091da8ff5f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:32.916181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1033/2069] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:14:32 2022] DELETE /identity/v3/users/5f75db436fa04ca5bf0f00091da8ff5f => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:32.920423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dc0f8-ff52-4701-85d9-7123348cd275 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:32.921403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dc0f8-ff52-4701-85d9-7123348cd275 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:32.921852 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dc0f8-ff52-4701-85d9-7123348cd275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:32.925333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-78fc7b18-7757-4aba-a282-ea680e349516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b590901163f4e958f2e40949ff5a320'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:32.930215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:32.947286 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-769dc0f8-ff52-4701-85d9-7123348cd275 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:32.948901 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-769dc0f8-ff52-4701-85d9-7123348cd275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:33.015029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1034/2070] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:33.025055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dc0f8-ff52-4701-85d9-7123348cd275 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:33.026411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-769dc0f8-ff52-4701-85d9-7123348cd275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:33.083828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dc0f8-ff52-4701-85d9-7123348cd275 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:33.088053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801bf1b-b115-413d-bce7-12a95f7322e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:33.088778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801bf1b-b115-413d-bce7-12a95f7322e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:33.089090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801bf1b-b115-413d-bce7-12a95f7322e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:33.089369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801bf1b-b115-413d-bce7-12a95f7322e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:33.099131 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801bf1b-b115-413d-bce7-12a95f7322e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:33.101326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801bf1b-b115-413d-bce7-12a95f7322e3 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:33.112758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1037/2071] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:14:32 2022] DELETE /identity/v3/users/9b590901163f4e958f2e40949ff5a320 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:14:33.113278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1035/2072] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:14:33.117196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886baad-a04b-4970-b660-6fe7d455c3c1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:33.117489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886baad-a04b-4970-b660-6fe7d455c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:33.117769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886baad-a04b-4970-b660-6fe7d455c3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:33.135853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d886baad-a04b-4970-b660-6fe7d455c3c1 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:33.137481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d886baad-a04b-4970-b660-6fe7d455c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:33.198674 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1038/2073] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:33.208313 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801bf1b-b115-413d-bce7-12a95f7322e3 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:33.210301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4801bf1b-b115-413d-bce7-12a95f7322e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:33.221578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801bf1b-b115-413d-bce7-12a95f7322e3 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:33.269494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5e4af-5753-4b3f-a20d-cefdb4c307d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:33.270149 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5e4af-5753-4b3f-a20d-cefdb4c307d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:33.270426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5e4af-5753-4b3f-a20d-cefdb4c307d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:33.270733 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5e4af-5753-4b3f-a20d-cefdb4c307d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:33.279794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5e4af-5753-4b3f-a20d-cefdb4c307d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:33.281267 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5e4af-5753-4b3f-a20d-cefdb4c307d7 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:33.291201 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1036/2074] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:33.727349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886baad-a04b-4970-b660-6fe7d455c3c1 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:33.727349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d886baad-a04b-4970-b660-6fe7d455c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:33.740909 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886baad-a04b-4970-b660-6fe7d455c3c1 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:33.747193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bf8db-2df5-4a6d-87b5-93a39614868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:33.748174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf8db-2df5-4a6d-87b5-93a39614868e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:33.748534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf8db-2df5-4a6d-87b5-93a39614868e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:33.748911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bf8db-2df5-4a6d-87b5-93a39614868e admin admin] PATH_INFO: `/v3/projects/f902e0eda77545dcb64a38a6f010007e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:33.750980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bf8db-2df5-4a6d-87b5-93a39614868e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f902e0eda77545dcb64a38a6f010007e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:33.754624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bf8db-2df5-4a6d-87b5-93a39614868e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:33.929288 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d03bf8db-2df5-4a6d-87b5-93a39614868e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f902e0eda77545dcb64a38a6f010007e', 'request_id': 'req-d03bf8db-2df5-4a6d-87b5-93a39614868e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:33.949674 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5e4af-5753-4b3f-a20d-cefdb4c307d7 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:33.951169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-44b5e4af-5753-4b3f-a20d-cefdb4c307d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:33.965561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5e4af-5753-4b3f-a20d-cefdb4c307d7 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.027263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff617579-f9e0-4ac8-b382-548e629cb10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.034467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff617579-f9e0-4ac8-b382-548e629cb10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.034467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff617579-f9e0-4ac8-b382-548e629cb10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.034467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff617579-f9e0-4ac8-b382-548e629cb10f admin admin] PATH_INFO: `/v3/projects/c06196b077f444f08c0ab4a68bf4bda0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.034467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff617579-f9e0-4ac8-b382-548e629cb10f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06196b077f444f08c0ab4a68bf4bda0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.034467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff617579-f9e0-4ac8-b382-548e629cb10f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.065823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d03bf8db-2df5-4a6d-87b5-93a39614868e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f902e0eda77545dcb64a38a6f010007e', 'request_id': 'req-d03bf8db-2df5-4a6d-87b5-93a39614868e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:34.073154 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d03bf8db-2df5-4a6d-87b5-93a39614868e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f902e0eda77545dcb64a38a6f010007e', 'request_id': 'req-d03bf8db-2df5-4a6d-87b5-93a39614868e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:34.086285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d03bf8db-2df5-4a6d-87b5-93a39614868e admin admin] The token cache is being invalidate because project f902e0eda77545dcb64a38a6f010007e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:14:34.086612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d03bf8db-2df5-4a6d-87b5-93a39614868e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:34.087316 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d03bf8db-2df5-4a6d-87b5-93a39614868e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:34.088902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1039/2075] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:14:33 2022] DELETE /identity/v3/projects/f902e0eda77545dcb64a38a6f010007e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:34.093803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc178284-d6dc-45be-9d6d-e16d9e3c89e1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.094100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc178284-d6dc-45be-9d6d-e16d9e3c89e1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.094378 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc178284-d6dc-45be-9d6d-e16d9e3c89e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.112357 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-cc178284-d6dc-45be-9d6d-e16d9e3c89e1 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:34.116059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cc178284-d6dc-45be-9d6d-e16d9e3c89e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:34.122465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1040/2076] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:34.130076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29355635-daee-43e9-b6af-90cb2d518a2a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.130367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29355635-daee-43e9-b6af-90cb2d518a2a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.130642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29355635-daee-43e9-b6af-90cb2d518a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.149774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-29355635-daee-43e9-b6af-90cb2d518a2a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:34.150888 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-29355635-daee-43e9-b6af-90cb2d518a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:34.159005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1041/2077] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:34.163488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29355635-daee-43e9-b6af-90cb2d518a2a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:34.172353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29355635-daee-43e9-b6af-90cb2d518a2a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.177170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926eaa6-b864-4654-9302-253a7080c446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.177819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926eaa6-b864-4654-9302-253a7080c446 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.178128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926eaa6-b864-4654-9302-253a7080c446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.179419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926eaa6-b864-4654-9302-253a7080c446 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.180356 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926eaa6-b864-4654-9302-253a7080c446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:14:34.180683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926eaa6-b864-4654-9302-253a7080c446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.182421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926eaa6-b864-4654-9302-253a7080c446 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.194384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1042/2078] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:14:34.198804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926eaa6-b864-4654-9302-253a7080c446 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:34.198961 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ff617579-f9e0-4ac8-b382-548e629cb10f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06196b077f444f08c0ab4a68bf4bda0', 'request_id': 'req-ff617579-f9e0-4ac8-b382-548e629cb10f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:34.205147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ff617579-f9e0-4ac8-b382-548e629cb10f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06196b077f444f08c0ab4a68bf4bda0', 'request_id': 'req-ff617579-f9e0-4ac8-b382-548e629cb10f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:34.208389 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926eaa6-b864-4654-9302-253a7080c446 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.210538 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ff617579-f9e0-4ac8-b382-548e629cb10f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06196b077f444f08c0ab4a68bf4bda0', 'request_id': 'req-ff617579-f9e0-4ac8-b382-548e629cb10f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:34.263550 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd00d7-7978-4b3c-8fa0-1d91a5d1c1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.264131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd00d7-7978-4b3c-8fa0-1d91a5d1c1cd admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.264413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd00d7-7978-4b3c-8fa0-1d91a5d1c1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.264714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd00d7-7978-4b3c-8fa0-1d91a5d1c1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.265397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd00d7-7978-4b3c-8fa0-1d91a5d1c1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.267600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd00d7-7978-4b3c-8fa0-1d91a5d1c1cd admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.270757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:34.314047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ff617579-f9e0-4ac8-b382-548e629cb10f admin admin] The token cache is being invalidate because project c06196b077f444f08c0ab4a68bf4bda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:14:34.314339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ff617579-f9e0-4ac8-b382-548e629cb10f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:34.314919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ff617579-f9e0-4ac8-b382-548e629cb10f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:34.316462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1037/2079] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:14:33 2022] DELETE /identity/v3/projects/c06196b077f444f08c0ab4a68bf4bda0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:14:34.322317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca0bf0-9c39-4a27-81d6-656f146c14a5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.322605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca0bf0-9c39-4a27-81d6-656f146c14a5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.322921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca0bf0-9c39-4a27-81d6-656f146c14a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.340555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d4ca0bf0-9c39-4a27-81d6-656f146c14a5 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:34.341773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d4ca0bf0-9c39-4a27-81d6-656f146c14a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:34.349876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1038/2080] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:34.357841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a2a09-38f0-4f86-9ea0-ac899f507e6b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.358133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a2a09-38f0-4f86-9ea0-ac899f507e6b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.358410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a2a09-38f0-4f86-9ea0-ac899f507e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.376493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-803a2a09-38f0-4f86-9ea0-ac899f507e6b None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:34.377724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-803a2a09-38f0-4f86-9ea0-ac899f507e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:34.385579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1039/2081] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:34.390467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a2a09-38f0-4f86-9ea0-ac899f507e6b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:34.399443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a2a09-38f0-4f86-9ea0-ac899f507e6b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.405257 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f037e-5390-46fc-b2bc-042cd67ef812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.405907 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f037e-5390-46fc-b2bc-042cd67ef812 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.406190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f037e-5390-46fc-b2bc-042cd67ef812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.406463 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f037e-5390-46fc-b2bc-042cd67ef812 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.407214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f037e-5390-46fc-b2bc-042cd67ef812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:14:34.407520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f037e-5390-46fc-b2bc-042cd67ef812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.409143 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f037e-5390-46fc-b2bc-042cd67ef812 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.421519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1040/2082] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:14:34.425774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f037e-5390-46fc-b2bc-042cd67ef812 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:34.435817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f037e-5390-46fc-b2bc-042cd67ef812 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.440522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735cd74-1d9b-4e80-90c1-976ef2552d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.441238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735cd74-1d9b-4e80-90c1-976ef2552d87 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.441520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735cd74-1d9b-4e80-90c1-976ef2552d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.441797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735cd74-1d9b-4e80-90c1-976ef2552d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.442548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735cd74-1d9b-4e80-90c1-976ef2552d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.444451 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735cd74-1d9b-4e80-90c1-976ef2552d87 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.448912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1043/2083] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:14:34 2022] POST /identity/v3/projects => generated 381 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:14:34.453049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd00d7-7978-4b3c-8fa0-1d91a5d1c1cd admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:34.454827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3ddd00d7-7978-4b3c-8fa0-1d91a5d1c1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:34.529652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd00d7-7978-4b3c-8fa0-1d91a5d1c1cd admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.534480 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dff0fe-3383-4a0f-80e4-0304ed4bd3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.535183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dff0fe-3383-4a0f-80e4-0304ed4bd3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.535560 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dff0fe-3383-4a0f-80e4-0304ed4bd3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.535840 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dff0fe-3383-4a0f-80e4-0304ed4bd3a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.536541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dff0fe-3383-4a0f-80e4-0304ed4bd3a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.539237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dff0fe-3383-4a0f-80e4-0304ed4bd3a2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.560700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1041/2084] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:14:34 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:14:34.564130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735cd74-1d9b-4e80-90c1-976ef2552d87 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:34.653852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1044/2085] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:14:34 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:14:34.658253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735cd74-1d9b-4e80-90c1-976ef2552d87 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.659804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dff0fe-3383-4a0f-80e4-0304ed4bd3a2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:34.663570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97a115-220c-4bf5-b79e-beb50daee4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.664253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97a115-220c-4bf5-b79e-beb50daee4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.664540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97a115-220c-4bf5-b79e-beb50daee4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.664870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97a115-220c-4bf5-b79e-beb50daee4f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.665565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97a115-220c-4bf5-b79e-beb50daee4f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.667491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97a115-220c-4bf5-b79e-beb50daee4f3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.672085 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dff0fe-3383-4a0f-80e4-0304ed4bd3a2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.674573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:34.677817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d47847-8c4f-428d-903c-4169d59783b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.678650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d47847-8c4f-428d-903c-4169d59783b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.679037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d47847-8c4f-428d-903c-4169d59783b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.679446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d47847-8c4f-428d-903c-4169d59783b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.680411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d47847-8c4f-428d-903c-4169d59783b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.682198 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d47847-8c4f-428d-903c-4169d59783b9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.696479 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1045/2086] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:14:34.703144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d47847-8c4f-428d-903c-4169d59783b9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:34.717694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d47847-8c4f-428d-903c-4169d59783b9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.727296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bdeae-aa80-4451-8a81-663ce6018800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.728183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bdeae-aa80-4451-8a81-663ce6018800 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.729901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bdeae-aa80-4451-8a81-663ce6018800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.730391 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bdeae-aa80-4451-8a81-663ce6018800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.731286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bdeae-aa80-4451-8a81-663ce6018800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.733033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bdeae-aa80-4451-8a81-663ce6018800 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.744296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1046/2087] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:14:34.748315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bdeae-aa80-4451-8a81-663ce6018800 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:34.760357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1042/2088] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:14:34 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:14:34.764325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97a115-220c-4bf5-b79e-beb50daee4f3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:34.771582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bdeae-aa80-4451-8a81-663ce6018800 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.775712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97a115-220c-4bf5-b79e-beb50daee4f3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.778219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ca7de-125b-4a22-b687-f546a2444073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.779223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca7de-125b-4a22-b687-f546a2444073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.779627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca7de-125b-4a22-b687-f546a2444073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.780203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca7de-125b-4a22-b687-f546a2444073 admin admin] PATH_INFO: `/v3/projects/385adda1b8ea42dcaaad194514a80d9b/users/3e3a907a8fe249f8bc0be8438b2c2e51/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.781010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022131ee-2a17-4f68-87e5-3a16c18a5c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.781737 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022131ee-2a17-4f68-87e5-3a16c18a5c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.782033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022131ee-2a17-4f68-87e5-3a16c18a5c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.782320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022131ee-2a17-4f68-87e5-3a16c18a5c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.783060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022131ee-2a17-4f68-87e5-3a16c18a5c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.784852 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022131ee-2a17-4f68-87e5-3a16c18a5c21 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.799355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1043/2089] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:14:34.800031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ca7de-125b-4a22-b687-f546a2444073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385adda1b8ea42dcaaad194514a80d9b, user_id=3e3a907a8fe249f8bc0be8438b2c2e51, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.800254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022131ee-2a17-4f68-87e5-3a16c18a5c21 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:34.804242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ca7de-125b-4a22-b687-f546a2444073 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.812201 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022131ee-2a17-4f68-87e5-3a16c18a5c21 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.817685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3378c-c6d2-4044-a362-c48757c67ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.817942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3378c-c6d2-4044-a362-c48757c67ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.818379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3378c-c6d2-4044-a362-c48757c67ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.819167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3378c-c6d2-4044-a362-c48757c67ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.819911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3378c-c6d2-4044-a362-c48757c67ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.823914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3378c-c6d2-4044-a362-c48757c67ea8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.833195 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1044/2090] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:14:34.837777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3378c-c6d2-4044-a362-c48757c67ea8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:34.848109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3378c-c6d2-4044-a362-c48757c67ea8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:34.853642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e6947-9237-4c46-b7cc-cc3a2af411d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:34.855906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e6947-9237-4c46-b7cc-cc3a2af411d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.855906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e6947-9237-4c46-b7cc-cc3a2af411d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.855906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e6947-9237-4c46-b7cc-cc3a2af411d9 admin admin] PATH_INFO: `/v3/projects/5648df69fdc54fbd8e89ba3d2bb6e472/users/22b7d04d088e4359afe8b92f10bf517e/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.872260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e6947-9237-4c46-b7cc-cc3a2af411d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5648df69fdc54fbd8e89ba3d2bb6e472, user_id=22b7d04d088e4359afe8b92f10bf517e, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:34.875021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e6947-9237-4c46-b7cc-cc3a2af411d9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:34.892175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1047/2091] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:14:34 2022] PUT /identity/v3/projects/385adda1b8ea42dcaaad194514a80d9b/users/3e3a907a8fe249f8bc0be8438b2c2e51/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:14:34.897107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59954e-b0f4-49c2-9498-bd3aab1a5e10 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:34.897608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59954e-b0f4-49c2-9498-bd3aab1a5e10 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:34.897996 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59954e-b0f4-49c2-9498-bd3aab1a5e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:34.925432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-dc59954e-b0f4-49c2-9498-bd3aab1a5e10 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:34.927051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dc59954e-b0f4-49c2-9498-bd3aab1a5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:35.004097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1048/2092] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:35.020848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1045/2093] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:14:34 2022] PUT /identity/v3/projects/5648df69fdc54fbd8e89ba3d2bb6e472/users/22b7d04d088e4359afe8b92f10bf517e/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:14:35.022285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59954e-b0f4-49c2-9498-bd3aab1a5e10 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:35.023983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dc59954e-b0f4-49c2-9498-bd3aab1a5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:35.032416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107cd57-ee90-4600-8d0d-4c5a24b49ebd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:35.034925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107cd57-ee90-4600-8d0d-4c5a24b49ebd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:35.036846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107cd57-ee90-4600-8d0d-4c5a24b49ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:35.115901 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f107cd57-ee90-4600-8d0d-4c5a24b49ebd None None] MFA Rules not processed for user `22b7d04d088e4359afe8b92f10bf517e`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:35.116123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59954e-b0f4-49c2-9498-bd3aab1a5e10 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:35.117447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f107cd57-ee90-4600-8d0d-4c5a24b49ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:35.124624 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:35.187912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13db64c-2fdf-4fd9-98d3-5e14236c6d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:35.188892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13db64c-2fdf-4fd9-98d3-5e14236c6d06 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:35.189255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13db64c-2fdf-4fd9-98d3-5e14236c6d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:35.189762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13db64c-2fdf-4fd9-98d3-5e14236c6d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:35.216509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1046/2094] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:35.228643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107cd57-ee90-4600-8d0d-4c5a24b49ebd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:35.230243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f107cd57-ee90-4600-8d0d-4c5a24b49ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:35.274121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13db64c-2fdf-4fd9-98d3-5e14236c6d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:35.275619 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13db64c-2fdf-4fd9-98d3-5e14236c6d06 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:35.286947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1049/2095] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:35.298450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107cd57-ee90-4600-8d0d-4c5a24b49ebd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:35.302797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0afb5-6ce2-4a83-86b8-4a07422fc01a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:35.303974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0afb5-6ce2-4a83-86b8-4a07422fc01a service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:35.304259 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0afb5-6ce2-4a83-86b8-4a07422fc01a service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:35.304538 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0afb5-6ce2-4a83-86b8-4a07422fc01a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:35.314746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0afb5-6ce2-4a83-86b8-4a07422fc01a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:35.316189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0afb5-6ce2-4a83-86b8-4a07422fc01a service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:35.330115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1047/2096] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:35.765924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:37.202234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13db64c-2fdf-4fd9-98d3-5e14236c6d06 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:37.203829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a13db64c-2fdf-4fd9-98d3-5e14236c6d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:37.223338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13db64c-2fdf-4fd9-98d3-5e14236c6d06 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:37.233817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887ae93-30a1-48c3-8661-67cb80d60d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:37.235113 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887ae93-30a1-48c3-8661-67cb80d60d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:37.235490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887ae93-30a1-48c3-8661-67cb80d60d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:37.235867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887ae93-30a1-48c3-8661-67cb80d60d42 admin admin] PATH_INFO: `/v3/users/e1573115cdcd4a7fb44791853ffd37d7` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:37.237297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887ae93-30a1-48c3-8661-67cb80d60d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1573115cdcd4a7fb44791853ffd37d7)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:37.249091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887ae93-30a1-48c3-8661-67cb80d60d42 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:37.554431 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c887ae93-30a1-48c3-8661-67cb80d60d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1573115cdcd4a7fb44791853ffd37d7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:37.555109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c887ae93-30a1-48c3-8661-67cb80d60d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1573115cdcd4a7fb44791853ffd37d7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:37.555723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c887ae93-30a1-48c3-8661-67cb80d60d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1573115cdcd4a7fb44791853ffd37d7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:37.568143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c887ae93-30a1-48c3-8661-67cb80d60d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1573115cdcd4a7fb44791853ffd37d7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:37.575703 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c887ae93-30a1-48c3-8661-67cb80d60d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1573115cdcd4a7fb44791853ffd37d7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:37.607294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e26599-e35e-4d9e-9ad1-3084d73df625 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:37.607793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e26599-e35e-4d9e-9ad1-3084d73df625 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:37.608003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e26599-e35e-4d9e-9ad1-3084d73df625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:37.639849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-47e26599-e35e-4d9e-9ad1-3084d73df625 None None] MFA Rules not processed for user `3e3a907a8fe249f8bc0be8438b2c2e51`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:37.641070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-47e26599-e35e-4d9e-9ad1-3084d73df625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:37.671873 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1050/2097] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:14:37 2022] DELETE /identity/v3/users/e1573115cdcd4a7fb44791853ffd37d7 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:37.678377 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a53f99-7b9d-4d13-90f4-790285a011ac None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:37.679108 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a53f99-7b9d-4d13-90f4-790285a011ac None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:37.680024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a53f99-7b9d-4d13-90f4-790285a011ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:37.703046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-18a53f99-7b9d-4d13-90f4-790285a011ac None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:37.703046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-18a53f99-7b9d-4d13-90f4-790285a011ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:37.715357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:37.725892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1048/2098] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:37.738070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e26599-e35e-4d9e-9ad1-3084d73df625 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:37.742465 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-47e26599-e35e-4d9e-9ad1-3084d73df625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:37.756145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e26599-e35e-4d9e-9ad1-3084d73df625 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:37.765023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:37.801821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1051/2099] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:37.810249 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a53f99-7b9d-4d13-90f4-790285a011ac None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:37.811922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-18a53f99-7b9d-4d13-90f4-790285a011ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:37.848965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b529428-47f7-4e18-9fdf-1c9be109cffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:37.849987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b529428-47f7-4e18-9fdf-1c9be109cffa service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:37.850552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b529428-47f7-4e18-9fdf-1c9be109cffa service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:37.851036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b529428-47f7-4e18-9fdf-1c9be109cffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:37.888606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a53f99-7b9d-4d13-90f4-790285a011ac None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:37.895043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bc588-de3a-4f19-a087-8a7ab3973c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:37.895843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bc588-de3a-4f19-a087-8a7ab3973c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:37.896225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bc588-de3a-4f19-a087-8a7ab3973c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:37.896632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bc588-de3a-4f19-a087-8a7ab3973c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:37.913347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bc588-de3a-4f19-a087-8a7ab3973c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:37.914789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bc588-de3a-4f19-a087-8a7ab3973c84 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:37.925515 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1052/2100] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:14:37.929720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b529428-47f7-4e18-9fdf-1c9be109cffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:37.931240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b529428-47f7-4e18-9fdf-1c9be109cffa service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:37.941367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1049/2101] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:14:38.407842 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abcb66-86d4-4d93-aa07-9abf0c368620 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:38.408311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abcb66-86d4-4d93-aa07-9abf0c368620 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:38.408401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abcb66-86d4-4d93-aa07-9abf0c368620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:38.430247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b529428-47f7-4e18-9fdf-1c9be109cffa service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:38.431999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2b529428-47f7-4e18-9fdf-1c9be109cffa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:38.432520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-26abcb66-86d4-4d93-aa07-9abf0c368620 None None] MFA Rules not processed for user `c3cff2d803b84f6cadea85eb0822ba62`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:38.448418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-26abcb66-86d4-4d93-aa07-9abf0c368620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:38.471819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b529428-47f7-4e18-9fdf-1c9be109cffa service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:38.483602 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:38.484625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:38.484913 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:38.485189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] PATH_INFO: `/v3/projects/940558be8f6047889b222dab428ce1cf` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:38.493103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=940558be8f6047889b222dab428ce1cf)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:38.493103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:38.578905 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1053/2102] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:38.683213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940558be8f6047889b222dab428ce1cf', 'request_id': 'req-395cb630-b4a9-4473-ac4d-5924f0e3a886'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:38.694478 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940558be8f6047889b222dab428ce1cf', 'request_id': 'req-395cb630-b4a9-4473-ac4d-5924f0e3a886'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:38.702563 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940558be8f6047889b222dab428ce1cf', 'request_id': 'req-395cb630-b4a9-4473-ac4d-5924f0e3a886'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:38.792727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] The token cache is being invalidate because project 940558be8f6047889b222dab428ce1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:14:38.793687 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:38.794597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:38.796835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1050/2103] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:14:38 2022] DELETE /identity/v3/projects/940558be8f6047889b222dab428ce1cf => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:38.802367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abcb66-86d4-4d93-aa07-9abf0c368620 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:38.820517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abcb66-86d4-4d93-aa07-9abf0c368620 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:38.951251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:38.952099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:38.952425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:38.952746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] PATH_INFO: `/v3/users/5a433a7d7bfd4eb999179ea955b16454` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:38.954057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a433a7d7bfd4eb999179ea955b16454)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:38.956122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:39.206705 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a433a7d7bfd4eb999179ea955b16454'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:39.207569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a433a7d7bfd4eb999179ea955b16454'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:39.208369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a433a7d7bfd4eb999179ea955b16454'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:39.224090 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a433a7d7bfd4eb999179ea955b16454'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:39.231703 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a433a7d7bfd4eb999179ea955b16454'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:39.343396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1054/2104] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:14:38 2022] DELETE /identity/v3/users/5a433a7d7bfd4eb999179ea955b16454 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:39.809771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:39.815072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:39.822076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:39.855190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cb630-b4a9-4473-ac4d-5924f0e3a886 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:39.890992 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:39.918727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f087da-396d-409e-85b4-aa51b2cc2ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:39.919635 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f087da-396d-409e-85b4-aa51b2cc2ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:39.919937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f087da-396d-409e-85b4-aa51b2cc2ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:39.920214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f087da-396d-409e-85b4-aa51b2cc2ff3 admin admin] PATH_INFO: `/v3/users/852d5930824842d5a28160bcc54f5c71` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:39.921438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f087da-396d-409e-85b4-aa51b2cc2ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852d5930824842d5a28160bcc54f5c71)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:39.923416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f087da-396d-409e-85b4-aa51b2cc2ff3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:39.947925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:39.951092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:39.970097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f6a6d-43c8-4369-a1cb-344f46864100 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:39.977954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45907ccd-5294-4b69-bd23-8402f1019f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:39.979329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45907ccd-5294-4b69-bd23-8402f1019f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:39.979661 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45907ccd-5294-4b69-bd23-8402f1019f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:39.980199 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45907ccd-5294-4b69-bd23-8402f1019f54 admin admin] PATH_INFO: `/v3/projects/bdf4164bf2c94c2a8deccf6901770ea9` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:39.981646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45907ccd-5294-4b69-bd23-8402f1019f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf4164bf2c94c2a8deccf6901770ea9)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:39.983451 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45907ccd-5294-4b69-bd23-8402f1019f54 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:40.125956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-45907ccd-5294-4b69-bd23-8402f1019f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf4164bf2c94c2a8deccf6901770ea9', 'request_id': 'req-45907ccd-5294-4b69-bd23-8402f1019f54'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:40.133285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-19f087da-396d-409e-85b4-aa51b2cc2ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852d5930824842d5a28160bcc54f5c71'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:40.134083 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-19f087da-396d-409e-85b4-aa51b2cc2ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852d5930824842d5a28160bcc54f5c71'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:40.227394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-45907ccd-5294-4b69-bd23-8402f1019f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf4164bf2c94c2a8deccf6901770ea9', 'request_id': 'req-45907ccd-5294-4b69-bd23-8402f1019f54'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:40.234750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-45907ccd-5294-4b69-bd23-8402f1019f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf4164bf2c94c2a8deccf6901770ea9', 'request_id': 'req-45907ccd-5294-4b69-bd23-8402f1019f54'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:40.247230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-45907ccd-5294-4b69-bd23-8402f1019f54 admin admin] The token cache is being invalidate because project bdf4164bf2c94c2a8deccf6901770ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:14:40.247684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-45907ccd-5294-4b69-bd23-8402f1019f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:40.248343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-45907ccd-5294-4b69-bd23-8402f1019f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:40.249904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1055/2105] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:14:39 2022] DELETE /identity/v3/projects/bdf4164bf2c94c2a8deccf6901770ea9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:40.268823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c96af-937c-40e6-8be8-209db27f1ac3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:40.269215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c96af-937c-40e6-8be8-209db27f1ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:40.269633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c96af-937c-40e6-8be8-209db27f1ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:40.293337 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d98c96af-937c-40e6-8be8-209db27f1ac3 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:40.294883 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d98c96af-937c-40e6-8be8-209db27f1ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:40.302597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-19f087da-396d-409e-85b4-aa51b2cc2ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852d5930824842d5a28160bcc54f5c71'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:40.318943 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-19f087da-396d-409e-85b4-aa51b2cc2ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852d5930824842d5a28160bcc54f5c71'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:40.325882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-19f087da-396d-409e-85b4-aa51b2cc2ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852d5930824842d5a28160bcc54f5c71'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:40.332045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1051/2106] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:14:39 2022] DELETE /identity/v3/users/852d5930824842d5a28160bcc54f5c71 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:40.360466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1056/2107] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:40.369472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45f371-84fc-4cf7-982d-fc9c07678bdc None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:40.369786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45f371-84fc-4cf7-982d-fc9c07678bdc None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:40.370069 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45f371-84fc-4cf7-982d-fc9c07678bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:40.389528 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ee45f371-84fc-4cf7-982d-fc9c07678bdc None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:40.390728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ee45f371-84fc-4cf7-982d-fc9c07678bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:40.452145 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1052/2108] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:40.456721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c96af-937c-40e6-8be8-209db27f1ac3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:40.467349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c96af-937c-40e6-8be8-209db27f1ac3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:40.472168 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57117c-ada0-453f-aa3d-0d6b712fb144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:40.472916 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57117c-ada0-453f-aa3d-0d6b712fb144 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:40.473207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57117c-ada0-453f-aa3d-0d6b712fb144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:40.473489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57117c-ada0-453f-aa3d-0d6b712fb144 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:40.474217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57117c-ada0-453f-aa3d-0d6b712fb144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:14:40.477318 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57117c-ada0-453f-aa3d-0d6b712fb144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:40.477318 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57117c-ada0-453f-aa3d-0d6b712fb144 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:40.488551 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1057/2109] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:14:40.493356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45f371-84fc-4cf7-982d-fc9c07678bdc None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:40.502841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45f371-84fc-4cf7-982d-fc9c07678bdc None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:40.507708 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efef77f-a227-4324-9f0f-b88963587b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:40.508366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efef77f-a227-4324-9f0f-b88963587b9a admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:40.508667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efef77f-a227-4324-9f0f-b88963587b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:40.508969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efef77f-a227-4324-9f0f-b88963587b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:40.509663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efef77f-a227-4324-9f0f-b88963587b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:40.511585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efef77f-a227-4324-9f0f-b88963587b9a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:40.684641 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57117c-ada0-453f-aa3d-0d6b712fb144 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:40.686620 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1053/2110] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:14:40 2022] POST /identity/v3/projects => generated 351 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:14:40.690783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-0b57117c-ada0-453f-aa3d-0d6b712fb144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:40.691850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efef77f-a227-4324-9f0f-b88963587b9a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:40.706741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57117c-ada0-453f-aa3d-0d6b712fb144 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:40.759235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efef77f-a227-4324-9f0f-b88963587b9a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:40.763819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:40.764734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:40.764945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda36d1b-8a5c-493c-baa5-f10cad58fac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:40.765040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:40.765283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] PATH_INFO: `/v3/projects/44241e4684c746209c0e0be8851fcd3e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:40.765722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda36d1b-8a5c-493c-baa5-f10cad58fac7 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:40.766077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda36d1b-8a5c-493c-baa5-f10cad58fac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:40.766602 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda36d1b-8a5c-493c-baa5-f10cad58fac7 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:40.766755 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44241e4684c746209c0e0be8851fcd3e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:40.767289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda36d1b-8a5c-493c-baa5-f10cad58fac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:40.768961 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:40.769227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda36d1b-8a5c-493c-baa5-f10cad58fac7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:40.877064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1054/2111] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:14:40 2022] POST /identity/v3/users => generated 276 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:14:40.879553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda36d1b-8a5c-493c-baa5-f10cad58fac7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:40.902953 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda36d1b-8a5c-493c-baa5-f10cad58fac7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:40.906154 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44241e4684c746209c0e0be8851fcd3e', 'request_id': 'req-a783c6a6-3ffc-4aee-99b1-cffae6afb626'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:40.973625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6317aa-4295-4c87-a149-1577eb1517ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:40.974305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6317aa-4295-4c87-a149-1577eb1517ef admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:40.974619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6317aa-4295-4c87-a149-1577eb1517ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:40.974902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6317aa-4295-4c87-a149-1577eb1517ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:40.975692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6317aa-4295-4c87-a149-1577eb1517ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:40.977343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6317aa-4295-4c87-a149-1577eb1517ef admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:40.986885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1055/2112] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:14:40.988077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988194d-315f-49f6-9334-53fb9d25f977 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:40.988800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988194d-315f-49f6-9334-53fb9d25f977 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:40.988800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988194d-315f-49f6-9334-53fb9d25f977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.005384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6988194d-315f-49f6-9334-53fb9d25f977 None None] MFA Rules not processed for user `3e3a907a8fe249f8bc0be8438b2c2e51`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:41.007108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6988194d-315f-49f6-9334-53fb9d25f977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:41.010905 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44241e4684c746209c0e0be8851fcd3e', 'request_id': 'req-a783c6a6-3ffc-4aee-99b1-cffae6afb626'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:41.017808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44241e4684c746209c0e0be8851fcd3e', 'request_id': 'req-a783c6a6-3ffc-4aee-99b1-cffae6afb626'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:41.029088 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] The token cache is being invalidate because project 44241e4684c746209c0e0be8851fcd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:14:41.029378 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:41.030024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:41.031577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1058/2113] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:14:40 2022] DELETE /identity/v3/projects/44241e4684c746209c0e0be8851fcd3e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:41.032401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.033976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:41.046855 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c6a6-3ffc-4aee-99b1-cffae6afb626 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.051512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61e867-23d5-492a-939f-f7b5299dc681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.055570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61e867-23d5-492a-939f-f7b5299dc681 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.055570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61e867-23d5-492a-939f-f7b5299dc681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.055570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61e867-23d5-492a-939f-f7b5299dc681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.055570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61e867-23d5-492a-939f-f7b5299dc681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.055570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61e867-23d5-492a-939f-f7b5299dc681 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.061714 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1056/2114] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:41.063066 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf7d3-4c81-4df6-ba9e-2c1c492e7e4e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.063347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf7d3-4c81-4df6-ba9e-2c1c492e7e4e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.063561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf7d3-4c81-4df6-ba9e-2c1c492e7e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.071643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1059/2115] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:14:41.077185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61e867-23d5-492a-939f-f7b5299dc681 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.088424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-51acf7d3-4c81-4df6-ba9e-2c1c492e7e4e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:41.088968 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61e867-23d5-492a-939f-f7b5299dc681 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.089666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-51acf7d3-4c81-4df6-ba9e-2c1c492e7e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:41.094373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac8789-4fa2-497a-be6d-230ffe51c32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.095258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac8789-4fa2-497a-be6d-230ffe51c32e admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.095542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac8789-4fa2-497a-be6d-230ffe51c32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.095869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac8789-4fa2-497a-be6d-230ffe51c32e admin admin] PATH_INFO: `/v3/projects/bedaa56584794792a1a5d86b730e239a/users/c3898794cf57453381f3454f91c22788/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.098170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1057/2116] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:41.106416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21c6fb-af5d-4054-8f9f-5755880c4312 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.106704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21c6fb-af5d-4054-8f9f-5755880c4312 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.106983 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21c6fb-af5d-4054-8f9f-5755880c4312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.120363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac8789-4fa2-497a-be6d-230ffe51c32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bedaa56584794792a1a5d86b730e239a, user_id=c3898794cf57453381f3454f91c22788, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.123093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac8789-4fa2-497a-be6d-230ffe51c32e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.127745 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4e21c6fb-af5d-4054-8f9f-5755880c4312 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:41.129440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4e21c6fb-af5d-4054-8f9f-5755880c4312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:41.140056 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1058/2117] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:41.142985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21c6fb-af5d-4054-8f9f-5755880c4312 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.152404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21c6fb-af5d-4054-8f9f-5755880c4312 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.158302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332350c3-80d8-4304-af1c-af5977f63d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.158957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332350c3-80d8-4304-af1c-af5977f63d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.159246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332350c3-80d8-4304-af1c-af5977f63d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.159528 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332350c3-80d8-4304-af1c-af5977f63d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.160263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332350c3-80d8-4304-af1c-af5977f63d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:14:41.160579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332350c3-80d8-4304-af1c-af5977f63d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.162773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332350c3-80d8-4304-af1c-af5977f63d0a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.174256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1059/2118] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:14:41.179087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332350c3-80d8-4304-af1c-af5977f63d0a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.188912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332350c3-80d8-4304-af1c-af5977f63d0a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.194556 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1060/2119] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:14:41 2022] PUT /identity/v3/projects/bedaa56584794792a1a5d86b730e239a/users/c3898794cf57453381f3454f91c22788/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:41.213280 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5f97e-fcd5-470c-a296-c2d9fa6b1ae3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.213571 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5f97e-fcd5-470c-a296-c2d9fa6b1ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.214072 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5f97e-fcd5-470c-a296-c2d9fa6b1ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.241685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f2b5f97e-fcd5-470c-a296-c2d9fa6b1ae3 None None] MFA Rules not processed for user `c3898794cf57453381f3454f91c22788`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:41.243382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f2b5f97e-fcd5-470c-a296-c2d9fa6b1ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:41.253791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73712c7c-ff8d-403a-9477-30270ad2f024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.254601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73712c7c-ff8d-403a-9477-30270ad2f024 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.255150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73712c7c-ff8d-403a-9477-30270ad2f024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.255430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73712c7c-ff8d-403a-9477-30270ad2f024 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.256320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73712c7c-ff8d-403a-9477-30270ad2f024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.258614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73712c7c-ff8d-403a-9477-30270ad2f024 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.314875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1061/2120] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:41 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:41.319317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5f97e-fcd5-470c-a296-c2d9fa6b1ae3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.329788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5f97e-fcd5-470c-a296-c2d9fa6b1ae3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.335055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174bcf9-3c60-47de-8eeb-f2925a836bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.335779 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174bcf9-3c60-47de-8eeb-f2925a836bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.336070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174bcf9-3c60-47de-8eeb-f2925a836bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.336351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174bcf9-3c60-47de-8eeb-f2925a836bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.337106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174bcf9-3c60-47de-8eeb-f2925a836bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.339092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174bcf9-3c60-47de-8eeb-f2925a836bdb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.346211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1060/2121] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:14:41 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:14:41.350875 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73712c7c-ff8d-403a-9477-30270ad2f024 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.411368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73712c7c-ff8d-403a-9477-30270ad2f024 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.416562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9479d-e82e-4c1d-9604-092c3386b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.417259 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9479d-e82e-4c1d-9604-092c3386b4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.417539 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9479d-e82e-4c1d-9604-092c3386b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.417814 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9479d-e82e-4c1d-9604-092c3386b4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.418493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9479d-e82e-4c1d-9604-092c3386b4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.420392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9479d-e82e-4c1d-9604-092c3386b4a4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.433103 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1062/2122] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:14:41 2022] POST /identity/v3/projects => generated 355 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:14:41.436984 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174bcf9-3c60-47de-8eeb-f2925a836bdb admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.499274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174bcf9-3c60-47de-8eeb-f2925a836bdb admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.504279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901cfae-b2e8-4dd3-9446-237a78e1fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.505078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901cfae-b2e8-4dd3-9446-237a78e1fc21 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.505430 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901cfae-b2e8-4dd3-9446-237a78e1fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.505870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901cfae-b2e8-4dd3-9446-237a78e1fc21 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.506623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901cfae-b2e8-4dd3-9446-237a78e1fc21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.508636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901cfae-b2e8-4dd3-9446-237a78e1fc21 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.520820 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1061/2123] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:14:41 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:14:41.525073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9479d-e82e-4c1d-9604-092c3386b4a4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.534824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9479d-e82e-4c1d-9604-092c3386b4a4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.542787 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51f87d-08e1-4a9b-ac1a-21ea6d550085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.543555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51f87d-08e1-4a9b-ac1a-21ea6d550085 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.549732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51f87d-08e1-4a9b-ac1a-21ea6d550085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.549732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51f87d-08e1-4a9b-ac1a-21ea6d550085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.549732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51f87d-08e1-4a9b-ac1a-21ea6d550085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.549732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51f87d-08e1-4a9b-ac1a-21ea6d550085 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.556472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1062/2124] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:14:41.560577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51f87d-08e1-4a9b-ac1a-21ea6d550085 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.570822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51f87d-08e1-4a9b-ac1a-21ea6d550085 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.575570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c99653-068e-415d-8435-083cf3856c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.576209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c99653-068e-415d-8435-083cf3856c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.576500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c99653-068e-415d-8435-083cf3856c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.576826 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c99653-068e-415d-8435-083cf3856c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.577547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c99653-068e-415d-8435-083cf3856c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.579189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c99653-068e-415d-8435-083cf3856c9d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.590030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1063/2125] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:14:41.594069 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c99653-068e-415d-8435-083cf3856c9d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.603480 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c99653-068e-415d-8435-083cf3856c9d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.608103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad790a-0f6d-4b93-a567-8d94c15855e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.608999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad790a-0f6d-4b93-a567-8d94c15855e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.609285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad790a-0f6d-4b93-a567-8d94c15855e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.609564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad790a-0f6d-4b93-a567-8d94c15855e5 admin admin] PATH_INFO: `/v3/projects/3099acc816d04980b81787fd2c432eb4/users/fc8869f1b56b46e1844d5f7937fc8986/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.614313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1063/2126] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:14:41 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:14:41.618074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901cfae-b2e8-4dd3-9446-237a78e1fc21 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.624943 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad790a-0f6d-4b93-a567-8d94c15855e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3099acc816d04980b81787fd2c432eb4, user_id=fc8869f1b56b46e1844d5f7937fc8986, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.627578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad790a-0f6d-4b93-a567-8d94c15855e5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.627809 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901cfae-b2e8-4dd3-9446-237a78e1fc21 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.633179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a6fad-c9ce-4814-bf91-2d29764b54c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.633836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a6fad-c9ce-4814-bf91-2d29764b54c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.634122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a6fad-c9ce-4814-bf91-2d29764b54c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.634401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a6fad-c9ce-4814-bf91-2d29764b54c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.635126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a6fad-c9ce-4814-bf91-2d29764b54c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.636766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a6fad-c9ce-4814-bf91-2d29764b54c3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.647520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1064/2127] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:14:41.651473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a6fad-c9ce-4814-bf91-2d29764b54c3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.660803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a6fad-c9ce-4814-bf91-2d29764b54c3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.665417 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625adc36-e750-463c-91f3-28c745979626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.666220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625adc36-e750-463c-91f3-28c745979626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.666501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625adc36-e750-463c-91f3-28c745979626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.666775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625adc36-e750-463c-91f3-28c745979626 admin admin] PATH_INFO: `/v3/projects/852f336063c64012821c6d4f0545e036/users/02f4c2e804f541488ebe514584abc8c4/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.681085 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625adc36-e750-463c-91f3-28c745979626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852f336063c64012821c6d4f0545e036, user_id=02f4c2e804f541488ebe514584abc8c4, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.683759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625adc36-e750-463c-91f3-28c745979626 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.765702 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1064/2128] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:14:41 2022] PUT /identity/v3/projects/3099acc816d04980b81787fd2c432eb4/users/fc8869f1b56b46e1844d5f7937fc8986/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:14:41.771232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9594a-6a10-403b-8362-e7a6ee3ea48a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.772064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9594a-6a10-403b-8362-e7a6ee3ea48a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.772349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9594a-6a10-403b-8362-e7a6ee3ea48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.803132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0de9594a-6a10-403b-8362-e7a6ee3ea48a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:41.804558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0de9594a-6a10-403b-8362-e7a6ee3ea48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:41.825326 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1065/2129] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:14:41 2022] PUT /identity/v3/projects/852f336063c64012821c6d4f0545e036/users/02f4c2e804f541488ebe514584abc8c4/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:14:41.829783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625adc36-e750-463c-91f3-28c745979626 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.895452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:41.908844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1065/2130] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:41.919666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9594a-6a10-403b-8362-e7a6ee3ea48a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.921902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:41.923127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0de9594a-6a10-403b-8362-e7a6ee3ea48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:41.931588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625adc36-e750-463c-91f3-28c745979626 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.938565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503662bf-1282-4e74-b526-023cda966aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.939337 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503662bf-1282-4e74-b526-023cda966aac admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.939679 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503662bf-1282-4e74-b526-023cda966aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.940047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503662bf-1282-4e74-b526-023cda966aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.940940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503662bf-1282-4e74-b526-023cda966aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.943012 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503662bf-1282-4e74-b526-023cda966aac admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:41.958928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1066/2131] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:14:41.960785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503662bf-1282-4e74-b526-023cda966aac admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:41.978528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503662bf-1282-4e74-b526-023cda966aac admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:41.983514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc82bf7-1b29-49f7-862e-18beb06eb684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:41.984424 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc82bf7-1b29-49f7-862e-18beb06eb684 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:41.984730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc82bf7-1b29-49f7-862e-18beb06eb684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:41.985005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc82bf7-1b29-49f7-862e-18beb06eb684 admin admin] PATH_INFO: `/v3/projects/852f336063c64012821c6d4f0545e036/users/02f4c2e804f541488ebe514584abc8c4/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:41.987340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc82bf7-1b29-49f7-862e-18beb06eb684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852f336063c64012821c6d4f0545e036, user_id=02f4c2e804f541488ebe514584abc8c4, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:41.990771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc82bf7-1b29-49f7-862e-18beb06eb684 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:42.004709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1067/2132] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:14:41 2022] PUT /identity/v3/projects/852f336063c64012821c6d4f0545e036/users/02f4c2e804f541488ebe514584abc8c4/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:42.009879 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9594a-6a10-403b-8362-e7a6ee3ea48a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:42.016938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2740a0-123b-4718-8296-7b6f11036db9 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:42.017232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2740a0-123b-4718-8296-7b6f11036db9 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:42.017510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2740a0-123b-4718-8296-7b6f11036db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:42.049815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6f2740a0-123b-4718-8296-7b6f11036db9 None None] MFA Rules not processed for user `02f4c2e804f541488ebe514584abc8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:42.051055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6f2740a0-123b-4718-8296-7b6f11036db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:42.069431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d7142-e805-43ec-bc46-26ca52f5003c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:42.070412 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d7142-e805-43ec-bc46-26ca52f5003c service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:42.070696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d7142-e805-43ec-bc46-26ca52f5003c service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:42.070978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d7142-e805-43ec-bc46-26ca52f5003c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:42.139608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1068/2133] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:42 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:42.146332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d7142-e805-43ec-bc46-26ca52f5003c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:42.147520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d7142-e805-43ec-bc46-26ca52f5003c service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:42.151786 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2740a0-123b-4718-8296-7b6f11036db9 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:42.153521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6f2740a0-123b-4718-8296-7b6f11036db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:42.158967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1066/2134] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:14:42.217437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2740a0-123b-4718-8296-7b6f11036db9 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:42.221383 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5660ad-053e-4985-a7e8-1160d5779863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:42.222023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5660ad-053e-4985-a7e8-1160d5779863 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:42.222437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5660ad-053e-4985-a7e8-1160d5779863 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:42.222614 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5660ad-053e-4985-a7e8-1160d5779863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:42.231749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5660ad-053e-4985-a7e8-1160d5779863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:42.233211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5660ad-053e-4985-a7e8-1160d5779863 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:42.243272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1069/2135] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:42 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:42.470276 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d7142-e805-43ec-bc46-26ca52f5003c service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:42.480377 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d7142-e805-43ec-bc46-26ca52f5003c service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:42.484068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3415db-d885-4d3d-bdb3-c0afdddb0a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:42.484750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3415db-d885-4d3d-bdb3-c0afdddb0a54 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:42.485057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3415db-d885-4d3d-bdb3-c0afdddb0a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:42.485329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3415db-d885-4d3d-bdb3-c0afdddb0a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:42.545807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3415db-d885-4d3d-bdb3-c0afdddb0a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:42.547406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3415db-d885-4d3d-bdb3-c0afdddb0a54 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:42.557933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1067/2136] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:42 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:43.340001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:43.359773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:44.503785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:45.137452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:48.900767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749715e-d584-4038-8a94-7aaf18ba7703 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:48.901320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749715e-d584-4038-8a94-7aaf18ba7703 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:48.901320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749715e-d584-4038-8a94-7aaf18ba7703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:48.937462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3749715e-d584-4038-8a94-7aaf18ba7703 None None] MFA Rules not processed for user `fc8869f1b56b46e1844d5f7937fc8986`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:48.939371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3749715e-d584-4038-8a94-7aaf18ba7703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:48.958168 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:49.011238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1070/2137] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:49.025724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3415db-d885-4d3d-bdb3-c0afdddb0a54 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:49.027261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8f3415db-d885-4d3d-bdb3-c0afdddb0a54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:49.039005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:49.107169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3415db-d885-4d3d-bdb3-c0afdddb0a54 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:49.114560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6109b42-60e8-4727-b8ed-cf003bc6f8c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:49.114560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6109b42-60e8-4727-b8ed-cf003bc6f8c8 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:49.114560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6109b42-60e8-4727-b8ed-cf003bc6f8c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:49.114560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6109b42-60e8-4727-b8ed-cf003bc6f8c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:49.122611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6109b42-60e8-4727-b8ed-cf003bc6f8c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:49.124204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6109b42-60e8-4727-b8ed-cf003bc6f8c8 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:49.133078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1068/2138] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:53.465637 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afdec5-a08f-4396-8fa7-b1dc8524d329 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:53.466202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afdec5-a08f-4396-8fa7-b1dc8524d329 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:53.466202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afdec5-a08f-4396-8fa7-b1dc8524d329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:53.483422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-20afdec5-a08f-4396-8fa7-b1dc8524d329 None None] MFA Rules not processed for user `fc8869f1b56b46e1844d5f7937fc8986`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:53.484630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-20afdec5-a08f-4396-8fa7-b1dc8524d329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:53.492341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1071/2139] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:14:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:59.190567 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=30 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:03.478146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=22 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:09.467881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6109b42-60e8-4727-b8ed-cf003bc6f8c8 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:09.469353 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f6109b42-60e8-4727-b8ed-cf003bc6f8c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:09.483568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6109b42-60e8-4727-b8ed-cf003bc6f8c8 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:09.488049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:09.489602 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:09.489878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:09.490143 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] PATH_INFO: `/v3/users/22b7d04d088e4359afe8b92f10bf517e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:09.491355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b7d04d088e4359afe8b92f10bf517e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:09.493289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:09.756507 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b7d04d088e4359afe8b92f10bf517e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:09.758061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b7d04d088e4359afe8b92f10bf517e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:09.884110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b7d04d088e4359afe8b92f10bf517e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:09.903751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b7d04d088e4359afe8b92f10bf517e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:09.912562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b7d04d088e4359afe8b92f10bf517e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:09.922321 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1069/2140] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:15:09 2022] DELETE /identity/v3/users/22b7d04d088e4359afe8b92f10bf517e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:09.924530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca38a-f768-4693-91ff-cba1c9c4b674 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:09.925033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca38a-f768-4693-91ff-cba1c9c4b674 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:09.925239 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca38a-f768-4693-91ff-cba1c9c4b674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:09.943031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-eb1ca38a-f768-4693-91ff-cba1c9c4b674 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:09.944323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-eb1ca38a-f768-4693-91ff-cba1c9c4b674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:10.004330 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1072/2141] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:15:10.013890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:10.015346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:10.077602 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dee571-b7b2-4404-b0ee-47a36f526f0a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:10.081764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3205a25-b9a0-436f-b1ed-054ecede7b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:10.083322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3205a25-b9a0-436f-b1ed-054ecede7b9b service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:10.083322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3205a25-b9a0-436f-b1ed-054ecede7b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:10.083583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3205a25-b9a0-436f-b1ed-054ecede7b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:10.094129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3205a25-b9a0-436f-b1ed-054ecede7b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:10.095651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3205a25-b9a0-436f-b1ed-054ecede7b9b service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:10.106902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1070/2142] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:11.124142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ca38a-f768-4693-91ff-cba1c9c4b674 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:11.126324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-eb1ca38a-f768-4693-91ff-cba1c9c4b674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:11.157956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ca38a-f768-4693-91ff-cba1c9c4b674 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:11.168099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac94c2-38ba-4540-9b95-1a05a455252a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:11.169765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac94c2-38ba-4540-9b95-1a05a455252a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:11.171599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac94c2-38ba-4540-9b95-1a05a455252a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:11.172042 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac94c2-38ba-4540-9b95-1a05a455252a admin admin] PATH_INFO: `/v3/projects/5648df69fdc54fbd8e89ba3d2bb6e472` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:11.173530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac94c2-38ba-4540-9b95-1a05a455252a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5648df69fdc54fbd8e89ba3d2bb6e472)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:11.177347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac94c2-38ba-4540-9b95-1a05a455252a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:11.339044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bcac94c2-38ba-4540-9b95-1a05a455252a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5648df69fdc54fbd8e89ba3d2bb6e472', 'request_id': 'req-bcac94c2-38ba-4540-9b95-1a05a455252a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:11.449552 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bcac94c2-38ba-4540-9b95-1a05a455252a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5648df69fdc54fbd8e89ba3d2bb6e472', 'request_id': 'req-bcac94c2-38ba-4540-9b95-1a05a455252a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:11.456829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bcac94c2-38ba-4540-9b95-1a05a455252a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5648df69fdc54fbd8e89ba3d2bb6e472', 'request_id': 'req-bcac94c2-38ba-4540-9b95-1a05a455252a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:11.467988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bcac94c2-38ba-4540-9b95-1a05a455252a admin admin] The token cache is being invalidate because project 5648df69fdc54fbd8e89ba3d2bb6e472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:15:11.468278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bcac94c2-38ba-4540-9b95-1a05a455252a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:11.468966 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-bcac94c2-38ba-4540-9b95-1a05a455252a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:11.470727 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1073/2143] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:15:11 2022] DELETE /identity/v3/projects/5648df69fdc54fbd8e89ba3d2bb6e472 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:11.476036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a818b11-1aec-4506-b700-8b0626cf3ab8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:11.476592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a818b11-1aec-4506-b700-8b0626cf3ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:11.476975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a818b11-1aec-4506-b700-8b0626cf3ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:11.500295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3a818b11-1aec-4506-b700-8b0626cf3ab8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:11.501522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3a818b11-1aec-4506-b700-8b0626cf3ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:11.604841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1071/2144] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:15:11.611483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c14a-22ca-4d1f-ae99-182b17dde906 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:11.611780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c14a-22ca-4d1f-ae99-182b17dde906 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:11.612067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c14a-22ca-4d1f-ae99-182b17dde906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:11.631129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-fdf5c14a-22ca-4d1f-ae99-182b17dde906 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:11.632280 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fdf5c14a-22ca-4d1f-ae99-182b17dde906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:11.640349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1074/2145] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:11.644943 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a818b11-1aec-4506-b700-8b0626cf3ab8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:11.655089 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a818b11-1aec-4506-b700-8b0626cf3ab8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:11.665497 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173adc67-4f2a-405e-9637-b0e773f7c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:11.666289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173adc67-4f2a-405e-9637-b0e773f7c7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:11.666579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173adc67-4f2a-405e-9637-b0e773f7c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:11.666860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173adc67-4f2a-405e-9637-b0e773f7c7d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:11.667690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173adc67-4f2a-405e-9637-b0e773f7c7d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:15:11.667904 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173adc67-4f2a-405e-9637-b0e773f7c7d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:11.669542 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173adc67-4f2a-405e-9637-b0e773f7c7d4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:11.682809 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1072/2146] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:15:11.687332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5c14a-22ca-4d1f-ae99-182b17dde906 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:11.696848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5c14a-22ca-4d1f-ae99-182b17dde906 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:11.701640 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc387b64-f970-46cf-9404-ed5457b4c2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:11.702297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387b64-f970-46cf-9404-ed5457b4c2dc admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:11.702657 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387b64-f970-46cf-9404-ed5457b4c2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:11.702943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387b64-f970-46cf-9404-ed5457b4c2dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:11.703691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc387b64-f970-46cf-9404-ed5457b4c2dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:11.705661 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc387b64-f970-46cf-9404-ed5457b4c2dc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:11.804035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1075/2147] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:15:11 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:15:11.807704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173adc67-4f2a-405e-9637-b0e773f7c7d4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:11.813341 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:11.818655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173adc67-4f2a-405e-9637-b0e773f7c7d4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:11.873157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160654e-4a28-49e2-8759-869ac70b2ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:11.873797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160654e-4a28-49e2-8759-869ac70b2ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:11.874084 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160654e-4a28-49e2-8759-869ac70b2ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:11.874393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160654e-4a28-49e2-8759-869ac70b2ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:11.875075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160654e-4a28-49e2-8759-869ac70b2ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:11.877156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160654e-4a28-49e2-8759-869ac70b2ef9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:11.998919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1073/2148] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:15:11 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:15:12.003036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc387b64-f970-46cf-9404-ed5457b4c2dc admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:12.013308 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc387b64-f970-46cf-9404-ed5457b4c2dc admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:12.018430 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb2adb-5de0-4115-86c6-913f7137c829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:12.019102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb2adb-5de0-4115-86c6-913f7137c829 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:12.019369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb2adb-5de0-4115-86c6-913f7137c829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:12.020196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb2adb-5de0-4115-86c6-913f7137c829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:12.020933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb2adb-5de0-4115-86c6-913f7137c829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:12.022639 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb2adb-5de0-4115-86c6-913f7137c829 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:12.033620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1076/2149] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:15:12.038174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160654e-4a28-49e2-8759-869ac70b2ef9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:12.048526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160654e-4a28-49e2-8759-869ac70b2ef9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:12.053298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfa02e-58f6-4363-96b4-84544959c095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:12.054020 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfa02e-58f6-4363-96b4-84544959c095 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:12.054310 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfa02e-58f6-4363-96b4-84544959c095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:12.054593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfa02e-58f6-4363-96b4-84544959c095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:12.055329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfa02e-58f6-4363-96b4-84544959c095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:12.057014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfa02e-58f6-4363-96b4-84544959c095 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:12.067327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1074/2150] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:15:12.071651 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb2adb-5de0-4115-86c6-913f7137c829 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:12.083160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb2adb-5de0-4115-86c6-913f7137c829 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:12.087946 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9068c-db06-4618-8636-d200721e1340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:12.088887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9068c-db06-4618-8636-d200721e1340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:12.089181 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9068c-db06-4618-8636-d200721e1340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:12.089487 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9068c-db06-4618-8636-d200721e1340 admin admin] PATH_INFO: `/v3/projects/3d6a665bb8ef4873bb2330cfebb5770a/users/e6beb6af188b412eb9ee3c38f4c6b94d/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:12.105662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9068c-db06-4618-8636-d200721e1340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6a665bb8ef4873bb2330cfebb5770a, user_id=e6beb6af188b412eb9ee3c38f4c6b94d, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:12.108411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9068c-db06-4618-8636-d200721e1340 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:12.201691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1077/2151] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:15:12 2022] PUT /identity/v3/projects/3d6a665bb8ef4873bb2330cfebb5770a/users/e6beb6af188b412eb9ee3c38f4c6b94d/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:12.207479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcd91d-2d55-4e28-a7ae-ace2acd2379f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:12.207777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcd91d-2d55-4e28-a7ae-ace2acd2379f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:12.214752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcd91d-2d55-4e28-a7ae-ace2acd2379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:12.226691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-71fcd91d-2d55-4e28-a7ae-ace2acd2379f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:12.227887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-71fcd91d-2d55-4e28-a7ae-ace2acd2379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:12.288006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1075/2152] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:12.297546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9068c-db06-4618-8636-d200721e1340 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:12.299400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-30f9068c-db06-4618-8636-d200721e1340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:12.328771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:12.366601 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9068c-db06-4618-8636-d200721e1340 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:12.370386 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69194277-9bd0-4696-949f-d24186850f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:12.371040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69194277-9bd0-4696-949f-d24186850f3b service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:12.371327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69194277-9bd0-4696-949f-d24186850f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:12.371606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69194277-9bd0-4696-949f-d24186850f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:12.382223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69194277-9bd0-4696-949f-d24186850f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:12.383665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69194277-9bd0-4696-949f-d24186850f3b service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:12.393860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1078/2153] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:13.608955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcd91d-2d55-4e28-a7ae-ace2acd2379f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:13.610637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-71fcd91d-2d55-4e28-a7ae-ace2acd2379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:13.655402 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcd91d-2d55-4e28-a7ae-ace2acd2379f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:13.661236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:13.662759 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:13.663059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:13.663338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] PATH_INFO: `/v3/users/c3898794cf57453381f3454f91c22788` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:13.665089 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3898794cf57453381f3454f91c22788)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:13.667051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:13.985916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3898794cf57453381f3454f91c22788'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:13.986606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3898794cf57453381f3454f91c22788'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:14.073272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3898794cf57453381f3454f91c22788'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:14.093845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3898794cf57453381f3454f91c22788'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:14.098470 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:14.101581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3898794cf57453381f3454f91c22788'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:14.110433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1076/2154] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:15:13 2022] DELETE /identity/v3/users/c3898794cf57453381f3454f91c22788 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:14.115406 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc9b89-7d09-4489-b0b9-781a15dbe5b7 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:14.115890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc9b89-7d09-4489-b0b9-781a15dbe5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:14.115980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc9b89-7d09-4489-b0b9-781a15dbe5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:14.133618 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-95bc9b89-7d09-4489-b0b9-781a15dbe5b7 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:14.134845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-95bc9b89-7d09-4489-b0b9-781a15dbe5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:14.205891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1079/2155] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:14.217965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:14.219886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:14.292338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370469fe-5b69-4f97-8365-6eafe98d40fc admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:14.296300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea774bd-7c56-40c5-90f0-e2b9c184b51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:14.297161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea774bd-7c56-40c5-90f0-e2b9c184b51c service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:14.297521 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea774bd-7c56-40c5-90f0-e2b9c184b51c service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:14.297891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea774bd-7c56-40c5-90f0-e2b9c184b51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:14.309067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea774bd-7c56-40c5-90f0-e2b9c184b51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:14.310800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea774bd-7c56-40c5-90f0-e2b9c184b51c service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:14.321536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1077/2156] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:15.157184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc9b89-7d09-4489-b0b9-781a15dbe5b7 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:15.168087 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-95bc9b89-7d09-4489-b0b9-781a15dbe5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:15.210843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc9b89-7d09-4489-b0b9-781a15dbe5b7 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:15.219471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:15.220414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:15.220789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:15.221334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] PATH_INFO: `/v3/projects/bedaa56584794792a1a5d86b730e239a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:15.225001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bedaa56584794792a1a5d86b730e239a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:15.227650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:15.432827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bedaa56584794792a1a5d86b730e239a', 'request_id': 'req-890d5c02-133e-41a2-8f0a-815deb4aea95'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:15.519908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bedaa56584794792a1a5d86b730e239a', 'request_id': 'req-890d5c02-133e-41a2-8f0a-815deb4aea95'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:15.530594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bedaa56584794792a1a5d86b730e239a', 'request_id': 'req-890d5c02-133e-41a2-8f0a-815deb4aea95'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:15.553310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] The token cache is being invalidate because project bedaa56584794792a1a5d86b730e239a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:15:15.553831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:15.555104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:15.558884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1080/2157] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:15:15 2022] DELETE /identity/v3/projects/bedaa56584794792a1a5d86b730e239a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:15.563315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea774bd-7c56-40c5-90f0-e2b9c184b51c service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:15.577064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea774bd-7c56-40c5-90f0-e2b9c184b51c service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:15.656475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f747ca-87dc-4b63-8cc5-76674d1f217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:15.657564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f747ca-87dc-4b63-8cc5-76674d1f217b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:15.657849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f747ca-87dc-4b63-8cc5-76674d1f217b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:15.658121 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f747ca-87dc-4b63-8cc5-76674d1f217b admin admin] PATH_INFO: `/v3/users/02f4c2e804f541488ebe514584abc8c4` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:15.659517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f747ca-87dc-4b63-8cc5-76674d1f217b admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f4c2e804f541488ebe514584abc8c4)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:15.665968 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f747ca-87dc-4b63-8cc5-76674d1f217b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:15.880704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d7f747ca-87dc-4b63-8cc5-76674d1f217b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f4c2e804f541488ebe514584abc8c4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:15.881570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d7f747ca-87dc-4b63-8cc5-76674d1f217b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f4c2e804f541488ebe514584abc8c4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:16.036865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d7f747ca-87dc-4b63-8cc5-76674d1f217b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f4c2e804f541488ebe514584abc8c4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:16.086050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d7f747ca-87dc-4b63-8cc5-76674d1f217b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f4c2e804f541488ebe514584abc8c4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:16.104363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d7f747ca-87dc-4b63-8cc5-76674d1f217b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f4c2e804f541488ebe514584abc8c4'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:16.119531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1078/2158] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:15:15 2022] DELETE /identity/v3/users/02f4c2e804f541488ebe514584abc8c4 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:16.711488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:16.711488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:16.722750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5c02-133e-41a2-8f0a-815deb4aea95 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:16.776512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:16.800058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7f8d4-85dd-4d79-a191-c32f9895f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:16.801095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7f8d4-85dd-4d79-a191-c32f9895f466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:16.801383 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7f8d4-85dd-4d79-a191-c32f9895f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:16.801663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7f8d4-85dd-4d79-a191-c32f9895f466 admin admin] PATH_INFO: `/v3/projects/852f336063c64012821c6d4f0545e036` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:16.803820 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7f8d4-85dd-4d79-a191-c32f9895f466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852f336063c64012821c6d4f0545e036)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:16.806743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7f8d4-85dd-4d79-a191-c32f9895f466 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:16.928824 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-05b7f8d4-85dd-4d79-a191-c32f9895f466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852f336063c64012821c6d4f0545e036', 'request_id': 'req-05b7f8d4-85dd-4d79-a191-c32f9895f466'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:17.055252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-05b7f8d4-85dd-4d79-a191-c32f9895f466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852f336063c64012821c6d4f0545e036', 'request_id': 'req-05b7f8d4-85dd-4d79-a191-c32f9895f466'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:17.065919 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-05b7f8d4-85dd-4d79-a191-c32f9895f466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852f336063c64012821c6d4f0545e036', 'request_id': 'req-05b7f8d4-85dd-4d79-a191-c32f9895f466'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:17.084135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-05b7f8d4-85dd-4d79-a191-c32f9895f466 admin admin] The token cache is being invalidate because project 852f336063c64012821c6d4f0545e036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:15:17.084643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-05b7f8d4-85dd-4d79-a191-c32f9895f466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:17.085562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-05b7f8d4-85dd-4d79-a191-c32f9895f466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:17.091364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1081/2159] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:15:16 2022] DELETE /identity/v3/projects/852f336063c64012821c6d4f0545e036 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:17.096110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987e2bd-3200-4566-be25-480deca6a85b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:17.096632 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987e2bd-3200-4566-be25-480deca6a85b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:17.096862 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987e2bd-3200-4566-be25-480deca6a85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:17.123418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6987e2bd-3200-4566-be25-480deca6a85b None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:17.123418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6987e2bd-3200-4566-be25-480deca6a85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:17.135083 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:17.197942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1079/2160] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:17.209599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979bfbf-19c2-4b8e-ae72-fce8b30979c7 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:17.209599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979bfbf-19c2-4b8e-ae72-fce8b30979c7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:17.209599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979bfbf-19c2-4b8e-ae72-fce8b30979c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:17.235097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a979bfbf-19c2-4b8e-ae72-fce8b30979c7 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:17.237070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a979bfbf-19c2-4b8e-ae72-fce8b30979c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:17.249514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1082/2161] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:17.251623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987e2bd-3200-4566-be25-480deca6a85b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:17.282509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987e2bd-3200-4566-be25-480deca6a85b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:17.293997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cb85e-639d-479a-99e2-d456dc5836b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:17.296007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cb85e-639d-479a-99e2-d456dc5836b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:17.297031 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cb85e-639d-479a-99e2-d456dc5836b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:17.297910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cb85e-639d-479a-99e2-d456dc5836b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:17.299889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cb85e-639d-479a-99e2-d456dc5836b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:15:17.300774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cb85e-639d-479a-99e2-d456dc5836b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:17.304703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cb85e-639d-479a-99e2-d456dc5836b5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:17.337791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1080/2162] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:15:17.339592 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979bfbf-19c2-4b8e-ae72-fce8b30979c7 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:17.350464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979bfbf-19c2-4b8e-ae72-fce8b30979c7 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:17.355329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a841bff-8dc2-4fd3-9c1d-ae8a0507c4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:17.355992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a841bff-8dc2-4fd3-9c1d-ae8a0507c4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:17.356279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a841bff-8dc2-4fd3-9c1d-ae8a0507c4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:17.356563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a841bff-8dc2-4fd3-9c1d-ae8a0507c4e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:17.357305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a841bff-8dc2-4fd3-9c1d-ae8a0507c4e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:17.359600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a841bff-8dc2-4fd3-9c1d-ae8a0507c4e3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:17.469280 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cb85e-639d-479a-99e2-d456dc5836b5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:17.483406 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1083/2163] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:15:17 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:15:17.493077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cb85e-639d-479a-99e2-d456dc5836b5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:17.597724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4b273-aad4-45ee-bbb3-6b22f16bbed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:17.598980 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b273-aad4-45ee-bbb3-6b22f16bbed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:17.598980 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b273-aad4-45ee-bbb3-6b22f16bbed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:17.599381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b273-aad4-45ee-bbb3-6b22f16bbed4 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:17.600146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4b273-aad4-45ee-bbb3-6b22f16bbed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:17.602231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4b273-aad4-45ee-bbb3-6b22f16bbed4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:17.703029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1081/2164] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:15:17 2022] POST /identity/v3/users => generated 283 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:15:17.705817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a841bff-8dc2-4fd3-9c1d-ae8a0507c4e3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:17.721940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a841bff-8dc2-4fd3-9c1d-ae8a0507c4e3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:17.735616 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec196cdd-e1f0-429a-adeb-92e595e72e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:17.736348 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec196cdd-e1f0-429a-adeb-92e595e72e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:17.744004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec196cdd-e1f0-429a-adeb-92e595e72e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:17.744004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec196cdd-e1f0-429a-adeb-92e595e72e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:17.744004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec196cdd-e1f0-429a-adeb-92e595e72e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:17.744004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec196cdd-e1f0-429a-adeb-92e595e72e40 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:17.764490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1084/2165] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:15:17.770152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4b273-aad4-45ee-bbb3-6b22f16bbed4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:17.782096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4b273-aad4-45ee-bbb3-6b22f16bbed4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:17.789603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812025c-1e00-4986-9077-be0fbf4e00cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:17.790493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812025c-1e00-4986-9077-be0fbf4e00cd admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:17.790613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812025c-1e00-4986-9077-be0fbf4e00cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:17.795760 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812025c-1e00-4986-9077-be0fbf4e00cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:17.795760 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812025c-1e00-4986-9077-be0fbf4e00cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:17.795760 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812025c-1e00-4986-9077-be0fbf4e00cd admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:17.804791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1082/2166] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:15:17.809392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec196cdd-e1f0-429a-adeb-92e595e72e40 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:17.825416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec196cdd-e1f0-429a-adeb-92e595e72e40 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:17.830336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca4be7-94a5-4066-ac4f-dc9ddc4a6b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:17.831415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca4be7-94a5-4066-ac4f-dc9ddc4a6b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:17.832762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca4be7-94a5-4066-ac4f-dc9ddc4a6b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:17.833162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca4be7-94a5-4066-ac4f-dc9ddc4a6b4e admin admin] PATH_INFO: `/v3/projects/af91e3f4fce54620acab7037782e47f3/users/fc9f73e61efd42d4b65a7d6c9576c4f3/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:17.850158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca4be7-94a5-4066-ac4f-dc9ddc4a6b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af91e3f4fce54620acab7037782e47f3, user_id=fc9f73e61efd42d4b65a7d6c9576c4f3, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:17.852976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca4be7-94a5-4066-ac4f-dc9ddc4a6b4e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:17.993931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1085/2167] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:15:17 2022] PUT /identity/v3/projects/af91e3f4fce54620acab7037782e47f3/users/fc9f73e61efd42d4b65a7d6c9576c4f3/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:18.005708 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578fba-9c58-4c82-ae36-28e94e31a911 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:18.007297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578fba-9c58-4c82-ae36-28e94e31a911 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:18.007595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578fba-9c58-4c82-ae36-28e94e31a911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:18.046526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-53578fba-9c58-4c82-ae36-28e94e31a911 None None] MFA Rules not processed for user `fc9f73e61efd42d4b65a7d6c9576c4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:18.046526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-53578fba-9c58-4c82-ae36-28e94e31a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:18.122482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1083/2168] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:15:18.126920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca4be7-94a5-4066-ac4f-dc9ddc4a6b4e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:18.197850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca4be7-94a5-4066-ac4f-dc9ddc4a6b4e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:18.202578 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7806bb-aac5-4010-9e5f-644c768d8c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:18.203236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7806bb-aac5-4010-9e5f-644c768d8c25 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:18.203527 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7806bb-aac5-4010-9e5f-644c768d8c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:18.203809 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7806bb-aac5-4010-9e5f-644c768d8c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:18.204512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7806bb-aac5-4010-9e5f-644c768d8c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:18.206459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7806bb-aac5-4010-9e5f-644c768d8c25 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:18.313164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:18.323022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1086/2169] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:15:18 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:15:18.327364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53578fba-9c58-4c82-ae36-28e94e31a911 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:18.350641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53578fba-9c58-4c82-ae36-28e94e31a911 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:18.436373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ea035-9c85-4b61-b42e-3e7a77a98c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:18.437599 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ea035-9c85-4b61-b42e-3e7a77a98c37 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:18.438182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ea035-9c85-4b61-b42e-3e7a77a98c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:18.439552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:18.440028 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ea035-9c85-4b61-b42e-3e7a77a98c37 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:18.440937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ea035-9c85-4b61-b42e-3e7a77a98c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:18.443192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ea035-9c85-4b61-b42e-3e7a77a98c37 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:18.607430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1084/2170] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:15:18 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:15:18.608172 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7806bb-aac5-4010-9e5f-644c768d8c25 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:18.613153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7806bb-aac5-4010-9e5f-644c768d8c25 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:18.626320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4a1e3-e8d3-440f-bb05-e1317cc374f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:18.627101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4a1e3-e8d3-440f-bb05-e1317cc374f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:18.627456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4a1e3-e8d3-440f-bb05-e1317cc374f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:18.627807 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4a1e3-e8d3-440f-bb05-e1317cc374f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:18.628635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4a1e3-e8d3-440f-bb05-e1317cc374f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:18.630384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4a1e3-e8d3-440f-bb05-e1317cc374f6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:18.656714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1087/2171] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:15:18.669663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ea035-9c85-4b61-b42e-3e7a77a98c37 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:18.680742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ea035-9c85-4b61-b42e-3e7a77a98c37 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:18.685925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988109c6-ba98-4dcf-afe7-964062f383b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:18.686984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988109c6-ba98-4dcf-afe7-964062f383b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:18.687417 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988109c6-ba98-4dcf-afe7-964062f383b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:18.687840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988109c6-ba98-4dcf-afe7-964062f383b7 admin admin] PATH_INFO: `/v3/projects/c0c832eac28444c681b1505f1ab99cdc/users/adf4af46c805445a8bff14bc755a72b0/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:18.722964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988109c6-ba98-4dcf-afe7-964062f383b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c832eac28444c681b1505f1ab99cdc, user_id=adf4af46c805445a8bff14bc755a72b0, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:18.722964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988109c6-ba98-4dcf-afe7-964062f383b7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:18.846461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1085/2172] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:15:18 2022] PUT /identity/v3/projects/c0c832eac28444c681b1505f1ab99cdc/users/adf4af46c805445a8bff14bc755a72b0/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:15:18.851142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4a1e3-e8d3-440f-bb05-e1317cc374f6 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:18.861350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4a1e3-e8d3-440f-bb05-e1317cc374f6 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:18.935069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea5715-e36f-4d6f-b710-8e8d2e95bdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:18.936047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea5715-e36f-4d6f-b710-8e8d2e95bdbb admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:18.936575 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea5715-e36f-4d6f-b710-8e8d2e95bdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:18.937030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea5715-e36f-4d6f-b710-8e8d2e95bdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:18.937915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea5715-e36f-4d6f-b710-8e8d2e95bdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:18.939696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea5715-e36f-4d6f-b710-8e8d2e95bdbb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:18.956349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988109c6-ba98-4dcf-afe7-964062f383b7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:18.962079 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1088/2173] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:15:18.969206 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988109c6-ba98-4dcf-afe7-964062f383b7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:18.975374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656ccd5-a6b5-40d7-8f6d-953082bb2c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:18.976469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656ccd5-a6b5-40d7-8f6d-953082bb2c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:18.976791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656ccd5-a6b5-40d7-8f6d-953082bb2c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:18.977072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656ccd5-a6b5-40d7-8f6d-953082bb2c61 admin admin] PATH_INFO: `/v3/projects/c0c832eac28444c681b1505f1ab99cdc/users/adf4af46c805445a8bff14bc755a72b0/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:18.979322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656ccd5-a6b5-40d7-8f6d-953082bb2c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c832eac28444c681b1505f1ab99cdc, user_id=adf4af46c805445a8bff14bc755a72b0, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:18.982045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656ccd5-a6b5-40d7-8f6d-953082bb2c61 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:19.001767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1086/2174] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:15:18 2022] PUT /identity/v3/projects/c0c832eac28444c681b1505f1ab99cdc/users/adf4af46c805445a8bff14bc755a72b0/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:19.007716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaed838-6f4e-4ec9-a79d-c4c5e2301116 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:19.011269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaed838-6f4e-4ec9-a79d-c4c5e2301116 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:19.011731 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaed838-6f4e-4ec9-a79d-c4c5e2301116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:19.050988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-bfaed838-6f4e-4ec9-a79d-c4c5e2301116 None None] MFA Rules not processed for user `adf4af46c805445a8bff14bc755a72b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:19.052224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bfaed838-6f4e-4ec9-a79d-c4c5e2301116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:19.173512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1089/2175] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:19.187434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656ccd5-a6b5-40d7-8f6d-953082bb2c61 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:19.189436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6656ccd5-a6b5-40d7-8f6d-953082bb2c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:19.319292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656ccd5-a6b5-40d7-8f6d-953082bb2c61 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:19.326678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07873f3-ab32-4924-9af7-4aa6c47460b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:19.327844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07873f3-ab32-4924-9af7-4aa6c47460b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:19.328271 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07873f3-ab32-4924-9af7-4aa6c47460b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:19.328971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07873f3-ab32-4924-9af7-4aa6c47460b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:19.342766 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07873f3-ab32-4924-9af7-4aa6c47460b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:19.344496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07873f3-ab32-4924-9af7-4aa6c47460b6 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:19.364763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1087/2176] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:19.702440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569fa55-6caf-4dd0-ac90-d72a47290152 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:19.703033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569fa55-6caf-4dd0-ac90-d72a47290152 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:19.703916 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569fa55-6caf-4dd0-ac90-d72a47290152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:19.719524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07873f3-ab32-4924-9af7-4aa6c47460b6 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:19.733180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07873f3-ab32-4924-9af7-4aa6c47460b6 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:19.738726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d569fa55-6caf-4dd0-ac90-d72a47290152 None None] MFA Rules not processed for user `e6beb6af188b412eb9ee3c38f4c6b94d`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:19.740518 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d569fa55-6caf-4dd0-ac90-d72a47290152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:19.750689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a304a0-c0b1-4e8c-9bf0-a52e95a39954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:19.750689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a304a0-c0b1-4e8c-9bf0-a52e95a39954 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:19.750689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a304a0-c0b1-4e8c-9bf0-a52e95a39954 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:19.750689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a304a0-c0b1-4e8c-9bf0-a52e95a39954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:19.812738 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1090/2177] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:19.816906 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569fa55-6caf-4dd0-ac90-d72a47290152 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:19.821151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d569fa55-6caf-4dd0-ac90-d72a47290152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:19.825902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a304a0-c0b1-4e8c-9bf0-a52e95a39954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:19.827449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a304a0-c0b1-4e8c-9bf0-a52e95a39954 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:19.847791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1088/2178] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:15:19.904270 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569fa55-6caf-4dd0-ac90-d72a47290152 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:19.910165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8b6b8-ea9f-4111-ba92-fa6c0e72c3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:19.910839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8b6b8-ea9f-4111-ba92-fa6c0e72c3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:19.912135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8b6b8-ea9f-4111-ba92-fa6c0e72c3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:19.912639 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8b6b8-ea9f-4111-ba92-fa6c0e72c3e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:19.913727 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8b6b8-ea9f-4111-ba92-fa6c0e72c3e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:19.916061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8b6b8-ea9f-4111-ba92-fa6c0e72c3e0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:20.018663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1091/2179] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:15:19 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:15:20.022491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a304a0-c0b1-4e8c-9bf0-a52e95a39954 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:20.033192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a304a0-c0b1-4e8c-9bf0-a52e95a39954 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:20.103856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eb85d-ca6c-4a1c-8e72-740547487b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:20.108731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:20.108731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eb85d-ca6c-4a1c-8e72-740547487b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:20.108731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eb85d-ca6c-4a1c-8e72-740547487b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:20.108731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eb85d-ca6c-4a1c-8e72-740547487b41 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:20.108731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8eb85d-ca6c-4a1c-8e72-740547487b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:20.109266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8eb85d-ca6c-4a1c-8e72-740547487b41 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:20.196209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1089/2180] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:15:20 2022] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:15:20.200519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8b6b8-ea9f-4111-ba92-fa6c0e72c3e0 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:20.211404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8b6b8-ea9f-4111-ba92-fa6c0e72c3e0 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:20.216048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4606a-568a-4a87-adde-2b5f6b69284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:20.216735 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4606a-568a-4a87-adde-2b5f6b69284a admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:20.217028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4606a-568a-4a87-adde-2b5f6b69284a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:20.217427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4606a-568a-4a87-adde-2b5f6b69284a admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:20.218161 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4606a-568a-4a87-adde-2b5f6b69284a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:20.219757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4606a-568a-4a87-adde-2b5f6b69284a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:20.231147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1092/2181] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:15:20.237437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eb85d-ca6c-4a1c-8e72-740547487b41 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:20.247738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eb85d-ca6c-4a1c-8e72-740547487b41 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:20.252326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e79d42-5d60-49c4-a8d9-a3fc587f9f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:20.253269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e79d42-5d60-49c4-a8d9-a3fc587f9f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:20.253557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e79d42-5d60-49c4-a8d9-a3fc587f9f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:20.254150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e79d42-5d60-49c4-a8d9-a3fc587f9f46 admin admin] PATH_INFO: `/v3/projects/45d85c3d91014a48b4caac9c5c6349e4/users/f9600e93ccee48538ce4432e8d6a05a2/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:20.271784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e79d42-5d60-49c4-a8d9-a3fc587f9f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d85c3d91014a48b4caac9c5c6349e4, user_id=f9600e93ccee48538ce4432e8d6a05a2, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:20.274671 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e79d42-5d60-49c4-a8d9-a3fc587f9f46 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:20.344604 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:20.373085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1090/2182] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:15:20 2022] PUT /identity/v3/projects/45d85c3d91014a48b4caac9c5c6349e4/users/f9600e93ccee48538ce4432e8d6a05a2/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:20.377230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4606a-568a-4a87-adde-2b5f6b69284a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:20.387351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4606a-568a-4a87-adde-2b5f6b69284a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:20.455179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95457d6-1433-4fa0-ace1-1a5cee231b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:20.455867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95457d6-1433-4fa0-ace1-1a5cee231b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:20.456155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95457d6-1433-4fa0-ace1-1a5cee231b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:20.456506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95457d6-1433-4fa0-ace1-1a5cee231b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:20.457221 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95457d6-1433-4fa0-ace1-1a5cee231b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:20.459400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95457d6-1433-4fa0-ace1-1a5cee231b50 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:20.470450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1093/2183] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:15:20.475373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e79d42-5d60-49c4-a8d9-a3fc587f9f46 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:20.489308 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e79d42-5d60-49c4-a8d9-a3fc587f9f46 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:20.491452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f43ba8-d69f-4143-a44d-53d9f103d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:20.492615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f43ba8-d69f-4143-a44d-53d9f103d589 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:20.493069 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f43ba8-d69f-4143-a44d-53d9f103d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:20.493448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f43ba8-d69f-4143-a44d-53d9f103d589 admin admin] PATH_INFO: `/v3/projects/45d85c3d91014a48b4caac9c5c6349e4/users/f9600e93ccee48538ce4432e8d6a05a2/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:20.496211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f43ba8-d69f-4143-a44d-53d9f103d589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d85c3d91014a48b4caac9c5c6349e4, user_id=f9600e93ccee48538ce4432e8d6a05a2, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:20.498993 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f43ba8-d69f-4143-a44d-53d9f103d589 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:20.518580 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1091/2184] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:15:20 2022] PUT /identity/v3/projects/45d85c3d91014a48b4caac9c5c6349e4/users/f9600e93ccee48538ce4432e8d6a05a2/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:22.095858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9d87-41ab-4d5f-ad5d-74dacb6f5afc None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:22.132942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9d87-41ab-4d5f-ad5d-74dacb6f5afc None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:22.132942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9d87-41ab-4d5f-ad5d-74dacb6f5afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:22.132942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6a8e9d87-41ab-4d5f-ad5d-74dacb6f5afc None None] MFA Rules not processed for user `2694401e38424109bce306728953c986`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:22.132942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6a8e9d87-41ab-4d5f-ad5d-74dacb6f5afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:22.191442 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:22.218817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1094/2185] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:27.123707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d7d41-13f7-4ac2-872d-c985ac417623 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:27.124352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d7d41-13f7-4ac2-872d-c985ac417623 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:27.124494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d7d41-13f7-4ac2-872d-c985ac417623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:27.146090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-767d7d41-13f7-4ac2-872d-c985ac417623 None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:27.147427 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-767d7d41-13f7-4ac2-872d-c985ac417623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:27.315339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1092/2186] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:15:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:27.387908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9d87-41ab-4d5f-ad5d-74dacb6f5afc None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:27.390221 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6a8e9d87-41ab-4d5f-ad5d-74dacb6f5afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:27.582975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9d87-41ab-4d5f-ad5d-74dacb6f5afc None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:27.591641 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35580aa-587f-42b7-b4d9-85d1d2edd3d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:27.592364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35580aa-587f-42b7-b4d9-85d1d2edd3d3 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:27.603738 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35580aa-587f-42b7-b4d9-85d1d2edd3d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:27.604035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35580aa-587f-42b7-b4d9-85d1d2edd3d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:27.614160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35580aa-587f-42b7-b4d9-85d1d2edd3d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:27.616270 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35580aa-587f-42b7-b4d9-85d1d2edd3d3 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:27.625847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1095/2187] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:15:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:15:27.658868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa458a-1a3a-46cc-9d55-6782380d78d7 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:27.659166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa458a-1a3a-46cc-9d55-6782380d78d7 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:27.659453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa458a-1a3a-46cc-9d55-6782380d78d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:27.690315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-78fa458a-1a3a-46cc-9d55-6782380d78d7 None None] MFA Rules not processed for user `f9600e93ccee48538ce4432e8d6a05a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:27.691614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-78fa458a-1a3a-46cc-9d55-6782380d78d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:27.853361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:27.946630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1093/2188] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:31.467499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35580aa-587f-42b7-b4d9-85d1d2edd3d3 service swift] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:31.470731 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f35580aa-587f-42b7-b4d9-85d1d2edd3d3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:31.542435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35580aa-587f-42b7-b4d9-85d1d2edd3d3 service swift] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:31.546553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b05d98-0bbe-496e-b2ce-b1d6310e9320 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '711d53a7deb94849b577c08dc9165ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:31.547463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b05d98-0bbe-496e-b2ce-b1d6310e9320 service glance] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:31.547820 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b05d98-0bbe-496e-b2ce-b1d6310e9320 service glance] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:31.548334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b05d98-0bbe-496e-b2ce-b1d6310e9320 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:31.621336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b05d98-0bbe-496e-b2ce-b1d6310e9320 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:31.622773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b05d98-0bbe-496e-b2ce-b1d6310e9320 service glance] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:31.632606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1096/2189] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:31.939207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca43a81-32a3-40f4-aea8-a9aa002ccd3c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:31.939207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca43a81-32a3-40f4-aea8-a9aa002ccd3c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:31.939207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca43a81-32a3-40f4-aea8-a9aa002ccd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:31.959612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6ca43a81-32a3-40f4-aea8-a9aa002ccd3c None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:31.960582 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6ca43a81-32a3-40f4-aea8-a9aa002ccd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:31.970221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1094/2190] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:15:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:31.985902 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b05d98-0bbe-496e-b2ce-b1d6310e9320 service glance] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:31.999811 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b05d98-0bbe-496e-b2ce-b1d6310e9320 service glance] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:32.011296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d047923-0ee9-4bb9-a80f-d3abd13a8f32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:32.012334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d047923-0ee9-4bb9-a80f-d3abd13a8f32 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:32.012743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d047923-0ee9-4bb9-a80f-d3abd13a8f32 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:32.013244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d047923-0ee9-4bb9-a80f-d3abd13a8f32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:32.023360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d047923-0ee9-4bb9-a80f-d3abd13a8f32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:32.025918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d047923-0ee9-4bb9-a80f-d3abd13a8f32 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:32.037697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1097/2191] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:15:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:15:39.758308 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca43a81-32a3-40f4-aea8-a9aa002ccd3c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:40.010018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca43a81-32a3-40f4-aea8-a9aa002ccd3c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:40.020001 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:40.038038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:40.038038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:40.038038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] PATH_INFO: `/v3/users/fc9f73e61efd42d4b65a7d6c9576c4f3` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:40.038038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9f73e61efd42d4b65a7d6c9576c4f3)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:40.038038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:40.827972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9f73e61efd42d4b65a7d6c9576c4f3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:40.829271 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9f73e61efd42d4b65a7d6c9576c4f3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:40.935978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9f73e61efd42d4b65a7d6c9576c4f3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:40.964221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9f73e61efd42d4b65a7d6c9576c4f3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:40.977004 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9f73e61efd42d4b65a7d6c9576c4f3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:40.993405 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1095/2192] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:15:39 2022] DELETE /identity/v3/users/fc9f73e61efd42d4b65a7d6c9576c4f3 => generated 0 bytes in 1239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:41.001752 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9d9c4-d055-4ee1-bd86-a6ff997cbf85 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:41.003311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9d9c4-d055-4ee1-bd86-a6ff997cbf85 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:41.003820 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9d9c4-d055-4ee1-bd86-a6ff997cbf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:41.054259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:41.096957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-bdb9d9c4-d055-4ee1-bd86-a6ff997cbf85 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:41.098690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bdb9d9c4-d055-4ee1-bd86-a6ff997cbf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:41.221695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1098/2193] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:41.232596 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:41.246363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:41.279346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:41.353220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b5516-af7b-4b1c-aaef-9fe8035bb8f1 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:41.358692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aac7b2-f6e4-4710-8c97-b1819ccd6b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:41.360001 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aac7b2-f6e4-4710-8c97-b1819ccd6b6a service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:41.360504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aac7b2-f6e4-4710-8c97-b1819ccd6b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:41.361738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aac7b2-f6e4-4710-8c97-b1819ccd6b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:41.374607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aac7b2-f6e4-4710-8c97-b1819ccd6b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:41.415923 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aac7b2-f6e4-4710-8c97-b1819ccd6b6a service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:41.435112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1096/2194] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:42.364046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9d9c4-d055-4ee1-bd86-a6ff997cbf85 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:42.366830 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bdb9d9c4-d055-4ee1-bd86-a6ff997cbf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:42.383053 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9d9c4-d055-4ee1-bd86-a6ff997cbf85 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:42.396926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:42.397967 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:42.400634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:42.401619 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] PATH_INFO: `/v3/projects/af91e3f4fce54620acab7037782e47f3` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:42.412320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] RBAC: Authorizing `identity:delete_project(project_id=af91e3f4fce54620acab7037782e47f3)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:42.413226 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:42.566366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af91e3f4fce54620acab7037782e47f3', 'request_id': 'req-9c57f004-bd99-4325-b679-d4cfa8a8aace'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:42.693346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af91e3f4fce54620acab7037782e47f3', 'request_id': 'req-9c57f004-bd99-4325-b679-d4cfa8a8aace'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:42.706704 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af91e3f4fce54620acab7037782e47f3', 'request_id': 'req-9c57f004-bd99-4325-b679-d4cfa8a8aace'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:42.737761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] The token cache is being invalidate because project af91e3f4fce54620acab7037782e47f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:15:42.738259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:42.741124 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:42.743467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1099/2195] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:15:42 2022] DELETE /identity/v3/projects/af91e3f4fce54620acab7037782e47f3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:42.748032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aac7b2-f6e4-4710-8c97-b1819ccd6b6a service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:42.759743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aac7b2-f6e4-4710-8c97-b1819ccd6b6a service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:42.933949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10469371-f608-4960-8ee3-ae0ca956b75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:42.939107 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10469371-f608-4960-8ee3-ae0ca956b75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:42.940212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10469371-f608-4960-8ee3-ae0ca956b75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:42.941955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10469371-f608-4960-8ee3-ae0ca956b75d admin admin] PATH_INFO: `/v3/users/adf4af46c805445a8bff14bc755a72b0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:42.944195 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10469371-f608-4960-8ee3-ae0ca956b75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf4af46c805445a8bff14bc755a72b0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:42.949693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10469371-f608-4960-8ee3-ae0ca956b75d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:43.227900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-10469371-f608-4960-8ee3-ae0ca956b75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf4af46c805445a8bff14bc755a72b0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:43.228494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-10469371-f608-4960-8ee3-ae0ca956b75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf4af46c805445a8bff14bc755a72b0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:43.327717 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-10469371-f608-4960-8ee3-ae0ca956b75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf4af46c805445a8bff14bc755a72b0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:43.356368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-10469371-f608-4960-8ee3-ae0ca956b75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf4af46c805445a8bff14bc755a72b0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:43.370206 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-10469371-f608-4960-8ee3-ae0ca956b75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf4af46c805445a8bff14bc755a72b0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:43.386673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1097/2196] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:15:42 2022] DELETE /identity/v3/users/adf4af46c805445a8bff14bc755a72b0 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:44.027662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:44.029081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:44.068350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57f004-bd99-4325-b679-d4cfa8a8aace admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:44.401814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723d0c5-b881-4ce7-9990-386833eade83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:44.402651 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723d0c5-b881-4ce7-9990-386833eade83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:44.402934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723d0c5-b881-4ce7-9990-386833eade83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:44.403234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723d0c5-b881-4ce7-9990-386833eade83 admin admin] PATH_INFO: `/v3/projects/c0c832eac28444c681b1505f1ab99cdc` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:44.404853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723d0c5-b881-4ce7-9990-386833eade83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c832eac28444c681b1505f1ab99cdc)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:44.407796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723d0c5-b881-4ce7-9990-386833eade83 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:44.533046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:44.705366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e723d0c5-b881-4ce7-9990-386833eade83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c832eac28444c681b1505f1ab99cdc', 'request_id': 'req-e723d0c5-b881-4ce7-9990-386833eade83'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:44.787927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e723d0c5-b881-4ce7-9990-386833eade83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c832eac28444c681b1505f1ab99cdc', 'request_id': 'req-e723d0c5-b881-4ce7-9990-386833eade83'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:44.795109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e723d0c5-b881-4ce7-9990-386833eade83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c832eac28444c681b1505f1ab99cdc', 'request_id': 'req-e723d0c5-b881-4ce7-9990-386833eade83'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:44.816235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e723d0c5-b881-4ce7-9990-386833eade83 admin admin] The token cache is being invalidate because project c0c832eac28444c681b1505f1ab99cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:15:44.816595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e723d0c5-b881-4ce7-9990-386833eade83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:44.823890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e723d0c5-b881-4ce7-9990-386833eade83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:44.825848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1100/2197] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:15:44 2022] DELETE /identity/v3/projects/c0c832eac28444c681b1505f1ab99cdc => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:44.830761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5d1fb-8385-4f53-8290-48994ed74ac8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:44.831751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5d1fb-8385-4f53-8290-48994ed74ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:44.832247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5d1fb-8385-4f53-8290-48994ed74ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:44.934003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:44.953984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2cf5d1fb-8385-4f53-8290-48994ed74ac8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:44.955651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2cf5d1fb-8385-4f53-8290-48994ed74ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:45.085379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1098/2198] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:15:45.086636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e3d40-d54c-4c9a-b109-f2080b405dcb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:45.087122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e3d40-d54c-4c9a-b109-f2080b405dcb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:45.087210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e3d40-d54c-4c9a-b109-f2080b405dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:45.168508 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-231e3d40-d54c-4c9a-b109-f2080b405dcb None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:45.174203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-231e3d40-d54c-4c9a-b109-f2080b405dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:45.209425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1101/2199] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:15:45.213610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5d1fb-8385-4f53-8290-48994ed74ac8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:45.224645 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5d1fb-8385-4f53-8290-48994ed74ac8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:45.239932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f61cae-5233-4476-911a-5ed7801319f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:45.241029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f61cae-5233-4476-911a-5ed7801319f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:45.241533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f61cae-5233-4476-911a-5ed7801319f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:45.241882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f61cae-5233-4476-911a-5ed7801319f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:45.242977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f61cae-5233-4476-911a-5ed7801319f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:15:45.243442 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f61cae-5233-4476-911a-5ed7801319f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:45.245225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f61cae-5233-4476-911a-5ed7801319f8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:45.262015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1099/2200] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:15:45.266814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e3d40-d54c-4c9a-b109-f2080b405dcb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:45.288457 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e3d40-d54c-4c9a-b109-f2080b405dcb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:45.299700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ece83-3567-43fd-8501-7702ce52f213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:45.300554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ece83-3567-43fd-8501-7702ce52f213 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:45.300932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ece83-3567-43fd-8501-7702ce52f213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:45.301186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ece83-3567-43fd-8501-7702ce52f213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:45.301922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ece83-3567-43fd-8501-7702ce52f213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:45.304078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ece83-3567-43fd-8501-7702ce52f213 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:45.908183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1102/2201] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:15:45 2022] POST /identity/v3/projects => generated 367 bytes in 642 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:15:45.915795 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f61cae-5233-4476-911a-5ed7801319f8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:45.939932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f61cae-5233-4476-911a-5ed7801319f8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:45.996944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d09a9c-a894-49d0-af0a-79c4e205bdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:45.997615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d09a9c-a894-49d0-af0a-79c4e205bdb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:45.997894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d09a9c-a894-49d0-af0a-79c4e205bdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:45.998170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d09a9c-a894-49d0-af0a-79c4e205bdb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:45.998845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d09a9c-a894-49d0-af0a-79c4e205bdb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:46.000768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d09a9c-a894-49d0-af0a-79c4e205bdb0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:46.098007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1100/2202] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:15:45 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:15:46.101697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ece83-3567-43fd-8501-7702ce52f213 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:46.113408 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ece83-3567-43fd-8501-7702ce52f213 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:46.120609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1225b-f05f-44e1-805c-2d7b8aacdf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:46.121419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1225b-f05f-44e1-805c-2d7b8aacdf5c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:46.121714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1225b-f05f-44e1-805c-2d7b8aacdf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:46.122651 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1225b-f05f-44e1-805c-2d7b8aacdf5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:46.123355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1225b-f05f-44e1-805c-2d7b8aacdf5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:46.125038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1225b-f05f-44e1-805c-2d7b8aacdf5c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:46.145586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1103/2203] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:15:46.147086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d09a9c-a894-49d0-af0a-79c4e205bdb0 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:46.162078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d09a9c-a894-49d0-af0a-79c4e205bdb0 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:46.170455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fec578-b1e2-41a7-b90f-f1f6a7c41e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:46.171512 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fec578-b1e2-41a7-b90f-f1f6a7c41e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:46.172026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fec578-b1e2-41a7-b90f-f1f6a7c41e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:46.172537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fec578-b1e2-41a7-b90f-f1f6a7c41e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:46.173527 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fec578-b1e2-41a7-b90f-f1f6a7c41e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:46.176741 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fec578-b1e2-41a7-b90f-f1f6a7c41e94 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:46.214646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1101/2204] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:15:46.216305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1225b-f05f-44e1-805c-2d7b8aacdf5c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:46.235350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1225b-f05f-44e1-805c-2d7b8aacdf5c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:46.248066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc68f5-0cdf-4eeb-9815-5a4e9a945029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:46.249656 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc68f5-0cdf-4eeb-9815-5a4e9a945029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:46.250188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc68f5-0cdf-4eeb-9815-5a4e9a945029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:46.250841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc68f5-0cdf-4eeb-9815-5a4e9a945029 admin admin] PATH_INFO: `/v3/projects/8e87f0001e9a4178a4e4b47c6a1dc74c/users/ffb873ec562147b6ab057926ed9a1bc0/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:46.288016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc68f5-0cdf-4eeb-9815-5a4e9a945029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e87f0001e9a4178a4e4b47c6a1dc74c, user_id=ffb873ec562147b6ab057926ed9a1bc0, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:46.300778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc68f5-0cdf-4eeb-9815-5a4e9a945029 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:46.383413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1104/2205] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:15:46 2022] PUT /identity/v3/projects/8e87f0001e9a4178a4e4b47c6a1dc74c/users/ffb873ec562147b6ab057926ed9a1bc0/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:46.394369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ff884-8096-479a-a78a-3a758c325311 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:46.394666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ff884-8096-479a-a78a-3a758c325311 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:46.395068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ff884-8096-479a-a78a-3a758c325311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:46.439151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1b3ff884-8096-479a-a78a-3a758c325311 None None] MFA Rules not processed for user `ffb873ec562147b6ab057926ed9a1bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:46.441142 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1b3ff884-8096-479a-a78a-3a758c325311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:46.524627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:46.529285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1102/2206] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:46.541456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc68f5-0cdf-4eeb-9815-5a4e9a945029 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:46.629790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc68f5-0cdf-4eeb-9815-5a4e9a945029 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:46.635322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4612448-6169-46fb-99fe-0eaea99815f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:46.636259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4612448-6169-46fb-99fe-0eaea99815f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:46.636542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4612448-6169-46fb-99fe-0eaea99815f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:46.636850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4612448-6169-46fb-99fe-0eaea99815f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:46.637548 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4612448-6169-46fb-99fe-0eaea99815f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:46.639433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4612448-6169-46fb-99fe-0eaea99815f5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:46.902750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1105/2207] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:15:46 2022] POST /identity/v3/projects => generated 365 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:15:46.904229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ff884-8096-479a-a78a-3a758c325311 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:46.916888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ff884-8096-479a-a78a-3a758c325311 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:46.995734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bcfaf-83da-45db-9cf8-4ae57c8e6791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:46.996491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bcfaf-83da-45db-9cf8-4ae57c8e6791 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:46.996816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bcfaf-83da-45db-9cf8-4ae57c8e6791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:46.997095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bcfaf-83da-45db-9cf8-4ae57c8e6791 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:46.997845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bcfaf-83da-45db-9cf8-4ae57c8e6791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:47.000102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bcfaf-83da-45db-9cf8-4ae57c8e6791 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:47.121548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1103/2208] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:15:46 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:15:47.122206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4612448-6169-46fb-99fe-0eaea99815f5 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:47.135432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4612448-6169-46fb-99fe-0eaea99815f5 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:47.140584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da7fd0-7f46-40e8-8700-703c747c6b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:47.141415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da7fd0-7f46-40e8-8700-703c747c6b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:47.141819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da7fd0-7f46-40e8-8700-703c747c6b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:47.142469 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da7fd0-7f46-40e8-8700-703c747c6b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:47.143317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da7fd0-7f46-40e8-8700-703c747c6b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:47.145150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da7fd0-7f46-40e8-8700-703c747c6b2d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:47.165084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1106/2209] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:15:47.166591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bcfaf-83da-45db-9cf8-4ae57c8e6791 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:47.187804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bcfaf-83da-45db-9cf8-4ae57c8e6791 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:47.206256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55fc81-a682-4bfc-bd30-dca908fee6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:47.206256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55fc81-a682-4bfc-bd30-dca908fee6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:47.206256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55fc81-a682-4bfc-bd30-dca908fee6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:47.216519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55fc81-a682-4bfc-bd30-dca908fee6ca admin admin] PATH_INFO: `/v3/projects/d1390bd62d9a497fa926ecb3f4a63ed8/users/cbf9e5ec4d0649dabf32067da60be52f/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:47.241461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55fc81-a682-4bfc-bd30-dca908fee6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1390bd62d9a497fa926ecb3f4a63ed8, user_id=cbf9e5ec4d0649dabf32067da60be52f, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:47.244136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55fc81-a682-4bfc-bd30-dca908fee6ca admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:47.337121 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1104/2210] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:15:47 2022] PUT /identity/v3/projects/d1390bd62d9a497fa926ecb3f4a63ed8/users/cbf9e5ec4d0649dabf32067da60be52f/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:47.340718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da7fd0-7f46-40e8-8700-703c747c6b2d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:47.351107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da7fd0-7f46-40e8-8700-703c747c6b2d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:47.363953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:47.394424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437c0bf-fcb3-4808-941e-8ba57bff49b6 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:47.394815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437c0bf-fcb3-4808-941e-8ba57bff49b6 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:47.395243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437c0bf-fcb3-4808-941e-8ba57bff49b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:47.418852 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1437c0bf-fcb3-4808-941e-8ba57bff49b6 None None] MFA Rules not processed for user `e6beb6af188b412eb9ee3c38f4c6b94d`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:47.420306 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1437c0bf-fcb3-4808-941e-8ba57bff49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:47.428632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4a59b-133b-40c0-9c16-bdf137935c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:47.429464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4a59b-133b-40c0-9c16-bdf137935c5e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:47.429851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4a59b-133b-40c0-9c16-bdf137935c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:47.430230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4a59b-133b-40c0-9c16-bdf137935c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:47.431074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4a59b-133b-40c0-9c16-bdf137935c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:47.432925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4a59b-133b-40c0-9c16-bdf137935c5e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:47.444929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1107/2211] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:15:47.449207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4a59b-133b-40c0-9c16-bdf137935c5e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:47.462329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4a59b-133b-40c0-9c16-bdf137935c5e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:47.468399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b85f1d-dace-419a-a1b8-58e8980cdec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:47.469914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85f1d-dace-419a-a1b8-58e8980cdec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:47.470388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85f1d-dace-419a-a1b8-58e8980cdec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:47.471093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85f1d-dace-419a-a1b8-58e8980cdec8 admin admin] PATH_INFO: `/v3/projects/d1390bd62d9a497fa926ecb3f4a63ed8/users/cbf9e5ec4d0649dabf32067da60be52f/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:47.477886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b85f1d-dace-419a-a1b8-58e8980cdec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1390bd62d9a497fa926ecb3f4a63ed8, user_id=cbf9e5ec4d0649dabf32067da60be52f, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:47.482900 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b85f1d-dace-419a-a1b8-58e8980cdec8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:47.503565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1108/2212] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:15:47 2022] PUT /identity/v3/projects/d1390bd62d9a497fa926ecb3f4a63ed8/users/cbf9e5ec4d0649dabf32067da60be52f/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:15:47.505567 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1105/2213] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:15:47.520405 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62013d-16a7-4fe2-90f8-5a840ba5e652 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:47.520750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62013d-16a7-4fe2-90f8-5a840ba5e652 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:47.521039 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62013d-16a7-4fe2-90f8-5a840ba5e652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:47.549491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ac62013d-16a7-4fe2-90f8-5a840ba5e652 None None] MFA Rules not processed for user `cbf9e5ec4d0649dabf32067da60be52f`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:47.551019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ac62013d-16a7-4fe2-90f8-5a840ba5e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:47.659234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1109/2214] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:47.672811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437c0bf-fcb3-4808-941e-8ba57bff49b6 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:47.674443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1437c0bf-fcb3-4808-941e-8ba57bff49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:47.737713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437c0bf-fcb3-4808-941e-8ba57bff49b6 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:47.763974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:47.790247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3979b-c96e-4ff8-b06c-05f9fc2e2003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:47.791330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3979b-c96e-4ff8-b06c-05f9fc2e2003 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:47.792726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3979b-c96e-4ff8-b06c-05f9fc2e2003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:47.793118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3979b-c96e-4ff8-b06c-05f9fc2e2003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:47.810414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3979b-c96e-4ff8-b06c-05f9fc2e2003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:47.812014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3979b-c96e-4ff8-b06c-05f9fc2e2003 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:47.825395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1106/2215] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:48.084924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62013d-16a7-4fe2-90f8-5a840ba5e652 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:48.111521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62013d-16a7-4fe2-90f8-5a840ba5e652 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:48.117994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e592914-d68a-467c-97bd-e54494e6daf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:48.119057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e592914-d68a-467c-97bd-e54494e6daf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:48.119554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e592914-d68a-467c-97bd-e54494e6daf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:48.120201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e592914-d68a-467c-97bd-e54494e6daf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:48.207773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e592914-d68a-467c-97bd-e54494e6daf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:48.210382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e592914-d68a-467c-97bd-e54494e6daf2 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:48.223353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1110/2216] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:52.176125 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4fa9-f2b7-444d-84a3-e966a2e1687d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:52.176693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4fa9-f2b7-444d-84a3-e966a2e1687d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:52.176854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4fa9-f2b7-444d-84a3-e966a2e1687d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:52.204549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-103c4fa9-f2b7-444d-84a3-e966a2e1687d None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:52.205929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-103c4fa9-f2b7-444d-84a3-e966a2e1687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:52.268366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1107/2217] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:15:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:52.280759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e592914-d68a-467c-97bd-e54494e6daf2 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:52.282245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2e592914-d68a-467c-97bd-e54494e6daf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:52.311164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:52.358065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e592914-d68a-467c-97bd-e54494e6daf2 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:52.358753 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77a1fb-a1ce-4ec6-8919-98ea77256da9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:52.359410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77a1fb-a1ce-4ec6-8919-98ea77256da9 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:52.359693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77a1fb-a1ce-4ec6-8919-98ea77256da9 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:52.359970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77a1fb-a1ce-4ec6-8919-98ea77256da9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:52.369789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77a1fb-a1ce-4ec6-8919-98ea77256da9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:52.371565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77a1fb-a1ce-4ec6-8919-98ea77256da9 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:52.380351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1111/2218] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:15:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:15:53.516114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d61058-7c15-4bda-9623-19973fbc4337 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:53.516642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d61058-7c15-4bda-9623-19973fbc4337 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:53.516761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d61058-7c15-4bda-9623-19973fbc4337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:53.535909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-25d61058-7c15-4bda-9623-19973fbc4337 None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:53.537711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-25d61058-7c15-4bda-9623-19973fbc4337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:53.549571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1108/2219] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jun 23 13:15:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:53.571955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77a1fb-a1ce-4ec6-8919-98ea77256da9 service swift] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:53.584163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77a1fb-a1ce-4ec6-8919-98ea77256da9 service swift] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:53.590650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c9690-04e3-4480-919f-d3cb1ce25516 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:53.593034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c9690-04e3-4480-919f-d3cb1ce25516 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:53.593034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c9690-04e3-4480-919f-d3cb1ce25516 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:53.593034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c9690-04e3-4480-919f-d3cb1ce25516 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:53.602151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c9690-04e3-4480-919f-d3cb1ce25516 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:53.603777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c9690-04e3-4480-919f-d3cb1ce25516 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:53.613167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1112/2220] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:15:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:15:56.645744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d61058-7c15-4bda-9623-19973fbc4337 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:56.746205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d61058-7c15-4bda-9623-19973fbc4337 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:56.752221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:56.753331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:56.753738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:56.754095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] PATH_INFO: `/v3/users/ffb873ec562147b6ab057926ed9a1bc0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:56.756534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb873ec562147b6ab057926ed9a1bc0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:56.759659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:57.045583 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb873ec562147b6ab057926ed9a1bc0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:57.046397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb873ec562147b6ab057926ed9a1bc0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:57.113400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb873ec562147b6ab057926ed9a1bc0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:57.114916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:57.127651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb873ec562147b6ab057926ed9a1bc0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:57.134613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb873ec562147b6ab057926ed9a1bc0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:57.140474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1109/2221] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:15:56 2022] DELETE /identity/v3/users/ffb873ec562147b6ab057926ed9a1bc0 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:57.145300 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e550c3-af77-4704-b118-f63a0e341bbb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:57.146438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e550c3-af77-4704-b118-f63a0e341bbb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:57.146609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e550c3-af77-4704-b118-f63a0e341bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:57.164123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f2e550c3-af77-4704-b118-f63a0e341bbb None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:57.165170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f2e550c3-af77-4704-b118-f63a0e341bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:57.238195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1113/2222] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:57.257883 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:57.257883 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:57.322200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5335f31-8fe2-445a-98f7-c4c13c643dca None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:57.322573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5335f31-8fe2-445a-98f7-c4c13c643dca None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:57.323558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5335f31-8fe2-445a-98f7-c4c13c643dca None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:57.325257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1114/2223] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 23 13:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:15:57.330414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4907b8-bb0a-4f21-ad96-9973322e51e1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:57.330819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4907b8-bb0a-4f21-ad96-9973322e51e1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:57.331238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4907b8-bb0a-4f21-ad96-9973322e51e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:57.358112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c99f7-9fde-4eb0-b493-c54e628e62c5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:57.375799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6217ef-40a2-40be-a14c-c2c4259d6192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:57.381234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6217ef-40a2-40be-a14c-c2c4259d6192 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:57.381234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6217ef-40a2-40be-a14c-c2c4259d6192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:57.381234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6217ef-40a2-40be-a14c-c2c4259d6192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:57.394626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6217ef-40a2-40be-a14c-c2c4259d6192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:57.397160 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6217ef-40a2-40be-a14c-c2c4259d6192 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:57.409474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1b4907b8-bb0a-4f21-ad96-9973322e51e1 None None] MFA Rules not processed for user `8644754798b5439c954c86dc9aa9e7af`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:57.410688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1b4907b8-bb0a-4f21-ad96-9973322e51e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:57.444652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1110/2224] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:57.444652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6217ef-40a2-40be-a14c-c2c4259d6192 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:57.445078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6c6217ef-40a2-40be-a14c-c2c4259d6192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:57.459534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6217ef-40a2-40be-a14c-c2c4259d6192 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:57.467072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:57.469405 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:57.470715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:57.471510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] PATH_INFO: `/v3/users/c3cff2d803b84f6cadea85eb0822ba62` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:57.474452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3cff2d803b84f6cadea85eb0822ba62)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:57.484878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:57.536921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1115/2225] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 23 13:15:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:57.548342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4907b8-bb0a-4f21-ad96-9973322e51e1 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:57.549871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1b4907b8-bb0a-4f21-ad96-9973322e51e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:57.559699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:57.569653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4907b8-bb0a-4f21-ad96-9973322e51e1 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:57.569750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80e193-a110-4c3f-a3c8-4d079a259fc0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:57.570542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e193-a110-4c3f-a3c8-4d079a259fc0 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:57.571016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e193-a110-4c3f-a3c8-4d079a259fc0 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:57.571332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e193-a110-4c3f-a3c8-4d079a259fc0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:57.582339 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80e193-a110-4c3f-a3c8-4d079a259fc0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:57.584013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80e193-a110-4c3f-a3c8-4d079a259fc0 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:57.595502 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1116/2226] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:15:57.706200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3cff2d803b84f6cadea85eb0822ba62'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:57.707518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3cff2d803b84f6cadea85eb0822ba62'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:57.784464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3cff2d803b84f6cadea85eb0822ba62'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:57.801011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3cff2d803b84f6cadea85eb0822ba62'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:57.811442 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3cff2d803b84f6cadea85eb0822ba62'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:57.817603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1111/2227] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:15:57 2022] DELETE /identity/v3/users/c3cff2d803b84f6cadea85eb0822ba62 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:57.935019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80e193-a110-4c3f-a3c8-4d079a259fc0 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:57.936533 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6e80e193-a110-4c3f-a3c8-4d079a259fc0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:57.961583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80e193-a110-4c3f-a3c8-4d079a259fc0 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:58.028560 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:58.029886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:58.030391 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:58.030896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] PATH_INFO: `/v3/projects/8e87f0001e9a4178a4e4b47c6a1dc74c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:58.032622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e87f0001e9a4178a4e4b47c6a1dc74c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:58.036275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:58.077734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:58.079178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:58.093451 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81e259-2b89-4be4-8491-c3fbd4c0c405 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:58.098374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:58.099350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:58.099637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:58.100057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa admin admin] PATH_INFO: `/v3/projects/b5dbe532f215440988ae952d8310002e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:58.101321 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5dbe532f215440988ae952d8310002e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:58.103250 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:58.161258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e87f0001e9a4178a4e4b47c6a1dc74c', 'request_id': 'req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.250658 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:58.253732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5dbe532f215440988ae952d8310002e', 'request_id': 'req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.261015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5dbe532f215440988ae952d8310002e', 'request_id': 'req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.265156 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e87f0001e9a4178a4e4b47c6a1dc74c', 'request_id': 'req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.266556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5dbe532f215440988ae952d8310002e', 'request_id': 'req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.269399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e87f0001e9a4178a4e4b47c6a1dc74c', 'request_id': 'req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.280952 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] The token cache is being invalidate because project 8e87f0001e9a4178a4e4b47c6a1dc74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:15:58.281237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.283894 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.285931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1117/2228] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:15:57 2022] DELETE /identity/v3/projects/8e87f0001e9a4178a4e4b47c6a1dc74c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:58.290077 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:58.297493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:58.352998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa admin admin] The token cache is being invalidate because project b5dbe532f215440988ae952d8310002e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:15:58.353291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.353928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b7d2eae5-7fd4-42cf-a9f4-cc45874377fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.355501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1112/2229] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:15:58 2022] DELETE /identity/v3/projects/b5dbe532f215440988ae952d8310002e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:58.361226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae708ba-1cf2-4c65-9af0-89fe36007cde None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:58.361710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae708ba-1cf2-4c65-9af0-89fe36007cde None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:58.362101 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae708ba-1cf2-4c65-9af0-89fe36007cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:58.362837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9bcf-3a1c-4e09-bed7-2ea25ea9a72f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:58.381874 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-bae708ba-1cf2-4c65-9af0-89fe36007cde None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:58.389406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bae708ba-1cf2-4c65-9af0-89fe36007cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:58.411930 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:58.447535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:58.448415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:58.448723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:58.449004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] PATH_INFO: `/v3/users/cbf9e5ec4d0649dabf32067da60be52f` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:58.450213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf9e5ec4d0649dabf32067da60be52f)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:58.452200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:58.478753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1113/2230] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:15:58.486991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143acede-5d51-4f67-b4e6-59447b22a190 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:58.487228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143acede-5d51-4f67-b4e6-59447b22a190 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:58.487539 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143acede-5d51-4f67-b4e6-59447b22a190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:58.507801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-143acede-5d51-4f67-b4e6-59447b22a190 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:58.509167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-143acede-5d51-4f67-b4e6-59447b22a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:58.518136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1114/2231] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:15:58.522472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143acede-5d51-4f67-b4e6-59447b22a190 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:58.535768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143acede-5d51-4f67-b4e6-59447b22a190 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:58.541440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2af7d-164d-4291-9f2d-0139032f3a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:58.542340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2af7d-164d-4291-9f2d-0139032f3a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:58.542744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2af7d-164d-4291-9f2d-0139032f3a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:58.543128 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2af7d-164d-4291-9f2d-0139032f3a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:58.543992 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2af7d-164d-4291-9f2d-0139032f3a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:15:58.544375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2af7d-164d-4291-9f2d-0139032f3a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:58.546173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2af7d-164d-4291-9f2d-0139032f3a2b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:58.558973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1115/2232] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:15:58.563155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2af7d-164d-4291-9f2d-0139032f3a2b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:58.573296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2af7d-164d-4291-9f2d-0139032f3a2b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:58.578030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11ff1c-726f-4474-85d7-710320f99a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:58.578653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11ff1c-726f-4474-85d7-710320f99a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:58.578937 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11ff1c-726f-4474-85d7-710320f99a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:58.579214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11ff1c-726f-4474-85d7-710320f99a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:58.579888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11ff1c-726f-4474-85d7-710320f99a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:58.581841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11ff1c-726f-4474-85d7-710320f99a8b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:58.675490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf9e5ec4d0649dabf32067da60be52f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.676238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf9e5ec4d0649dabf32067da60be52f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.677765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf9e5ec4d0649dabf32067da60be52f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.690708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf9e5ec4d0649dabf32067da60be52f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.698565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf9e5ec4d0649dabf32067da60be52f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:58.702347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1116/2233] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:15:58 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:15:58.703651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11ff1c-726f-4474-85d7-710320f99a8b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:58.705310 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7a11ff1c-726f-4474-85d7-710320f99a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:58.775585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11ff1c-726f-4474-85d7-710320f99a8b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:58.781880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60e7e9-3182-4ca3-a336-ddf840b3dd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:58.791430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e7e9-3182-4ca3-a336-ddf840b3dd01 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:58.791430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e7e9-3182-4ca3-a336-ddf840b3dd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:58.791430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e7e9-3182-4ca3-a336-ddf840b3dd01 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:58.791430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60e7e9-3182-4ca3-a336-ddf840b3dd01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:58.791430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60e7e9-3182-4ca3-a336-ddf840b3dd01 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:58.871262 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1118/2234] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:15:58 2022] DELETE /identity/v3/users/cbf9e5ec4d0649dabf32067da60be52f => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:15:58.914667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1117/2235] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:15:58 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:15:58.915848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:58.992309 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b1a6f-3539-4aea-8e9a-cd1448ac71ab admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:58.997182 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59313fcb-3b41-45e8-8b9c-f9f8ba175618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:58.998008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59313fcb-3b41-45e8-8b9c-f9f8ba175618 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:58.998364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59313fcb-3b41-45e8-8b9c-f9f8ba175618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:58.998730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59313fcb-3b41-45e8-8b9c-f9f8ba175618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:58.999562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59313fcb-3b41-45e8-8b9c-f9f8ba175618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:59.001702 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59313fcb-3b41-45e8-8b9c-f9f8ba175618 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:59.013021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1119/2236] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:15:59.016872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60e7e9-3182-4ca3-a336-ddf840b3dd01 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:59.028007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60e7e9-3182-4ca3-a336-ddf840b3dd01 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:59.033070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fe502-0ef8-4022-9ea8-13e77549123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:59.040469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe502-0ef8-4022-9ea8-13e77549123d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:59.040469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe502-0ef8-4022-9ea8-13e77549123d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:59.040469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe502-0ef8-4022-9ea8-13e77549123d admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:59.040469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fe502-0ef8-4022-9ea8-13e77549123d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:59.040469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fe502-0ef8-4022-9ea8-13e77549123d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:59.049547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1118/2237] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:15:59.054685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59313fcb-3b41-45e8-8b9c-f9f8ba175618 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:59.064821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59313fcb-3b41-45e8-8b9c-f9f8ba175618 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:59.069520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b498acb-f9c4-4030-b1b4-66149ecd709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:59.070441 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b498acb-f9c4-4030-b1b4-66149ecd709c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:59.071747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b498acb-f9c4-4030-b1b4-66149ecd709c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:59.071747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b498acb-f9c4-4030-b1b4-66149ecd709c admin admin] PATH_INFO: `/v3/projects/d6dcf8d46df7490080ca84f98553acf6/users/2f40b0bce4964069a78e708e68f4501a/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:59.090070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b498acb-f9c4-4030-b1b4-66149ecd709c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6dcf8d46df7490080ca84f98553acf6, user_id=2f40b0bce4964069a78e708e68f4501a, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:59.092866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b498acb-f9c4-4030-b1b4-66149ecd709c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:59.200215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1120/2238] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:15:59 2022] PUT /identity/v3/projects/d6dcf8d46df7490080ca84f98553acf6/users/2f40b0bce4964069a78e708e68f4501a/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:15:59.211077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab5e8-0a95-4544-9d9a-18d45d52234f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:59.211371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab5e8-0a95-4544-9d9a-18d45d52234f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:59.211648 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab5e8-0a95-4544-9d9a-18d45d52234f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:59.230966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:59.253005 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-009ab5e8-0a95-4544-9d9a-18d45d52234f None None] MFA Rules not processed for user `2f40b0bce4964069a78e708e68f4501a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:59.257827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-009ab5e8-0a95-4544-9d9a-18d45d52234f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:59.339801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1119/2239] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:59.351921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b498acb-f9c4-4030-b1b4-66149ecd709c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:59.353622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5b498acb-f9c4-4030-b1b4-66149ecd709c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:59.368499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ab5e8-0a95-4544-9d9a-18d45d52234f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:59.374607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-009ab5e8-0a95-4544-9d9a-18d45d52234f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:59.411070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:59.456555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ab5e8-0a95-4544-9d9a-18d45d52234f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:59.462368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7b245-273f-4bcb-910c-1b9385d0c2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:59.463397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7b245-273f-4bcb-910c-1b9385d0c2d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:59.463687 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7b245-273f-4bcb-910c-1b9385d0c2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:59.463984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7b245-273f-4bcb-910c-1b9385d0c2d6 admin admin] PATH_INFO: `/v3/projects/d1390bd62d9a497fa926ecb3f4a63ed8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:59.465198 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7b245-273f-4bcb-910c-1b9385d0c2d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1390bd62d9a497fa926ecb3f4a63ed8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:59.467136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7b245-273f-4bcb-910c-1b9385d0c2d6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:59.473261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b498acb-f9c4-4030-b1b4-66149ecd709c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:59.480409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962056d-f675-48f1-bd5a-9e47e58b84e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:59.480409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962056d-f675-48f1-bd5a-9e47e58b84e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:59.480409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962056d-f675-48f1-bd5a-9e47e58b84e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:59.480858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962056d-f675-48f1-bd5a-9e47e58b84e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:59.501605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962056d-f675-48f1-bd5a-9e47e58b84e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:59.506648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962056d-f675-48f1-bd5a-9e47e58b84e4 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:59.517084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1121/2240] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:59.656995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-04c7b245-273f-4bcb-910c-1b9385d0c2d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1390bd62d9a497fa926ecb3f4a63ed8', 'request_id': 'req-04c7b245-273f-4bcb-910c-1b9385d0c2d6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:59.664168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-04c7b245-273f-4bcb-910c-1b9385d0c2d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1390bd62d9a497fa926ecb3f4a63ed8', 'request_id': 'req-04c7b245-273f-4bcb-910c-1b9385d0c2d6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:59.669829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-04c7b245-273f-4bcb-910c-1b9385d0c2d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1390bd62d9a497fa926ecb3f4a63ed8', 'request_id': 'req-04c7b245-273f-4bcb-910c-1b9385d0c2d6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:59.778291 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-04c7b245-273f-4bcb-910c-1b9385d0c2d6 admin admin] The token cache is being invalidate because project d1390bd62d9a497fa926ecb3f4a63ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:15:59.778961 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-04c7b245-273f-4bcb-910c-1b9385d0c2d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:59.779192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-04c7b245-273f-4bcb-910c-1b9385d0c2d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:15:59.780762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1120/2241] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:15:59 2022] DELETE /identity/v3/projects/d1390bd62d9a497fa926ecb3f4a63ed8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:15:59.785671 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887eef-a11e-4f5d-9c6b-608b7aa61c66 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:59.785964 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887eef-a11e-4f5d-9c6b-608b7aa61c66 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:59.786272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887eef-a11e-4f5d-9c6b-608b7aa61c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:59.804516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-04887eef-a11e-4f5d-9c6b-608b7aa61c66 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:59.805673 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-04887eef-a11e-4f5d-9c6b-608b7aa61c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:59.874291 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1122/2242] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:15:59.882958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa0ed1-61b8-49f7-be45-958330cc1c90 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:59.883249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa0ed1-61b8-49f7-be45-958330cc1c90 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:59.883531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa0ed1-61b8-49f7-be45-958330cc1c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:59.902680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-eafa0ed1-61b8-49f7-be45-958330cc1c90 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:59.905331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-eafa0ed1-61b8-49f7-be45-958330cc1c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:59.912181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1121/2243] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:59.916438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887eef-a11e-4f5d-9c6b-608b7aa61c66 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:59.926031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887eef-a11e-4f5d-9c6b-608b7aa61c66 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:59.937605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1dcfb-b092-438a-8157-fcbae0b7ed23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:59.937605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1dcfb-b092-438a-8157-fcbae0b7ed23 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:59.937605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1dcfb-b092-438a-8157-fcbae0b7ed23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:59.937605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1dcfb-b092-438a-8157-fcbae0b7ed23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:59.938082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1dcfb-b092-438a-8157-fcbae0b7ed23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:15:59.938082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1dcfb-b092-438a-8157-fcbae0b7ed23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:59.938082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1dcfb-b092-438a-8157-fcbae0b7ed23 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:59.953900 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1123/2244] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:15:59.955099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa0ed1-61b8-49f7-be45-958330cc1c90 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:59.969243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa0ed1-61b8-49f7-be45-958330cc1c90 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:59.982785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31789da2-0f57-43a9-92fc-732989fbafc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:59.984550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31789da2-0f57-43a9-92fc-732989fbafc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:59.985592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31789da2-0f57-43a9-92fc-732989fbafc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:59.986055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31789da2-0f57-43a9-92fc-732989fbafc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:59.986940 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31789da2-0f57-43a9-92fc-732989fbafc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:59.990196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31789da2-0f57-43a9-92fc-732989fbafc0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:00.148040 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:00.161627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1122/2245] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:15:59 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:16:00.164466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1dcfb-b092-438a-8157-fcbae0b7ed23 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:00.174658 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1dcfb-b092-438a-8157-fcbae0b7ed23 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:00.238151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f040580-8c30-45fc-b645-c0835753c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:00.238758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040580-8c30-45fc-b645-c0835753c1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:00.239881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040580-8c30-45fc-b645-c0835753c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:00.240165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040580-8c30-45fc-b645-c0835753c1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:00.240893 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f040580-8c30-45fc-b645-c0835753c1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:00.243015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f040580-8c30-45fc-b645-c0835753c1f1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:00.370568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1124/2246] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:16:00 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:16:00.372753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31789da2-0f57-43a9-92fc-732989fbafc0 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:00.383226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31789da2-0f57-43a9-92fc-732989fbafc0 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:00.388033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fbf10-f662-4022-b1bd-6fd61d315237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:00.388886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fbf10-f662-4022-b1bd-6fd61d315237 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:00.389265 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fbf10-f662-4022-b1bd-6fd61d315237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:00.389627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fbf10-f662-4022-b1bd-6fd61d315237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:00.390432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fbf10-f662-4022-b1bd-6fd61d315237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:00.392389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fbf10-f662-4022-b1bd-6fd61d315237 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:00.403908 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1123/2247] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:16:00.407977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f040580-8c30-45fc-b645-c0835753c1f1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:00.418802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f040580-8c30-45fc-b645-c0835753c1f1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:00.423532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9b29c-59bb-4f8c-a0ed-2a3064833e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:00.424380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9b29c-59bb-4f8c-a0ed-2a3064833e1b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:00.424696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9b29c-59bb-4f8c-a0ed-2a3064833e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:00.425100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9b29c-59bb-4f8c-a0ed-2a3064833e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:00.425856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9b29c-59bb-4f8c-a0ed-2a3064833e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:00.428334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9b29c-59bb-4f8c-a0ed-2a3064833e1b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:00.444095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1125/2248] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:16:00.448430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fbf10-f662-4022-b1bd-6fd61d315237 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:00.461703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fbf10-f662-4022-b1bd-6fd61d315237 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:00.467863 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8e3d7-1f22-435d-b697-1c6852fd137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:00.469086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8e3d7-1f22-435d-b697-1c6852fd137c admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:00.469488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8e3d7-1f22-435d-b697-1c6852fd137c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:00.469844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8e3d7-1f22-435d-b697-1c6852fd137c admin admin] PATH_INFO: `/v3/projects/29d6740267a0400da326cf4802362d9d/users/b11c052f00c240a89dd7442e55ff3a4d/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:00.487999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8e3d7-1f22-435d-b697-1c6852fd137c admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d6740267a0400da326cf4802362d9d, user_id=b11c052f00c240a89dd7442e55ff3a4d, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:00.491456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8e3d7-1f22-435d-b697-1c6852fd137c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:00.624928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1124/2249] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:16:00 2022] PUT /identity/v3/projects/29d6740267a0400da326cf4802362d9d/users/b11c052f00c240a89dd7442e55ff3a4d/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:16:00.634829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bbe78-4d87-4d9d-a021-e3565bb9a4aa None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:00.635125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bbe78-4d87-4d9d-a021-e3565bb9a4aa None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:00.635411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bbe78-4d87-4d9d-a021-e3565bb9a4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:00.654508 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:00.663308 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c60bbe78-4d87-4d9d-a021-e3565bb9a4aa None None] MFA Rules not processed for user `b11c052f00c240a89dd7442e55ff3a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:00.664464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c60bbe78-4d87-4d9d-a021-e3565bb9a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:00.733035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1126/2250] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:16:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:00.743815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8e3d7-1f22-435d-b697-1c6852fd137c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:00.745529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-46f8e3d7-1f22-435d-b697-1c6852fd137c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:00.806754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8e3d7-1f22-435d-b697-1c6852fd137c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:00.810580 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a24dc8-be72-47a3-a1eb-9baca4d2d28e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:00.811231 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a24dc8-be72-47a3-a1eb-9baca4d2d28e service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:00.811517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a24dc8-be72-47a3-a1eb-9baca4d2d28e service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:00.811802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a24dc8-be72-47a3-a1eb-9baca4d2d28e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:00.820430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a24dc8-be72-47a3-a1eb-9baca4d2d28e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:00.821900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a24dc8-be72-47a3-a1eb-9baca4d2d28e service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:00.830915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1125/2251] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:16:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:16:03.863509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bbe78-4d87-4d9d-a021-e3565bb9a4aa None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:03.865005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c60bbe78-4d87-4d9d-a021-e3565bb9a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:03.939765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bbe78-4d87-4d9d-a021-e3565bb9a4aa None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:03.944330 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:03.945271 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:03.945554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:03.945829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] PATH_INFO: `/v3/users/2f40b0bce4964069a78e708e68f4501a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:03.947077 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f40b0bce4964069a78e708e68f4501a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:03.949090 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:04.196617 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f40b0bce4964069a78e708e68f4501a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:04.197705 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f40b0bce4964069a78e708e68f4501a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:04.198497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f40b0bce4964069a78e708e68f4501a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:04.219485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f40b0bce4964069a78e708e68f4501a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:04.227301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f40b0bce4964069a78e708e68f4501a'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:04.310595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1127/2252] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:16:03 2022] DELETE /identity/v3/users/2f40b0bce4964069a78e708e68f4501a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:16:04.315112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6216a1-a568-4e41-ab9d-ebc766919c8f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:04.315660 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6216a1-a568-4e41-ab9d-ebc766919c8f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:04.315660 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6216a1-a568-4e41-ab9d-ebc766919c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:04.333584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8a6216a1-a568-4e41-ab9d-ebc766919c8f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:04.337760 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8a6216a1-a568-4e41-ab9d-ebc766919c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:04.400060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1126/2253] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:04.409567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:04.410962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:04.431720 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:04.468803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6a5d-9c5f-48d4-b164-810e56999626 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:04.473264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1a673-d6c4-47aa-87d9-13507d366128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:04.473922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a673-d6c4-47aa-87d9-13507d366128 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:04.474273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a673-d6c4-47aa-87d9-13507d366128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:04.475059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a673-d6c4-47aa-87d9-13507d366128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:04.485608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1a673-d6c4-47aa-87d9-13507d366128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:04.487263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1a673-d6c4-47aa-87d9-13507d366128 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:04.498456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1128/2254] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:16:05.648920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6216a1-a568-4e41-ab9d-ebc766919c8f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:05.651001 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8a6216a1-a568-4e41-ab9d-ebc766919c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:05.666573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6216a1-a568-4e41-ab9d-ebc766919c8f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:05.671615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:05.672553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:05.673400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:05.673400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5 admin admin] PATH_INFO: `/v3/projects/d6dcf8d46df7490080ca84f98553acf6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:05.674562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6dcf8d46df7490080ca84f98553acf6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:05.676511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:05.840369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6dcf8d46df7490080ca84f98553acf6', 'request_id': 'req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:05.847234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6dcf8d46df7490080ca84f98553acf6', 'request_id': 'req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:05.852290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:05.856461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6dcf8d46df7490080ca84f98553acf6', 'request_id': 'req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:05.944558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5 admin admin] The token cache is being invalidate because project d6dcf8d46df7490080ca84f98553acf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:16:05.944881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:05.945517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-b1864356-b496-4bf8-b7e7-f0b5bdb8dff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:05.947313 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1127/2255] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:16:05 2022] DELETE /identity/v3/projects/d6dcf8d46df7490080ca84f98553acf6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:16:05.952216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974067-9645-4172-b556-69cb2d289225 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:05.952781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974067-9645-4172-b556-69cb2d289225 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:05.952874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974067-9645-4172-b556-69cb2d289225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:05.973520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-d8974067-9645-4172-b556-69cb2d289225 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:05.977330 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d8974067-9645-4172-b556-69cb2d289225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:06.074333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1129/2256] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:16:06.082501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438b157-9b66-4688-82cc-a369ca8e9f0a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:06.082797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438b157-9b66-4688-82cc-a369ca8e9f0a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:06.083139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438b157-9b66-4688-82cc-a369ca8e9f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:06.103024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-6438b157-9b66-4688-82cc-a369ca8e9f0a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:06.104233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6438b157-9b66-4688-82cc-a369ca8e9f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:06.112614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1128/2257] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:16:06.117096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8974067-9645-4172-b556-69cb2d289225 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:06.128583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8974067-9645-4172-b556-69cb2d289225 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:06.133537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb0c39-d21a-412b-b92f-c3d886b98ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:06.134213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb0c39-d21a-412b-b92f-c3d886b98ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:06.134498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb0c39-d21a-412b-b92f-c3d886b98ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:06.134789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb0c39-d21a-412b-b92f-c3d886b98ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:06.135520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb0c39-d21a-412b-b92f-c3d886b98ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:16:06.135843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb0c39-d21a-412b-b92f-c3d886b98ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:06.137518 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb0c39-d21a-412b-b92f-c3d886b98ecc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:06.152197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1130/2258] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:16:06.155902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438b157-9b66-4688-82cc-a369ca8e9f0a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:06.166085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438b157-9b66-4688-82cc-a369ca8e9f0a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:06.170732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ed6ee-004b-4295-aa0a-9cd6c2f6b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:06.171376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ed6ee-004b-4295-aa0a-9cd6c2f6b0be admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:06.171660 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ed6ee-004b-4295-aa0a-9cd6c2f6b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:06.171957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ed6ee-004b-4295-aa0a-9cd6c2f6b0be admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:06.172704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ed6ee-004b-4295-aa0a-9cd6c2f6b0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:06.174600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ed6ee-004b-4295-aa0a-9cd6c2f6b0be admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:06.266531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1129/2259] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:16:06 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:16:06.270749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb0c39-d21a-412b-b92f-c3d886b98ecc admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:06.283315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb0c39-d21a-412b-b92f-c3d886b98ecc admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:06.345880 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9133ec-ecf4-4f8d-bd10-0d787239f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:06.346613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9133ec-ecf4-4f8d-bd10-0d787239f06e admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:06.346895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9133ec-ecf4-4f8d-bd10-0d787239f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:06.347171 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9133ec-ecf4-4f8d-bd10-0d787239f06e admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:06.347932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9133ec-ecf4-4f8d-bd10-0d787239f06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:06.350010 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9133ec-ecf4-4f8d-bd10-0d787239f06e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:06.479361 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1131/2260] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:16:06 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:16:06.483563 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ed6ee-004b-4295-aa0a-9cd6c2f6b0be admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:06.493660 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ed6ee-004b-4295-aa0a-9cd6c2f6b0be admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:06.498185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71339b28-e84e-48aa-b745-3a7e666c7d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:06.498832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71339b28-e84e-48aa-b745-3a7e666c7d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:06.499116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71339b28-e84e-48aa-b745-3a7e666c7d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:06.499390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71339b28-e84e-48aa-b745-3a7e666c7d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:06.500105 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71339b28-e84e-48aa-b745-3a7e666c7d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:06.501987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71339b28-e84e-48aa-b745-3a7e666c7d4c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:06.512607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1130/2261] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:16:06.516369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9133ec-ecf4-4f8d-bd10-0d787239f06e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:06.527557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9133ec-ecf4-4f8d-bd10-0d787239f06e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:06.532253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033fcf1-5d53-4a1e-a72d-cd1a00b5293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:06.537136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033fcf1-5d53-4a1e-a72d-cd1a00b5293d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:06.537136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033fcf1-5d53-4a1e-a72d-cd1a00b5293d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:06.537136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033fcf1-5d53-4a1e-a72d-cd1a00b5293d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:06.537136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033fcf1-5d53-4a1e-a72d-cd1a00b5293d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:06.537136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033fcf1-5d53-4a1e-a72d-cd1a00b5293d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:06.545690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1132/2262] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:16:06.549718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71339b28-e84e-48aa-b745-3a7e666c7d4c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:06.559637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71339b28-e84e-48aa-b745-3a7e666c7d4c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:06.564117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef6f99-1039-46fe-bb18-458ed7a8e177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:06.565014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef6f99-1039-46fe-bb18-458ed7a8e177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:06.565294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef6f99-1039-46fe-bb18-458ed7a8e177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:06.565568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef6f99-1039-46fe-bb18-458ed7a8e177 admin admin] PATH_INFO: `/v3/projects/87b07c04562741da8739e3804194921a/users/0ab619cb3f9741ad98ae31592d46b1ca/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:06.580097 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef6f99-1039-46fe-bb18-458ed7a8e177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b07c04562741da8739e3804194921a, user_id=0ab619cb3f9741ad98ae31592d46b1ca, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:06.582742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef6f99-1039-46fe-bb18-458ed7a8e177 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:06.680090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1131/2263] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:16:06 2022] PUT /identity/v3/projects/87b07c04562741da8739e3804194921a/users/0ab619cb3f9741ad98ae31592d46b1ca/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:16:06.691107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6f30b-58c4-43ee-bcf6-e52b12c6e0d4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:06.691404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6f30b-58c4-43ee-bcf6-e52b12c6e0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:06.691684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6f30b-58c4-43ee-bcf6-e52b12c6e0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:06.718334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9bb6f30b-58c4-43ee-bcf6-e52b12c6e0d4 None None] MFA Rules not processed for user `0ab619cb3f9741ad98ae31592d46b1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:06.719574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9bb6f30b-58c4-43ee-bcf6-e52b12c6e0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:06.731962 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:06.784782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1133/2264] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:16:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:06.796261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef6f99-1039-46fe-bb18-458ed7a8e177 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:06.798037 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9fef6f99-1039-46fe-bb18-458ed7a8e177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:06.853138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef6f99-1039-46fe-bb18-458ed7a8e177 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:06.856811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebdcf8-a188-494c-9ec5-4407158d4fbe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '711d53a7deb94849b577c08dc9165ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:06.857449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebdcf8-a188-494c-9ec5-4407158d4fbe service glance] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:06.857732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebdcf8-a188-494c-9ec5-4407158d4fbe service glance] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:06.858010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebdcf8-a188-494c-9ec5-4407158d4fbe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:06.866732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebdcf8-a188-494c-9ec5-4407158d4fbe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:06.868152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebdcf8-a188-494c-9ec5-4407158d4fbe service glance] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:06.876741 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1132/2265] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:16:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:16:13.923936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6f30b-58c4-43ee-bcf6-e52b12c6e0d4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:13.925776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9bb6f30b-58c4-43ee-bcf6-e52b12c6e0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:14.028358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6f30b-58c4-43ee-bcf6-e52b12c6e0d4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:14.034664 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217c77f-0dc3-4f8b-9246-039d30880891 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:14.035335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217c77f-0dc3-4f8b-9246-039d30880891 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:14.035628 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217c77f-0dc3-4f8b-9246-039d30880891 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:14.036364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217c77f-0dc3-4f8b-9246-039d30880891 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:14.038076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3217c77f-0dc3-4f8b-9246-039d30880891 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:14.052857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217c77f-0dc3-4f8b-9246-039d30880891 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:14.055105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217c77f-0dc3-4f8b-9246-039d30880891 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:14.066795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1134/2266] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:16:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:16:16.872894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=56,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:17.537821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebdcf8-a188-494c-9ec5-4407158d4fbe service glance] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:17.539748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-eaebdcf8-a188-494c-9ec5-4407158d4fbe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:17.605463 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebdcf8-a188-494c-9ec5-4407158d4fbe service glance] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:17.610044 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:17.610912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:17.611199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:17.611487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] PATH_INFO: `/v3/users/b11c052f00c240a89dd7442e55ff3a4d` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:17.612698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b11c052f00c240a89dd7442e55ff3a4d)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:17.614639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:17.847172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b11c052f00c240a89dd7442e55ff3a4d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:17.847850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b11c052f00c240a89dd7442e55ff3a4d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:17.914230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b11c052f00c240a89dd7442e55ff3a4d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:17.927036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b11c052f00c240a89dd7442e55ff3a4d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:17.934569 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b11c052f00c240a89dd7442e55ff3a4d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:17.940786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1133/2267] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:16:17 2022] DELETE /identity/v3/users/b11c052f00c240a89dd7442e55ff3a4d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:16:17.945642 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400303bb-cbc0-48fc-a4ff-ddc19a99b600 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:17.946139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400303bb-cbc0-48fc-a4ff-ddc19a99b600 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:17.946289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400303bb-cbc0-48fc-a4ff-ddc19a99b600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:17.965943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-400303bb-cbc0-48fc-a4ff-ddc19a99b600 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:17.967436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-400303bb-cbc0-48fc-a4ff-ddc19a99b600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:18.027496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1135/2268] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:18.039207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:18.044330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:18.106188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6520767-127d-4cdc-aa5c-5f20b05652cc admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:18.110189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9381d-7290-424b-be3b-f5731ac2e315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:18.113021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9381d-7290-424b-be3b-f5731ac2e315 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:18.113021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9381d-7290-424b-be3b-f5731ac2e315 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:18.113021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9381d-7290-424b-be3b-f5731ac2e315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:18.126660 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9381d-7290-424b-be3b-f5731ac2e315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:18.128244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9381d-7290-424b-be3b-f5731ac2e315 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:18.138403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1134/2269] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:16:18.550031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400303bb-cbc0-48fc-a4ff-ddc19a99b600 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:18.551649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-400303bb-cbc0-48fc-a4ff-ddc19a99b600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:18.564811 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400303bb-cbc0-48fc-a4ff-ddc19a99b600 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:18.569493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cae037-e993-4756-8c10-6b62d10a8a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:18.570862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cae037-e993-4756-8c10-6b62d10a8a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:18.571152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cae037-e993-4756-8c10-6b62d10a8a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:18.571436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cae037-e993-4756-8c10-6b62d10a8a39 admin admin] PATH_INFO: `/v3/projects/29d6740267a0400da326cf4802362d9d` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:18.572883 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cae037-e993-4756-8c10-6b62d10a8a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29d6740267a0400da326cf4802362d9d)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:18.574670 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cae037-e993-4756-8c10-6b62d10a8a39 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:18.695539 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:18.702016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-41cae037-e993-4756-8c10-6b62d10a8a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d6740267a0400da326cf4802362d9d', 'request_id': 'req-41cae037-e993-4756-8c10-6b62d10a8a39'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:18.876844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-41cae037-e993-4756-8c10-6b62d10a8a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d6740267a0400da326cf4802362d9d', 'request_id': 'req-41cae037-e993-4756-8c10-6b62d10a8a39'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:18.886278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-41cae037-e993-4756-8c10-6b62d10a8a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d6740267a0400da326cf4802362d9d', 'request_id': 'req-41cae037-e993-4756-8c10-6b62d10a8a39'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:18.895928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-41cae037-e993-4756-8c10-6b62d10a8a39 admin admin] The token cache is being invalidate because project 29d6740267a0400da326cf4802362d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:16:18.896214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-41cae037-e993-4756-8c10-6b62d10a8a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:18.897205 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-41cae037-e993-4756-8c10-6b62d10a8a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:18.898759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1136/2270] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:16:18 2022] DELETE /identity/v3/projects/29d6740267a0400da326cf4802362d9d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:16:18.908971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c2deb-2332-40e4-ace2-aeecb9f6f24b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:18.909266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c2deb-2332-40e4-ace2-aeecb9f6f24b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:18.909601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c2deb-2332-40e4-ace2-aeecb9f6f24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:18.930877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-547c2deb-2332-40e4-ace2-aeecb9f6f24b None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:18.932093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-547c2deb-2332-40e4-ace2-aeecb9f6f24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:18.950217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:18.996065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1135/2271] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:19.004892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54bb80-87e2-4050-8bfe-97d2c3bba7ff None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:19.005406 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54bb80-87e2-4050-8bfe-97d2c3bba7ff None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:19.005486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54bb80-87e2-4050-8bfe-97d2c3bba7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:19.024860 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4b54bb80-87e2-4050-8bfe-97d2c3bba7ff None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:19.028043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4b54bb80-87e2-4050-8bfe-97d2c3bba7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:19.034089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1137/2272] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:19.039242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c2deb-2332-40e4-ace2-aeecb9f6f24b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:19.049472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c2deb-2332-40e4-ace2-aeecb9f6f24b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:19.056511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e575eaf-cd3b-49c6-b91f-92b7598cd663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:19.057727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e575eaf-cd3b-49c6-b91f-92b7598cd663 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:19.058315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e575eaf-cd3b-49c6-b91f-92b7598cd663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:19.058818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e575eaf-cd3b-49c6-b91f-92b7598cd663 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:19.059911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e575eaf-cd3b-49c6-b91f-92b7598cd663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:16:19.060578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e575eaf-cd3b-49c6-b91f-92b7598cd663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:19.064106 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e575eaf-cd3b-49c6-b91f-92b7598cd663 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:19.076872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1136/2273] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:16:19.079286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54bb80-87e2-4050-8bfe-97d2c3bba7ff None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:19.089267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54bb80-87e2-4050-8bfe-97d2c3bba7ff None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:19.095547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dd8da-6e81-4981-be19-2a91070f9a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:19.096299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dd8da-6e81-4981-be19-2a91070f9a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:19.096592 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dd8da-6e81-4981-be19-2a91070f9a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:19.101693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dd8da-6e81-4981-be19-2a91070f9a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:19.101693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dd8da-6e81-4981-be19-2a91070f9a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:19.101693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dd8da-6e81-4981-be19-2a91070f9a1d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:19.227975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1138/2274] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:16:19 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:16:19.233168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e575eaf-cd3b-49c6-b91f-92b7598cd663 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:19.244764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e575eaf-cd3b-49c6-b91f-92b7598cd663 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:19.305618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110e0fd-3361-4849-8253-fa177f51ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:19.306289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110e0fd-3361-4849-8253-fa177f51ab94 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:19.306741 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110e0fd-3361-4849-8253-fa177f51ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:19.306845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110e0fd-3361-4849-8253-fa177f51ab94 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:19.307520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110e0fd-3361-4849-8253-fa177f51ab94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:19.309563 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110e0fd-3361-4849-8253-fa177f51ab94 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:19.418364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1137/2275] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:16:19 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:16:19.422356 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dd8da-6e81-4981-be19-2a91070f9a1d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:19.432610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dd8da-6e81-4981-be19-2a91070f9a1d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:19.437184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88e1a2-d69a-4241-8eb2-e37f48d55e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:19.437839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88e1a2-d69a-4241-8eb2-e37f48d55e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:19.438196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88e1a2-d69a-4241-8eb2-e37f48d55e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:19.438581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88e1a2-d69a-4241-8eb2-e37f48d55e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:19.439426 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88e1a2-d69a-4241-8eb2-e37f48d55e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:19.441189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88e1a2-d69a-4241-8eb2-e37f48d55e3b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:19.455342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1139/2276] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:16:19.458070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110e0fd-3361-4849-8253-fa177f51ab94 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:19.468688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110e0fd-3361-4849-8253-fa177f51ab94 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:19.473400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9d204-530f-4172-be44-b6882d8984e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:19.474063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9d204-530f-4172-be44-b6882d8984e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:19.474347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9d204-530f-4172-be44-b6882d8984e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:19.474631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9d204-530f-4172-be44-b6882d8984e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:19.475360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9d204-530f-4172-be44-b6882d8984e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:19.477625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9d204-530f-4172-be44-b6882d8984e9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:19.489626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1138/2277] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:16:19.495200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88e1a2-d69a-4241-8eb2-e37f48d55e3b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:19.509983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88e1a2-d69a-4241-8eb2-e37f48d55e3b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:19.514994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eedae0-2b03-49fc-bccd-bf3059127d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:19.515488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eedae0-2b03-49fc-bccd-bf3059127d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:19.515862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eedae0-2b03-49fc-bccd-bf3059127d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:19.516054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eedae0-2b03-49fc-bccd-bf3059127d43 admin admin] PATH_INFO: `/v3/projects/a54c956210304706a0615d276a6a6ec5/users/6f01fd64f4f04999bd15397804f50c22/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:19.533466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eedae0-2b03-49fc-bccd-bf3059127d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54c956210304706a0615d276a6a6ec5, user_id=6f01fd64f4f04999bd15397804f50c22, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:19.536168 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eedae0-2b03-49fc-bccd-bf3059127d43 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:19.683128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1140/2278] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:16:19 2022] PUT /identity/v3/projects/a54c956210304706a0615d276a6a6ec5/users/6f01fd64f4f04999bd15397804f50c22/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:16:19.693187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ba72e-3298-4ec5-9a8e-1b9ca475cdc0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:19.693481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ba72e-3298-4ec5-9a8e-1b9ca475cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:19.693762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ba72e-3298-4ec5-9a8e-1b9ca475cdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:19.723461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f89ba72e-3298-4ec5-9a8e-1b9ca475cdc0 None None] MFA Rules not processed for user `6f01fd64f4f04999bd15397804f50c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:19.724838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f89ba72e-3298-4ec5-9a8e-1b9ca475cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:19.790162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1139/2279] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:16:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:19.794648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eedae0-2b03-49fc-bccd-bf3059127d43 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:19.858547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eedae0-2b03-49fc-bccd-bf3059127d43 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:19.863327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52d39b-fd20-43da-b939-8dd6ace36de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:19.863995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52d39b-fd20-43da-b939-8dd6ace36de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:19.864281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52d39b-fd20-43da-b939-8dd6ace36de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:19.864580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52d39b-fd20-43da-b939-8dd6ace36de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:19.865347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52d39b-fd20-43da-b939-8dd6ace36de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:19.867256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52d39b-fd20-43da-b939-8dd6ace36de3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:19.947607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1141/2280] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:16:19 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:16:19.951743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ba72e-3298-4ec5-9a8e-1b9ca475cdc0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:19.964265 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ba72e-3298-4ec5-9a8e-1b9ca475cdc0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:19.976502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:20.019983 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaa47e-5cf3-4fa5-9efe-2fb485c1cc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.020652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaa47e-5cf3-4fa5-9efe-2fb485c1cc37 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.020972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaa47e-5cf3-4fa5-9efe-2fb485c1cc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.021248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaa47e-5cf3-4fa5-9efe-2fb485c1cc37 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.021948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaa47e-5cf3-4fa5-9efe-2fb485c1cc37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.024516 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaa47e-5cf3-4fa5-9efe-2fb485c1cc37 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.123210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1140/2281] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:16:19 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:16:20.127126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52d39b-fd20-43da-b939-8dd6ace36de3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.138605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52d39b-fd20-43da-b939-8dd6ace36de3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.143288 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2e9f6-83cb-41bd-b87f-6506582aa55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.146022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2e9f6-83cb-41bd-b87f-6506582aa55b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.146022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2e9f6-83cb-41bd-b87f-6506582aa55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.146022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2e9f6-83cb-41bd-b87f-6506582aa55b admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.146022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2e9f6-83cb-41bd-b87f-6506582aa55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.147116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2e9f6-83cb-41bd-b87f-6506582aa55b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.158753 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1142/2282] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:16:20.162711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaa47e-5cf3-4fa5-9efe-2fb485c1cc37 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.172953 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaa47e-5cf3-4fa5-9efe-2fb485c1cc37 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.181176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673d7ad-12cb-4af7-892e-b12441d76486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.181956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673d7ad-12cb-4af7-892e-b12441d76486 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.182326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673d7ad-12cb-4af7-892e-b12441d76486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.182670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673d7ad-12cb-4af7-892e-b12441d76486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.183476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673d7ad-12cb-4af7-892e-b12441d76486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.185159 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673d7ad-12cb-4af7-892e-b12441d76486 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.196914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1141/2283] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:16:20.200325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2e9f6-83cb-41bd-b87f-6506582aa55b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.211062 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2e9f6-83cb-41bd-b87f-6506582aa55b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.215895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac6133-425d-42d5-9570-3c7c235ef8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.216823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac6133-425d-42d5-9570-3c7c235ef8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.217109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac6133-425d-42d5-9570-3c7c235ef8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.217383 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac6133-425d-42d5-9570-3c7c235ef8b4 admin admin] PATH_INFO: `/v3/projects/9b0da3332de14ffb9eca8e0ca8687643/users/b02de6b00a3a43bfa3aba499174f0bf0/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.233346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac6133-425d-42d5-9570-3c7c235ef8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0da3332de14ffb9eca8e0ca8687643, user_id=b02de6b00a3a43bfa3aba499174f0bf0, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.236204 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac6133-425d-42d5-9570-3c7c235ef8b4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.311766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1143/2284] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:16:20 2022] PUT /identity/v3/projects/9b0da3332de14ffb9eca8e0ca8687643/users/b02de6b00a3a43bfa3aba499174f0bf0/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:16:20.324757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eebd7-4d2c-4020-b516-1d8e25d8c0d1 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.324757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eebd7-4d2c-4020-b516-1d8e25d8c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.324757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eebd7-4d2c-4020-b516-1d8e25d8c0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.350813 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7f5eebd7-4d2c-4020-b516-1d8e25d8c0d1 None None] MFA Rules not processed for user `b02de6b00a3a43bfa3aba499174f0bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:20.352069 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7f5eebd7-4d2c-4020-b516-1d8e25d8c0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:20.420065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1142/2285] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:20.424688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac6133-425d-42d5-9570-3c7c235ef8b4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.448974 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:20.497143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac6133-425d-42d5-9570-3c7c235ef8b4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.502927 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d3171-b671-423b-a9ae-f16308c1b315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.503692 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d3171-b671-423b-a9ae-f16308c1b315 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.503977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d3171-b671-423b-a9ae-f16308c1b315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.508640 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d3171-b671-423b-a9ae-f16308c1b315 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.509526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d3171-b671-423b-a9ae-f16308c1b315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.511472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d3171-b671-423b-a9ae-f16308c1b315 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.604845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1144/2286] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:16:20 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:16:20.606960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eebd7-4d2c-4020-b516-1d8e25d8c0d1 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.617626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eebd7-4d2c-4020-b516-1d8e25d8c0d1 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.681963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccae3cd-9865-4f35-a17a-1fb6b09ad73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.682646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccae3cd-9865-4f35-a17a-1fb6b09ad73e admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.682936 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccae3cd-9865-4f35-a17a-1fb6b09ad73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.683221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccae3cd-9865-4f35-a17a-1fb6b09ad73e admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.683950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccae3cd-9865-4f35-a17a-1fb6b09ad73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.685918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccae3cd-9865-4f35-a17a-1fb6b09ad73e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.777308 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1143/2287] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:16:20 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:16:20.778544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d3171-b671-423b-a9ae-f16308c1b315 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.790843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d3171-b671-423b-a9ae-f16308c1b315 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.795666 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600c0b0-5515-4b6d-b327-311e3a7c28a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.796323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600c0b0-5515-4b6d-b327-311e3a7c28a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.796606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600c0b0-5515-4b6d-b327-311e3a7c28a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.796909 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600c0b0-5515-4b6d-b327-311e3a7c28a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.797632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600c0b0-5515-4b6d-b327-311e3a7c28a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.799312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600c0b0-5515-4b6d-b327-311e3a7c28a2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.811113 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1145/2288] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:16:20.815428 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccae3cd-9865-4f35-a17a-1fb6b09ad73e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.825705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccae3cd-9865-4f35-a17a-1fb6b09ad73e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.830370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59311-2d9b-4163-9935-3746f555db9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.831264 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59311-2d9b-4163-9935-3746f555db9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.831556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59311-2d9b-4163-9935-3746f555db9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.831838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59311-2d9b-4163-9935-3746f555db9c admin admin] PATH_INFO: `/v3/projects/2b49ab14c77242c0a44158dc9ebd5d49/users/e2c9d3e5364146e4b44afe55858ff266/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.845041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:20.848367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c59311-2d9b-4163-9935-3746f555db9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b49ab14c77242c0a44158dc9ebd5d49, user_id=e2c9d3e5364146e4b44afe55858ff266, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.851853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c59311-2d9b-4163-9935-3746f555db9c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.922444 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1144/2289] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:16:20 2022] PUT /identity/v3/projects/2b49ab14c77242c0a44158dc9ebd5d49/users/e2c9d3e5364146e4b44afe55858ff266/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:16:20.926478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600c0b0-5515-4b6d-b327-311e3a7c28a2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.936473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600c0b0-5515-4b6d-b327-311e3a7c28a2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.994361 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21441d-f9cd-4f54-945a-55963132f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.995036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21441d-f9cd-4f54-945a-55963132f6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.995320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21441d-f9cd-4f54-945a-55963132f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.995597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21441d-f9cd-4f54-945a-55963132f6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.996322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21441d-f9cd-4f54-945a-55963132f6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.997961 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21441d-f9cd-4f54-945a-55963132f6c8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:21.008073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1146/2290] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:16:21.012064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59311-2d9b-4163-9935-3746f555db9c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:21.023926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59311-2d9b-4163-9935-3746f555db9c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:21.029112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240268a-7ca5-460d-ae51-182b981ee34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:21.030019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240268a-7ca5-460d-ae51-182b981ee34b admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:21.030318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240268a-7ca5-460d-ae51-182b981ee34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:21.030595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240268a-7ca5-460d-ae51-182b981ee34b admin admin] PATH_INFO: `/v3/projects/2b49ab14c77242c0a44158dc9ebd5d49/users/e2c9d3e5364146e4b44afe55858ff266/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:21.032615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240268a-7ca5-460d-ae51-182b981ee34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b49ab14c77242c0a44158dc9ebd5d49, user_id=e2c9d3e5364146e4b44afe55858ff266, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:21.035335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240268a-7ca5-460d-ae51-182b981ee34b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:21.046667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1145/2291] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:16:21 2022] PUT /identity/v3/projects/2b49ab14c77242c0a44158dc9ebd5d49/users/e2c9d3e5364146e4b44afe55858ff266/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:16:21.057798 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90431e82-71a5-491d-84ac-7d6bfea56dce None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:21.058160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90431e82-71a5-491d-84ac-7d6bfea56dce None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:21.058539 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90431e82-71a5-491d-84ac-7d6bfea56dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:21.084541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-90431e82-71a5-491d-84ac-7d6bfea56dce None None] MFA Rules not processed for user `e2c9d3e5364146e4b44afe55858ff266`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:21.086314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-90431e82-71a5-491d-84ac-7d6bfea56dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:21.154954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1147/2292] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:16:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:21.166428 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240268a-7ca5-460d-ae51-182b981ee34b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:21.168126 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6240268a-7ca5-460d-ae51-182b981ee34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:21.226373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240268a-7ca5-460d-ae51-182b981ee34b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:21.230061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68426-4de5-494b-90ac-e373517788ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:21.230734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68426-4de5-494b-90ac-e373517788ca service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:21.231016 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68426-4de5-494b-90ac-e373517788ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:21.231293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68426-4de5-494b-90ac-e373517788ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:21.286513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea68426-4de5-494b-90ac-e373517788ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:21.287866 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea68426-4de5-494b-90ac-e373517788ca service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:21.297124 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1146/2293] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:16:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:16:24.445660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90431e82-71a5-491d-84ac-7d6bfea56dce None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:24.447040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-90431e82-71a5-491d-84ac-7d6bfea56dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:24.458534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90431e82-71a5-491d-84ac-7d6bfea56dce None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:24.462037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b9cfb-ecae-4c06-98d5-4ceb30060c68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:24.462668 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b9cfb-ecae-4c06-98d5-4ceb30060c68 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:24.462949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b9cfb-ecae-4c06-98d5-4ceb30060c68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:24.463222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b9cfb-ecae-4c06-98d5-4ceb30060c68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:24.471552 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:24.519396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b9cfb-ecae-4c06-98d5-4ceb30060c68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:24.520888 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b9cfb-ecae-4c06-98d5-4ceb30060c68 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:24.529754 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1148/2294] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:16:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:16:26.364212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68426-4de5-494b-90ac-e373517788ca service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:26.373347 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68426-4de5-494b-90ac-e373517788ca service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:26.377238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393d5fc-8197-4ac4-9731-5f6b94b6492d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:26.378011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393d5fc-8197-4ac4-9731-5f6b94b6492d service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:26.378364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393d5fc-8197-4ac4-9731-5f6b94b6492d service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:26.378728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393d5fc-8197-4ac4-9731-5f6b94b6492d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:26.394492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393d5fc-8197-4ac4-9731-5f6b94b6492d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:26.395962 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393d5fc-8197-4ac4-9731-5f6b94b6492d service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:26.406074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1147/2295] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:16:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:16:34.756036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=23 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:36.401782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=62,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:37.934003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b9cfb-ecae-4c06-98d5-4ceb30060c68 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:37.935418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d11b9cfb-ecae-4c06-98d5-4ceb30060c68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:37.993916 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b9cfb-ecae-4c06-98d5-4ceb30060c68 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:37.997545 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceff52-f9b7-4c6b-9d9a-fdbe4d23e5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:37.998192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceff52-f9b7-4c6b-9d9a-fdbe4d23e5fb service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:37.998491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceff52-f9b7-4c6b-9d9a-fdbe4d23e5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:37.998759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceff52-f9b7-4c6b-9d9a-fdbe4d23e5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:38.001061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-aaceff52-f9b7-4c6b-9d9a-fdbe4d23e5fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:38.067573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaceff52-f9b7-4c6b-9d9a-fdbe4d23e5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:38.069060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaceff52-f9b7-4c6b-9d9a-fdbe4d23e5fb service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:38.079753 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1149/2296] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:39.484241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216cb5e-b6f6-4969-9df9-7820a75468a2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:39.484959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216cb5e-b6f6-4969-9df9-7820a75468a2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:39.484959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216cb5e-b6f6-4969-9df9-7820a75468a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:39.533254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8216cb5e-b6f6-4969-9df9-7820a75468a2 None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:39.534469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8216cb5e-b6f6-4969-9df9-7820a75468a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:39.604819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1148/2297] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:17:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:39.784652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceff52-f9b7-4c6b-9d9a-fdbe4d23e5fb service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:39.790021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-aaceff52-f9b7-4c6b-9d9a-fdbe4d23e5fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:39.878532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceff52-f9b7-4c6b-9d9a-fdbe4d23e5fb service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:39.883907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2985970-de15-4ee3-be5f-b20361c27788 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:39.884597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2985970-de15-4ee3-be5f-b20361c27788 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:39.884925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2985970-de15-4ee3-be5f-b20361c27788 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:39.885188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2985970-de15-4ee3-be5f-b20361c27788 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:39.893760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2985970-de15-4ee3-be5f-b20361c27788 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:39.895346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2985970-de15-4ee3-be5f-b20361c27788 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:39.904064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1150/2298] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:17:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:17:49.600499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=40 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:49.900794 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:51.417614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216cb5e-b6f6-4969-9df9-7820a75468a2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:51.419215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8216cb5e-b6f6-4969-9df9-7820a75468a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:51.432845 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216cb5e-b6f6-4969-9df9-7820a75468a2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:51.436625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fca684-ab87-40a9-97bf-3aa2ac30a361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:51.437298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fca684-ab87-40a9-97bf-3aa2ac30a361 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:51.437581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fca684-ab87-40a9-97bf-3aa2ac30a361 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:51.437855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fca684-ab87-40a9-97bf-3aa2ac30a361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:51.439640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-29fca684-ab87-40a9-97bf-3aa2ac30a361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:51.531057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fca684-ab87-40a9-97bf-3aa2ac30a361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:51.533272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fca684-ab87-40a9-97bf-3aa2ac30a361 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:51.557360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1149/2299] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:52.741873 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2985970-de15-4ee3-be5f-b20361c27788 service swift] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:52.751678 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2985970-de15-4ee3-be5f-b20361c27788 service swift] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:52.756929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f155d3-4a11-4605-80f8-9e0906f11647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:52.757582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f155d3-4a11-4605-80f8-9e0906f11647 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:52.757866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f155d3-4a11-4605-80f8-9e0906f11647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:52.758745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f155d3-4a11-4605-80f8-9e0906f11647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:52.760524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-08f155d3-4a11-4605-80f8-9e0906f11647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:52.774328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f155d3-4a11-4605-80f8-9e0906f11647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:52.775746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f155d3-4a11-4605-80f8-9e0906f11647 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:52.786519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1151/2300] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:59.177361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1a4f-48fe-406a-b376-7c315e5519cf None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.177361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1a4f-48fe-406a-b376-7c315e5519cf None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.177361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1a4f-48fe-406a-b376-7c315e5519cf None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.177361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1150/2301] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 23 13:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:17:59.182011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e21466-e456-4992-bcae-45b3f229bde3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.182440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e21466-e456-4992-bcae-45b3f229bde3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.182570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e21466-e456-4992-bcae-45b3f229bde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.224303 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-38e21466-e456-4992-bcae-45b3f229bde3 None None] MFA Rules not processed for user `5874e98df57242028c0f9983dee3b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:59.224676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-38e21466-e456-4992-bcae-45b3f229bde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:59.234046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1152/2302] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 23 13:17:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:59.245976 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e1a4f-48fe-406a-b376-7c315e5519cf None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:59.247681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-300e1a4f-48fe-406a-b376-7c315e5519cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:59.331435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e1a4f-48fe-406a-b376-7c315e5519cf None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:59.335086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563be44-0f31-4712-846b-696670a61312 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '711d53a7deb94849b577c08dc9165ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:59.335727 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563be44-0f31-4712-846b-696670a61312 service glance] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.336011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563be44-0f31-4712-846b-696670a61312 service glance] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.336285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563be44-0f31-4712-846b-696670a61312 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.346680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563be44-0f31-4712-846b-696670a61312 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:59.348096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563be44-0f31-4712-846b-696670a61312 service glance] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:59.358984 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1151/2303] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:59.591052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a4e91-1300-4c34-8d91-b65706f27e1c None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.591346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a4e91-1300-4c34-8d91-b65706f27e1c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.591627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a4e91-1300-4c34-8d91-b65706f27e1c None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.593217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1153/2304] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 23 13:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:17:59.598324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14510951-ad46-4e5b-b5ac-ba11c256afc5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.605139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14510951-ad46-4e5b-b5ac-ba11c256afc5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.605139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14510951-ad46-4e5b-b5ac-ba11c256afc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.617771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-14510951-ad46-4e5b-b5ac-ba11c256afc5 None None] MFA Rules not processed for user `b1eb257517674c63840d6a2090eb2200`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:59.618952 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-14510951-ad46-4e5b-b5ac-ba11c256afc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:59.625577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1152/2305] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 23 13:17:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:17:59.637021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a4e91-1300-4c34-8d91-b65706f27e1c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:59.648065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a4e91-1300-4c34-8d91-b65706f27e1c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:59.651464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac185edf-1756-4529-b4b8-27b77e9c2723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:59.652118 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac185edf-1756-4529-b4b8-27b77e9c2723 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.652401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac185edf-1756-4529-b4b8-27b77e9c2723 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.652699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac185edf-1756-4529-b4b8-27b77e9c2723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.660119 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac185edf-1756-4529-b4b8-27b77e9c2723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:59.661563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac185edf-1756-4529-b4b8-27b77e9c2723 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:59.669181 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1154/2306] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:59.754807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5756a-4465-44b7-b692-4d4c97df969a None None] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.755227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5756a-4465-44b7-b692-4d4c97df969a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.755609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5756a-4465-44b7-b692-4d4c97df969a None None] PATH_INFO: `/` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.757085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1153/2307] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 23 13:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:17:59.762573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834555e-0b64-4de8-b3cd-4c1ddf5afcd4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.762868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834555e-0b64-4de8-b3cd-4c1ddf5afcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.763147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834555e-0b64-4de8-b3cd-4c1ddf5afcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.782525 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4834555e-0b64-4de8-b3cd-4c1ddf5afcd4 None None] MFA Rules not processed for user `5874e98df57242028c0f9983dee3b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:59.783725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4834555e-0b64-4de8-b3cd-4c1ddf5afcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:59.792973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1155/2308] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 23 13:17:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:59.803696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5756a-4465-44b7-b692-4d4c97df969a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:59.814413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5756a-4465-44b7-b692-4d4c97df969a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:59.817940 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec6738-4959-44d0-a470-e44a392ad75c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:59.818560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec6738-4959-44d0-a470-e44a392ad75c service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.818841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec6738-4959-44d0-a470-e44a392ad75c service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.819119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec6738-4959-44d0-a470-e44a392ad75c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.828951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec6738-4959-44d0-a470-e44a392ad75c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:59.830374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec6738-4959-44d0-a470-e44a392ad75c service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:59.840761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1154/2309] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:03.843803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834555e-0b64-4de8-b3cd-4c1ddf5afcd4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:03.845353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4834555e-0b64-4de8-b3cd-4c1ddf5afcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:03.859121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834555e-0b64-4de8-b3cd-4c1ddf5afcd4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:03.865215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23e6d0-0f79-42f0-80b3-69ac2bbf3697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:03.865886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23e6d0-0f79-42f0-80b3-69ac2bbf3697 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:03.866172 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23e6d0-0f79-42f0-80b3-69ac2bbf3697 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:03.866445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23e6d0-0f79-42f0-80b3-69ac2bbf3697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:03.868158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cc23e6d0-0f79-42f0-80b3-69ac2bbf3697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:03.925462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23e6d0-0f79-42f0-80b3-69ac2bbf3697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:03.927290 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23e6d0-0f79-42f0-80b3-69ac2bbf3697 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:03.937449 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1156/2310] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:06.270083 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec6738-4959-44d0-a470-e44a392ad75c service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:06.281946 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec6738-4959-44d0-a470-e44a392ad75c service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:06.287212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395eb74e-89a6-4231-a945-d140be6bb579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:06.287882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eb74e-89a6-4231-a945-d140be6bb579 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:06.288166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eb74e-89a6-4231-a945-d140be6bb579 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:06.288445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eb74e-89a6-4231-a945-d140be6bb579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:06.290262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-395eb74e-89a6-4231-a945-d140be6bb579 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:06.317722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:06.351811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395eb74e-89a6-4231-a945-d140be6bb579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:06.353489 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395eb74e-89a6-4231-a945-d140be6bb579 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:06.364721 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1155/2311] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:13.933076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=52 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:16.360283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=15 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:16.694719 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23e6d0-0f79-42f0-80b3-69ac2bbf3697 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:16.703913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23e6d0-0f79-42f0-80b3-69ac2bbf3697 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:16.707494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a04742-16cc-487d-83d2-598bd3430cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:16.708624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a04742-16cc-487d-83d2-598bd3430cad service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:16.708933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a04742-16cc-487d-83d2-598bd3430cad service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:16.709203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a04742-16cc-487d-83d2-598bd3430cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:16.710952 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-40a04742-16cc-487d-83d2-598bd3430cad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:16.720111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a04742-16cc-487d-83d2-598bd3430cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:16.721588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a04742-16cc-487d-83d2-598bd3430cad service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:16.730177 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1157/2312] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:26.727031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:35.987499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395eb74e-89a6-4231-a945-d140be6bb579 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:35.989204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-395eb74e-89a6-4231-a945-d140be6bb579 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:36.029392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395eb74e-89a6-4231-a945-d140be6bb579 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:36.041972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85480552-6539-4698-a43a-8cb0d8bde629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:36.043034 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85480552-6539-4698-a43a-8cb0d8bde629 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:36.045201 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85480552-6539-4698-a43a-8cb0d8bde629 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:36.045804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85480552-6539-4698-a43a-8cb0d8bde629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:36.049322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-85480552-6539-4698-a43a-8cb0d8bde629 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:36.088550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85480552-6539-4698-a43a-8cb0d8bde629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:36.092227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85480552-6539-4698-a43a-8cb0d8bde629 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:36.127981 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1156/2313] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:37.397299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a04742-16cc-487d-83d2-598bd3430cad service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:37.406689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a04742-16cc-487d-83d2-598bd3430cad service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:37.410290 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac84035-d9e4-49f6-8f18-7a6423940563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:37.410929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac84035-d9e4-49f6-8f18-7a6423940563 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:37.411214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac84035-d9e4-49f6-8f18-7a6423940563 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:37.411489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac84035-d9e4-49f6-8f18-7a6423940563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:37.413275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-bac84035-d9e4-49f6-8f18-7a6423940563 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:37.478173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac84035-d9e4-49f6-8f18-7a6423940563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:37.479719 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac84035-d9e4-49f6-8f18-7a6423940563 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:37.490382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1158/2314] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:46.111963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:47.485399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=28 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:48.395443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85480552-6539-4698-a43a-8cb0d8bde629 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:48.405391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85480552-6539-4698-a43a-8cb0d8bde629 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:48.408914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695bebe-076f-4c69-bd64-8e3ff62e32b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:48.409544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695bebe-076f-4c69-bd64-8e3ff62e32b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:48.412783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695bebe-076f-4c69-bd64-8e3ff62e32b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:48.412783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695bebe-076f-4c69-bd64-8e3ff62e32b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:48.412783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1695bebe-076f-4c69-bd64-8e3ff62e32b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:48.471245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695bebe-076f-4c69-bd64-8e3ff62e32b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:48.472729 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695bebe-076f-4c69-bd64-8e3ff62e32b5 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:48.481648 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1157/2315] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:58.477441 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=28 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:32.561725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac84035-d9e4-49f6-8f18-7a6423940563 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:32.575039 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac84035-d9e4-49f6-8f18-7a6423940563 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:32.581504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafa0f5-6820-4d26-8f68-15df0846ac6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:32.590325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafa0f5-6820-4d26-8f68-15df0846ac6e service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:32.590325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafa0f5-6820-4d26-8f68-15df0846ac6e service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:32.590325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafa0f5-6820-4d26-8f68-15df0846ac6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:32.590325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-baafa0f5-6820-4d26-8f68-15df0846ac6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:32.657220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafa0f5-6820-4d26-8f68-15df0846ac6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:32.658814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafa0f5-6820-4d26-8f68-15df0846ac6e service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:32.676122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1159/2316] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:20:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:20:42.664725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=28 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:21:07.513321 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695bebe-076f-4c69-bd64-8e3ff62e32b5 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:07.521892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695bebe-076f-4c69-bd64-8e3ff62e32b5 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:07.525440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32785cf-a4fd-4df1-9e30-ce8cfdb9e801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:07.526073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32785cf-a4fd-4df1-9e30-ce8cfdb9e801 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:07.526938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32785cf-a4fd-4df1-9e30-ce8cfdb9e801 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:07.527217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32785cf-a4fd-4df1-9e30-ce8cfdb9e801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:07.529014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c32785cf-a4fd-4df1-9e30-ce8cfdb9e801 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:07.585235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32785cf-a4fd-4df1-9e30-ce8cfdb9e801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:07.586577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32785cf-a4fd-4df1-9e30-ce8cfdb9e801 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:07.596093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1158/2317] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:21:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:21:17.591960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=28 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:21:26.288029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafa0f5-6820-4d26-8f68-15df0846ac6e service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:26.297647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafa0f5-6820-4d26-8f68-15df0846ac6e service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:26.301169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76829e2-2711-4e30-a008-e586add43c0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:26.301804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76829e2-2711-4e30-a008-e586add43c0d service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:26.302093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76829e2-2711-4e30-a008-e586add43c0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:26.302408 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76829e2-2711-4e30-a008-e586add43c0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:26.312253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76829e2-2711-4e30-a008-e586add43c0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:26.313714 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76829e2-2711-4e30-a008-e586add43c0d service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:26.323385 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1160/2318] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:21:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:21:36.319081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:22:01.428977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32785cf-a4fd-4df1-9e30-ce8cfdb9e801 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:01.430376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c32785cf-a4fd-4df1-9e30-ce8cfdb9e801 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:01.496776 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32785cf-a4fd-4df1-9e30-ce8cfdb9e801 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:01.501810 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c07b8-1f2f-4726-a1ba-aa2313dcbd28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:01.502453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c07b8-1f2f-4726-a1ba-aa2313dcbd28 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:01.502736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c07b8-1f2f-4726-a1ba-aa2313dcbd28 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:01.503014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c07b8-1f2f-4726-a1ba-aa2313dcbd28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:01.504784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-699c07b8-1f2f-4726-a1ba-aa2313dcbd28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:01.516113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c07b8-1f2f-4726-a1ba-aa2313dcbd28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:01.517734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c07b8-1f2f-4726-a1ba-aa2313dcbd28 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:01.527290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1159/2319] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:22:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:22:11.523214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=32 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:22:38.845023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76829e2-2711-4e30-a008-e586add43c0d service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:38.853872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76829e2-2711-4e30-a008-e586add43c0d service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:38.857546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507d17b-c464-4512-ac24-a5bae40096be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:38.858183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507d17b-c464-4512-ac24-a5bae40096be service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:38.858466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507d17b-c464-4512-ac24-a5bae40096be service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:38.858744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507d17b-c464-4512-ac24-a5bae40096be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:38.866958 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507d17b-c464-4512-ac24-a5bae40096be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:38.868373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507d17b-c464-4512-ac24-a5bae40096be service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:38.877164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1161/2320] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:22:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:22:38.937831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c07b8-1f2f-4726-a1ba-aa2313dcbd28 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:39.000900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c07b8-1f2f-4726-a1ba-aa2313dcbd28 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:39.005317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:39.006178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:39.006940 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:39.007225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] PATH_INFO: `/v3/users/6f01fd64f4f04999bd15397804f50c22` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:39.008402 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f01fd64f4f04999bd15397804f50c22)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:39.010365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:39.169210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f01fd64f4f04999bd15397804f50c22'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:39.170185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f01fd64f4f04999bd15397804f50c22'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:39.230532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f01fd64f4f04999bd15397804f50c22'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:39.243807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f01fd64f4f04999bd15397804f50c22'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:39.253477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f01fd64f4f04999bd15397804f50c22'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:39.264186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1160/2321] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:22:38 2022] DELETE /identity/v3/users/6f01fd64f4f04999bd15397804f50c22 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:22:39.265569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d88f-b6bd-4f97-9c55-8fd642376e4a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:39.266044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d88f-b6bd-4f97-9c55-8fd642376e4a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:39.266321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d88f-b6bd-4f97-9c55-8fd642376e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:39.283675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8b50d88f-b6bd-4f97-9c55-8fd642376e4a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:22:39.284921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8b50d88f-b6bd-4f97-9c55-8fd642376e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:39.343437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1162/2322] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:22:39.353329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:39.354734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:39.412063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df6861-ddc8-4ab1-92ae-a6512ee9be33 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:39.415753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd924869-d821-40d6-b33c-cec8d22e53c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:39.416402 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd924869-d821-40d6-b33c-cec8d22e53c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:39.416782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd924869-d821-40d6-b33c-cec8d22e53c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:39.417074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd924869-d821-40d6-b33c-cec8d22e53c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:39.426163 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd924869-d821-40d6-b33c-cec8d22e53c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:39.427534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd924869-d821-40d6-b33c-cec8d22e53c4 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:39.437566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1161/2323] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:22:39.876875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d88f-b6bd-4f97-9c55-8fd642376e4a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:39.878397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8b50d88f-b6bd-4f97-9c55-8fd642376e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:39.890803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d88f-b6bd-4f97-9c55-8fd642376e4a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:39.895980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:39.896941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:39.897729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:39.898005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] PATH_INFO: `/v3/projects/a54c956210304706a0615d276a6a6ec5` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:39.899405 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54c956210304706a0615d276a6a6ec5)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:39.901364 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:40.013329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54c956210304706a0615d276a6a6ec5', 'request_id': 'req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:40.104209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54c956210304706a0615d276a6a6ec5', 'request_id': 'req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:40.111656 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54c956210304706a0615d276a6a6ec5', 'request_id': 'req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:40.122412 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] The token cache is being invalidate because project a54c956210304706a0615d276a6a6ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:22:40.122706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:40.123349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:40.124922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1163/2324] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:22:39 2022] DELETE /identity/v3/projects/a54c956210304706a0615d276a6a6ec5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:22:40.128986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd924869-d821-40d6-b33c-cec8d22e53c4 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:40.139622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd924869-d821-40d6-b33c-cec8d22e53c4 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:40.161055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:22:40.198987 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:40.199855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:40.200142 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:40.200418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] PATH_INFO: `/v3/users/b02de6b00a3a43bfa3aba499174f0bf0` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:40.201634 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02de6b00a3a43bfa3aba499174f0bf0)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:40.203535 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:40.375261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02de6b00a3a43bfa3aba499174f0bf0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:40.375947 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02de6b00a3a43bfa3aba499174f0bf0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:40.440791 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02de6b00a3a43bfa3aba499174f0bf0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:40.453122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02de6b00a3a43bfa3aba499174f0bf0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:40.459833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02de6b00a3a43bfa3aba499174f0bf0'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:40.465726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1162/2325] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:22:40 2022] DELETE /identity/v3/users/b02de6b00a3a43bfa3aba499174f0bf0 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:22:40.893955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:40.895538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:40.910905 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f7c10-7e53-4232-88d1-c8fe34cd4dd9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:40.968117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:40.969008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:40.969294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:40.969574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] PATH_INFO: `/v3/projects/9b0da3332de14ffb9eca8e0ca8687643` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:40.970769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0da3332de14ffb9eca8e0ca8687643)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:40.972672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:40.983622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:22:41.105279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0da3332de14ffb9eca8e0ca8687643', 'request_id': 'req-72e74dd2-4241-4edf-8aec-720742be05aa'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:41.200981 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0da3332de14ffb9eca8e0ca8687643', 'request_id': 'req-72e74dd2-4241-4edf-8aec-720742be05aa'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:41.207584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0da3332de14ffb9eca8e0ca8687643', 'request_id': 'req-72e74dd2-4241-4edf-8aec-720742be05aa'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:41.218484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] The token cache is being invalidate because project 9b0da3332de14ffb9eca8e0ca8687643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:22:41.218768 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:41.219422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:41.220997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1164/2326] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:22:40 2022] DELETE /identity/v3/projects/9b0da3332de14ffb9eca8e0ca8687643 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:22:41.224864 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:41.226263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:41.238930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237ff13-e7fc-4fcc-a125-2226a175ab41 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:41.293915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:41.294778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:41.295057 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:41.295331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] PATH_INFO: `/v3/users/e2c9d3e5364146e4b44afe55858ff266` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:41.296502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c9d3e5364146e4b44afe55858ff266)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:41.298449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:41.469966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:22:41.472543 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c9d3e5364146e4b44afe55858ff266'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:41.473260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c9d3e5364146e4b44afe55858ff266'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:41.548622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c9d3e5364146e4b44afe55858ff266'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:41.562103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c9d3e5364146e4b44afe55858ff266'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:41.569433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c9d3e5364146e4b44afe55858ff266'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:41.576475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1163/2327] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:22:41 2022] DELETE /identity/v3/users/e2c9d3e5364146e4b44afe55858ff266 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:22:41.961828 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:41.963359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:41.976713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74dd2-4241-4edf-8aec-720742be05aa admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:42.033726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:42.034582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:42.034865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:42.035138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] PATH_INFO: `/v3/projects/2b49ab14c77242c0a44158dc9ebd5d49` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:42.036305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b49ab14c77242c0a44158dc9ebd5d49)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:42.038890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:42.172874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b49ab14c77242c0a44158dc9ebd5d49', 'request_id': 'req-7b98bb18-8082-4d02-97d2-71873cbf60fa'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:42.229629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b49ab14c77242c0a44158dc9ebd5d49', 'request_id': 'req-7b98bb18-8082-4d02-97d2-71873cbf60fa'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:42.236499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b49ab14c77242c0a44158dc9ebd5d49', 'request_id': 'req-7b98bb18-8082-4d02-97d2-71873cbf60fa'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:42.247849 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] The token cache is being invalidate because project 2b49ab14c77242c0a44158dc9ebd5d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:22:42.248317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:42.249239 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:42.250841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1165/2328] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:22:41 2022] DELETE /identity/v3/projects/2b49ab14c77242c0a44158dc9ebd5d49 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:22:51.607765 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=4,keystone:SELECT=13,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:22:51.983772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:51.985255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:52.041290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e7b5-3638-4c14-ac7c-bf6a9d196866 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:52.089024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f079c1a-9cdb-4097-a2e8-c1e4b5c7849c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:52.089673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f079c1a-9cdb-4097-a2e8-c1e4b5c7849c service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:52.089955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f079c1a-9cdb-4097-a2e8-c1e4b5c7849c service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:52.090286 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f079c1a-9cdb-4097-a2e8-c1e4b5c7849c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:52.092086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3f079c1a-9cdb-4097-a2e8-c1e4b5c7849c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:52.159955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f079c1a-9cdb-4097-a2e8-c1e4b5c7849c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:52.161400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f079c1a-9cdb-4097-a2e8-c1e4b5c7849c service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:52.172477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1164/2329] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:22:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:22:52.244411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=70,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:23:02.167747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=74 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:23:02.641783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:23:02.643276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:23:02.661430 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98bb18-8082-4d02-97d2-71873cbf60fa admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:23:02.666810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f44e73-d775-4be3-b8fd-cdf49a4f9594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:23:02.667460 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f44e73-d775-4be3-b8fd-cdf49a4f9594 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:23:02.667744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f44e73-d775-4be3-b8fd-cdf49a4f9594 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:23:02.668021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f44e73-d775-4be3-b8fd-cdf49a4f9594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:23:02.669814 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-67f44e73-d775-4be3-b8fd-cdf49a4f9594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:23:02.747193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f44e73-d775-4be3-b8fd-cdf49a4f9594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:23:02.748822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f44e73-d775-4be3-b8fd-cdf49a4f9594 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:23:02.757877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1166/2330] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:23:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:23:06.005760 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f079c1a-9cdb-4097-a2e8-c1e4b5c7849c service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:23:06.007139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3f079c1a-9cdb-4097-a2e8-c1e4b5c7849c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:23:06.062361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f079c1a-9cdb-4097-a2e8-c1e4b5c7849c service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:23:06.065985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465d31a-ae5c-45c8-bd74-a2dd8c186228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:23:06.066632 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465d31a-ae5c-45c8-bd74-a2dd8c186228 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:23:06.066915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465d31a-ae5c-45c8-bd74-a2dd8c186228 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:23:06.067193 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465d31a-ae5c-45c8-bd74-a2dd8c186228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:23:06.068973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9465d31a-ae5c-45c8-bd74-a2dd8c186228 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:23:06.148011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465d31a-ae5c-45c8-bd74-a2dd8c186228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:23:06.149500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465d31a-ae5c-45c8-bd74-a2dd8c186228 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:23:06.168198 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1165/2331] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:23:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:23:12.753610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=37 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:23:16.164951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=61 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:23:59.266052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f44e73-d775-4be3-b8fd-cdf49a4f9594 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:23:59.275294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f44e73-d775-4be3-b8fd-cdf49a4f9594 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:23:59.279083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d919b1d-b310-47e2-af75-332dcdad94cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:23:59.279713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d919b1d-b310-47e2-af75-332dcdad94cd service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:23:59.279994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d919b1d-b310-47e2-af75-332dcdad94cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:23:59.280269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d919b1d-b310-47e2-af75-332dcdad94cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:23:59.282058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4d919b1d-b310-47e2-af75-332dcdad94cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:23:59.296253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d919b1d-b310-47e2-af75-332dcdad94cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:23:59.297768 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d919b1d-b310-47e2-af75-332dcdad94cd service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:23:59.309067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1167/2332] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:23:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:24:00.100534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bec60-0038-4b8a-a3a2-dfe9f84a2433 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:00.101059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bec60-0038-4b8a-a3a2-dfe9f84a2433 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:00.101169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bec60-0038-4b8a-a3a2-dfe9f84a2433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:00.119823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-148bec60-0038-4b8a-a3a2-dfe9f84a2433 None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:24:00.121074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-148bec60-0038-4b8a-a3a2-dfe9f84a2433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:00.177015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1166/2333] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jun 23 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:24:00.370260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d919b1d-b310-47e2-af75-332dcdad94cd service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:24:00.371791 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4d919b1d-b310-47e2-af75-332dcdad94cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:00.439225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d919b1d-b310-47e2-af75-332dcdad94cd service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:24:00.444171 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dde40-187c-4c7d-aeb8-26e578ea9f35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:24:00.444851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dde40-187c-4c7d-aeb8-26e578ea9f35 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:00.445141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dde40-187c-4c7d-aeb8-26e578ea9f35 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:00.445421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dde40-187c-4c7d-aeb8-26e578ea9f35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:00.453366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dde40-187c-4c7d-aeb8-26e578ea9f35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:24:00.454951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dde40-187c-4c7d-aeb8-26e578ea9f35 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:24:00.462932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1168/2334] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:24:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:24:02.676326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bec60-0038-4b8a-a3a2-dfe9f84a2433 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:24:02.693071 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bec60-0038-4b8a-a3a2-dfe9f84a2433 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:24:02.707374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d56aa1-e1af-432b-9533-3230478380ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:24:02.708065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56aa1-e1af-432b-9533-3230478380ba service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:02.708409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56aa1-e1af-432b-9533-3230478380ba service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:02.708735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56aa1-e1af-432b-9533-3230478380ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:02.710748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a4d56aa1-e1af-432b-9533-3230478380ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:02.724210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d56aa1-e1af-432b-9533-3230478380ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:24:02.725963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d56aa1-e1af-432b-9533-3230478380ba service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:24:02.739704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1167/2335] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:24:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:24:03.313875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475a774-952c-4c85-9da1-2f61866cbde5 None None] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:03.314334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475a774-952c-4c85-9da1-2f61866cbde5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:03.314430 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475a774-952c-4c85-9da1-2f61866cbde5 None None] PATH_INFO: `/` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:03.316037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1169/2336] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jun 23 13:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:24:03.322495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11be56-1b1f-4f71-89f3-daeb1905147e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:03.322779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11be56-1b1f-4f71-89f3-daeb1905147e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:03.323066 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11be56-1b1f-4f71-89f3-daeb1905147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:03.361971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8e11be56-1b1f-4f71-89f3-daeb1905147e None None] MFA Rules not processed for user `8644754798b5439c954c86dc9aa9e7af`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:24:03.364042 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8e11be56-1b1f-4f71-89f3-daeb1905147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:03.514382 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1168/2337] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:24:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:24:03.549029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475a774-952c-4c85-9da1-2f61866cbde5 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:24:03.552150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d475a774-952c-4c85-9da1-2f61866cbde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:03.571643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475a774-952c-4c85-9da1-2f61866cbde5 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:24:03.578002 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a770bee-a306-428f-88a2-20fd86e3ff32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:24:03.579061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a770bee-a306-428f-88a2-20fd86e3ff32 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:03.580867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a770bee-a306-428f-88a2-20fd86e3ff32 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:03.580867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a770bee-a306-428f-88a2-20fd86e3ff32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:03.592102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a770bee-a306-428f-88a2-20fd86e3ff32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:24:03.594718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a770bee-a306-428f-88a2-20fd86e3ff32 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:24:03.611655 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1170/2338] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:24:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:24:08.006801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab860b5-e68b-4e22-af5e-cfe407d312f0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:08.007319 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab860b5-e68b-4e22-af5e-cfe407d312f0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:08.007458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab860b5-e68b-4e22-af5e-cfe407d312f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:08.034657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4ab860b5-e68b-4e22-af5e-cfe407d312f0 None None] MFA Rules not processed for user `7d740fb903c24d8f851fe03e05cb8afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:24:08.035873 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4ab860b5-e68b-4e22-af5e-cfe407d312f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:08.052731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1169/2339] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:24:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:24:08.438374 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a770bee-a306-428f-88a2-20fd86e3ff32 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:24:08.439836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4a770bee-a306-428f-88a2-20fd86e3ff32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:08.451869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a770bee-a306-428f-88a2-20fd86e3ff32 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:24:08.455528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057a27f-0484-40a2-a02c-ed6c525be72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:24:08.456175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057a27f-0484-40a2-a02c-ed6c525be72c service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:08.456464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057a27f-0484-40a2-a02c-ed6c525be72c service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:08.456782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057a27f-0484-40a2-a02c-ed6c525be72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:08.458583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1057a27f-0484-40a2-a02c-ed6c525be72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:08.469421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057a27f-0484-40a2-a02c-ed6c525be72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:24:08.470818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057a27f-0484-40a2-a02c-ed6c525be72c service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:24:08.479287 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1171/2340] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:24:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:24:08.611980 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab860b5-e68b-4e22-af5e-cfe407d312f0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:24:08.622951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab860b5-e68b-4e22-af5e-cfe407d312f0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:24:08.626979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf5a4d-0072-472d-b140-5531ba5746d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:24:08.629114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf5a4d-0072-472d-b140-5531ba5746d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:08.629497 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf5a4d-0072-472d-b140-5531ba5746d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:08.629855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf5a4d-0072-472d-b140-5531ba5746d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:08.631799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f7bf5a4d-0072-472d-b140-5531ba5746d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:08.642323 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf5a4d-0072-472d-b140-5531ba5746d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:24:08.643930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf5a4d-0072-472d-b140-5531ba5746d3 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:24:08.661485 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1170/2341] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:24:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:24:08.699232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e44d9-18d4-48cf-907b-96e81f4415e3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:08.699528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e44d9-18d4-48cf-907b-96e81f4415e3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:08.699999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e44d9-18d4-48cf-907b-96e81f4415e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:08.722166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-621e44d9-18d4-48cf-907b-96e81f4415e3 None None] MFA Rules not processed for user `fc8869f1b56b46e1844d5f7937fc8986`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:24:08.723478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-621e44d9-18d4-48cf-907b-96e81f4415e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:08.788871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1172/2342] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:24:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:24:09.108946 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf5a4d-0072-472d-b140-5531ba5746d3 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:24:09.110408 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f7bf5a4d-0072-472d-b140-5531ba5746d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:09.121050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf5a4d-0072-472d-b140-5531ba5746d3 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:24:09.124833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df86c00-fb81-4d9f-abc2-5a42bc94b2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:24:09.125489 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df86c00-fb81-4d9f-abc2-5a42bc94b2ce service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:09.125773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df86c00-fb81-4d9f-abc2-5a42bc94b2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:09.126050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df86c00-fb81-4d9f-abc2-5a42bc94b2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:09.127833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3df86c00-fb81-4d9f-abc2-5a42bc94b2ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:09.137957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df86c00-fb81-4d9f-abc2-5a42bc94b2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:24:09.139982 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df86c00-fb81-4d9f-abc2-5a42bc94b2ce service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:24:09.148384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1171/2343] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:24:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:24:09.633674 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e44d9-18d4-48cf-907b-96e81f4415e3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:24:09.649953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e44d9-18d4-48cf-907b-96e81f4415e3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:24:09.661177 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436c57c-ad20-4440-845c-efc902d3c754 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:24:09.661895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436c57c-ad20-4440-845c-efc902d3c754 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:09.662358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436c57c-ad20-4440-845c-efc902d3c754 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:09.662827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436c57c-ad20-4440-845c-efc902d3c754 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:09.664999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7436c57c-ad20-4440-845c-efc902d3c754 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:09.678790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436c57c-ad20-4440-845c-efc902d3c754 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:24:09.680421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436c57c-ad20-4440-845c-efc902d3c754 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:24:09.693727 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1173/2344] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:24:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:24:19.144438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=82 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:24:19.687069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=81 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:24:21.179858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df86c00-fb81-4d9f-abc2-5a42bc94b2ce service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:24:21.196087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df86c00-fb81-4d9f-abc2-5a42bc94b2ce service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:24:21.203991 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265faa6f-86c5-48c7-bf42-fbd1642657be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:24:21.204796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265faa6f-86c5-48c7-bf42-fbd1642657be service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:21.205082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265faa6f-86c5-48c7-bf42-fbd1642657be service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:21.205388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265faa6f-86c5-48c7-bf42-fbd1642657be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:21.207244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-265faa6f-86c5-48c7-bf42-fbd1642657be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:21.222040 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265faa6f-86c5-48c7-bf42-fbd1642657be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:24:21.223637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265faa6f-86c5-48c7-bf42-fbd1642657be service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:24:21.235934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1172/2345] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:24:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:24:31.230254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:24:38.373565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436c57c-ad20-4440-845c-efc902d3c754 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:24:38.375002 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7436c57c-ad20-4440-845c-efc902d3c754 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:38.386136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436c57c-ad20-4440-845c-efc902d3c754 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:24:38.389650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883df15-2c43-4327-afd1-465977e55374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:24:38.390788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883df15-2c43-4327-afd1-465977e55374 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:24:38.391068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883df15-2c43-4327-afd1-465977e55374 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:24:38.391340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883df15-2c43-4327-afd1-465977e55374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:24:38.393060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c883df15-2c43-4327-afd1-465977e55374 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:24:38.471286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883df15-2c43-4327-afd1-465977e55374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:24:38.472749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883df15-2c43-4327-afd1-465977e55374 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:24:38.491629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1174/2346] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:24:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:24:48.489017 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=41 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:33.727782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265faa6f-86c5-48c7-bf42-fbd1642657be service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:33.770110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265faa6f-86c5-48c7-bf42-fbd1642657be service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:33.776343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15097360-a7de-4781-bef6-e70269a450b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:33.777024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15097360-a7de-4781-bef6-e70269a450b1 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:33.777329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15097360-a7de-4781-bef6-e70269a450b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:33.777596 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15097360-a7de-4781-bef6-e70269a450b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:33.779387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-15097360-a7de-4781-bef6-e70269a450b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:33.866155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15097360-a7de-4781-bef6-e70269a450b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:33.867742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15097360-a7de-4781-bef6-e70269a450b1 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:33.886121 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1173/2347] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:25:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:25:43.883514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=59 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:44.455055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883df15-2c43-4327-afd1-465977e55374 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:44.489054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883df15-2c43-4327-afd1-465977e55374 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:44.494965 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6847f6-bfdf-40bb-80d9-f79aadc62cb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:44.495607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6847f6-bfdf-40bb-80d9-f79aadc62cb5 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:44.495890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6847f6-bfdf-40bb-80d9-f79aadc62cb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:44.496164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6847f6-bfdf-40bb-80d9-f79aadc62cb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:44.497906 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3b6847f6-bfdf-40bb-80d9-f79aadc62cb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:44.529933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6847f6-bfdf-40bb-80d9-f79aadc62cb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:44.531499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6847f6-bfdf-40bb-80d9-f79aadc62cb5 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:44.549074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1175/2348] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:25:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:25:54.546448 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=30 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:26:07.348136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15097360-a7de-4781-bef6-e70269a450b1 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:26:07.374754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15097360-a7de-4781-bef6-e70269a450b1 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:26:07.378390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61833f4-3711-4ff6-859f-3ac910c1bb98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:26:07.379024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61833f4-3711-4ff6-859f-3ac910c1bb98 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:26:07.379310 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61833f4-3711-4ff6-859f-3ac910c1bb98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:26:07.379585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61833f4-3711-4ff6-859f-3ac910c1bb98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:26:07.381366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b61833f4-3711-4ff6-859f-3ac910c1bb98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:26:07.458682 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61833f4-3711-4ff6-859f-3ac910c1bb98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:26:07.460821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61833f4-3711-4ff6-859f-3ac910c1bb98 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:26:07.478337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1174/2349] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:26:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:26:17.476139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=48 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:27:07.485267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6847f6-bfdf-40bb-80d9-f79aadc62cb5 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:27:07.505878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6847f6-bfdf-40bb-80d9-f79aadc62cb5 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:27:07.511320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4faf22-0abc-4c0d-90d4-ec18ec56bf56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:27:07.511506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4faf22-0abc-4c0d-90d4-ec18ec56bf56 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:27:07.511796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4faf22-0abc-4c0d-90d4-ec18ec56bf56 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:27:07.512069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4faf22-0abc-4c0d-90d4-ec18ec56bf56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:27:07.513861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4f4faf22-0abc-4c0d-90d4-ec18ec56bf56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:27:07.537708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4faf22-0abc-4c0d-90d4-ec18ec56bf56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:27:07.539291 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4faf22-0abc-4c0d-90d4-ec18ec56bf56 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:27:07.549686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1176/2350] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:27:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:27:17.545362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=15 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:03.125159 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61833f4-3711-4ff6-859f-3ac910c1bb98 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:03.133472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61833f4-3711-4ff6-859f-3ac910c1bb98 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:03.137102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8170-10eb-4492-ae88-54a4f3428e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:03.137738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8170-10eb-4492-ae88-54a4f3428e3e service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:03.138554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8170-10eb-4492-ae88-54a4f3428e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:03.138831 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8170-10eb-4492-ae88-54a4f3428e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:03.147094 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f8170-10eb-4492-ae88-54a4f3428e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:03.148506 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f8170-10eb-4492-ae88-54a4f3428e3e service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:03.158277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1175/2351] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:28:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:28:07.296031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4faf22-0abc-4c0d-90d4-ec18ec56bf56 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:07.305531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4faf22-0abc-4c0d-90d4-ec18ec56bf56 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:07.309170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7dd60-68f4-420d-b284-9d21d10c032a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:07.309837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7dd60-68f4-420d-b284-9d21d10c032a service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:07.310126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7dd60-68f4-420d-b284-9d21d10c032a service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:07.310405 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7dd60-68f4-420d-b284-9d21d10c032a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:07.318880 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7dd60-68f4-420d-b284-9d21d10c032a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:07.320319 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7dd60-68f4-420d-b284-9d21d10c032a service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:07.329583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1177/2352] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:28:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:28:07.566593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8170-10eb-4492-ae88-54a4f3428e3e service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:07.568030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-583f8170-10eb-4492-ae88-54a4f3428e3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:07.662398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8170-10eb-4492-ae88-54a4f3428e3e service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:07.666935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:07.667802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:07.668082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:07.668358 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] PATH_INFO: `/v3/users/0ab619cb3f9741ad98ae31592d46b1ca` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:07.669621 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab619cb3f9741ad98ae31592d46b1ca)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:07.671561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:07.875773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab619cb3f9741ad98ae31592d46b1ca'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:28:07.876415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab619cb3f9741ad98ae31592d46b1ca'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:28:07.954919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab619cb3f9741ad98ae31592d46b1ca'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:28:07.967579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab619cb3f9741ad98ae31592d46b1ca'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:28:07.974609 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab619cb3f9741ad98ae31592d46b1ca'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:28:07.980457 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1176/2353] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:28:07 2022] DELETE /identity/v3/users/0ab619cb3f9741ad98ae31592d46b1ca => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:28:07.985065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d550c5b-1d6b-43de-a225-86efa882224c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:07.985360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d550c5b-1d6b-43de-a225-86efa882224c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:07.985657 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d550c5b-1d6b-43de-a225-86efa882224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:08.011060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1d550c5b-1d6b-43de-a225-86efa882224c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:08.012259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1d550c5b-1d6b-43de-a225-86efa882224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:08.069263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1178/2354] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:28:08.079534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:08.081079 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:08.127011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:08.162570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bf4e2-6f7f-45af-b0cc-51997949359d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:08.166333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa0e50-19b0-46a4-b365-76c20402436b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:08.166983 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa0e50-19b0-46a4-b365-76c20402436b service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:08.167273 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa0e50-19b0-46a4-b365-76c20402436b service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:08.167557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa0e50-19b0-46a4-b365-76c20402436b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:08.177490 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa0e50-19b0-46a4-b365-76c20402436b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:08.179396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa0e50-19b0-46a4-b365-76c20402436b service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:08.188881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1177/2355] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:28:08.635788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d550c5b-1d6b-43de-a225-86efa882224c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:08.637320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1d550c5b-1d6b-43de-a225-86efa882224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:08.649718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d550c5b-1d6b-43de-a225-86efa882224c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:08.654877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c62b7e-3b56-4f37-a62b-48936793b209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:08.655987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c62b7e-3b56-4f37-a62b-48936793b209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:08.657327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c62b7e-3b56-4f37-a62b-48936793b209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:08.657946 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c62b7e-3b56-4f37-a62b-48936793b209 admin admin] PATH_INFO: `/v3/projects/87b07c04562741da8739e3804194921a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:08.659758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c62b7e-3b56-4f37-a62b-48936793b209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b07c04562741da8739e3804194921a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:08.661858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c62b7e-3b56-4f37-a62b-48936793b209 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:08.772803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-96c62b7e-3b56-4f37-a62b-48936793b209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b07c04562741da8739e3804194921a', 'request_id': 'req-96c62b7e-3b56-4f37-a62b-48936793b209'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:28:08.822924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-96c62b7e-3b56-4f37-a62b-48936793b209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b07c04562741da8739e3804194921a', 'request_id': 'req-96c62b7e-3b56-4f37-a62b-48936793b209'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:28:08.829921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-96c62b7e-3b56-4f37-a62b-48936793b209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b07c04562741da8739e3804194921a', 'request_id': 'req-96c62b7e-3b56-4f37-a62b-48936793b209'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:28:08.840262 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-96c62b7e-3b56-4f37-a62b-48936793b209 admin admin] The token cache is being invalidate because project 87b07c04562741da8739e3804194921a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:28:08.842432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-96c62b7e-3b56-4f37-a62b-48936793b209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:28:08.842432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-96c62b7e-3b56-4f37-a62b-48936793b209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:28:08.842846 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1179/2356] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:28:08 2022] DELETE /identity/v3/projects/87b07c04562741da8739e3804194921a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:28:08.850165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0f4b1-4922-4e42-9606-69cb80ffaa47 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:08.850755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0f4b1-4922-4e42-9606-69cb80ffaa47 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:08.851346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0f4b1-4922-4e42-9606-69cb80ffaa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:08.898056 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-a5b0f4b1-4922-4e42-9606-69cb80ffaa47 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:08.899236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a5b0f4b1-4922-4e42-9606-69cb80ffaa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:08.956792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1178/2357] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:28:08.964597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f80cf-7d94-4ab9-895a-8f30689d0994 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:08.964926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f80cf-7d94-4ab9-895a-8f30689d0994 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:08.965205 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f80cf-7d94-4ab9-895a-8f30689d0994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:08.983061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-716f80cf-7d94-4ab9-895a-8f30689d0994 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:08.984280 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-716f80cf-7d94-4ab9-895a-8f30689d0994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:08.992058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1180/2358] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:28:08.996292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0f4b1-4922-4e42-9606-69cb80ffaa47 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:09.006385 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0f4b1-4922-4e42-9606-69cb80ffaa47 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:09.010960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6bd72-c26c-43fd-9007-e079f972438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:09.011612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6bd72-c26c-43fd-9007-e079f972438a admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:09.011899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6bd72-c26c-43fd-9007-e079f972438a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:09.012455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6bd72-c26c-43fd-9007-e079f972438a admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:09.013906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6bd72-c26c-43fd-9007-e079f972438a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:28:09.014218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6bd72-c26c-43fd-9007-e079f972438a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:09.015811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6bd72-c26c-43fd-9007-e079f972438a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:09.027455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1179/2359] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:28:09.031901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f80cf-7d94-4ab9-895a-8f30689d0994 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:09.041214 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f80cf-7d94-4ab9-895a-8f30689d0994 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:09.045890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54599e-06f8-41ae-a3cd-dc07a28bbb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:09.046528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54599e-06f8-41ae-a3cd-dc07a28bbb6a admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:09.046815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54599e-06f8-41ae-a3cd-dc07a28bbb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:09.047091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54599e-06f8-41ae-a3cd-dc07a28bbb6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:09.047768 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54599e-06f8-41ae-a3cd-dc07a28bbb6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:09.049712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54599e-06f8-41ae-a3cd-dc07a28bbb6a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:09.178578 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1181/2360] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:28:09 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:28:09.183048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6bd72-c26c-43fd-9007-e079f972438a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:09.194417 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6bd72-c26c-43fd-9007-e079f972438a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:09.248899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27367e10-de1c-4d60-87be-299bd6b6ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:09.249565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367e10-de1c-4d60-87be-299bd6b6ad27 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:09.250327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367e10-de1c-4d60-87be-299bd6b6ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:09.250327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367e10-de1c-4d60-87be-299bd6b6ad27 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:09.250792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27367e10-de1c-4d60-87be-299bd6b6ad27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:09.252729 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27367e10-de1c-4d60-87be-299bd6b6ad27 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:09.358973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1180/2361] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:28:09 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:28:09.361926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54599e-06f8-41ae-a3cd-dc07a28bbb6a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:09.372885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54599e-06f8-41ae-a3cd-dc07a28bbb6a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:09.380392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa1d53-4e91-4654-ac2a-754eeeec00ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:09.381176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa1d53-4e91-4654-ac2a-754eeeec00ad admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:09.386458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa1d53-4e91-4654-ac2a-754eeeec00ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:09.386458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa1d53-4e91-4654-ac2a-754eeeec00ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:09.386458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa1d53-4e91-4654-ac2a-754eeeec00ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:09.386458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa1d53-4e91-4654-ac2a-754eeeec00ad admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:09.396605 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1182/2362] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:28:09.400642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27367e10-de1c-4d60-87be-299bd6b6ad27 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:09.411171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27367e10-de1c-4d60-87be-299bd6b6ad27 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:09.415904 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8802a-caa5-442c-810a-a085ff97ef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:09.416564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8802a-caa5-442c-810a-a085ff97ef8a admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:09.416892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8802a-caa5-442c-810a-a085ff97ef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:09.417170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8802a-caa5-442c-810a-a085ff97ef8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:09.417894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8802a-caa5-442c-810a-a085ff97ef8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:09.419981 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8802a-caa5-442c-810a-a085ff97ef8a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:09.430003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1181/2363] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:28:09.434044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa1d53-4e91-4654-ac2a-754eeeec00ad admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:09.444839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa1d53-4e91-4654-ac2a-754eeeec00ad admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:09.449563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab06c2c-2ffa-4c25-9784-935d008fdacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:09.450435 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab06c2c-2ffa-4c25-9784-935d008fdacb admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:09.450854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab06c2c-2ffa-4c25-9784-935d008fdacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:09.451124 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab06c2c-2ffa-4c25-9784-935d008fdacb admin admin] PATH_INFO: `/v3/projects/f70efcef7d3943e192668ce4f8688bd2/users/25d6bcfab45b4ebea0c8a53f3b8e86ae/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:09.463468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:09.472878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab06c2c-2ffa-4c25-9784-935d008fdacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70efcef7d3943e192668ce4f8688bd2, user_id=25d6bcfab45b4ebea0c8a53f3b8e86ae, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:09.472878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab06c2c-2ffa-4c25-9784-935d008fdacb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:09.572283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1183/2364] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:28:09 2022] PUT /identity/v3/projects/f70efcef7d3943e192668ce4f8688bd2/users/25d6bcfab45b4ebea0c8a53f3b8e86ae/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:28:09.584718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d486f4b-09ab-4311-aa43-e6dfb84108d4 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:09.585018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d486f4b-09ab-4311-aa43-e6dfb84108d4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:09.585302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d486f4b-09ab-4311-aa43-e6dfb84108d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:09.591833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:09.612632 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5d486f4b-09ab-4311-aa43-e6dfb84108d4 None None] MFA Rules not processed for user `25d6bcfab45b4ebea0c8a53f3b8e86ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:28:09.613848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5d486f4b-09ab-4311-aa43-e6dfb84108d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:09.677466 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1182/2365] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:28:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:28:09.688801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab06c2c-2ffa-4c25-9784-935d008fdacb admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:09.690583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dab06c2c-2ffa-4c25-9784-935d008fdacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:09.758281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab06c2c-2ffa-4c25-9784-935d008fdacb admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:09.761913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02717d17-4166-4c94-a2e7-0dbea761331e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:09.762585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02717d17-4166-4c94-a2e7-0dbea761331e service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:09.762895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02717d17-4166-4c94-a2e7-0dbea761331e service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:09.763176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02717d17-4166-4c94-a2e7-0dbea761331e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:09.771351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02717d17-4166-4c94-a2e7-0dbea761331e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:09.772820 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02717d17-4166-4c94-a2e7-0dbea761331e service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:09.782318 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1184/2366] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:28:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:28:19.692065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=31 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:19.777556 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:39.404654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d486f4b-09ab-4311-aa43-e6dfb84108d4 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:39.406349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5d486f4b-09ab-4311-aa43-e6dfb84108d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:39.462908 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d486f4b-09ab-4311-aa43-e6dfb84108d4 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:39.467277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4299a7-6f1c-4066-a21a-db2fc0e435ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:39.467918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4299a7-6f1c-4066-a21a-db2fc0e435ca service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:39.468207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4299a7-6f1c-4066-a21a-db2fc0e435ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:39.468491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4299a7-6f1c-4066-a21a-db2fc0e435ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:39.470282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ac4299a7-6f1c-4066-a21a-db2fc0e435ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:39.556955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4299a7-6f1c-4066-a21a-db2fc0e435ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:39.558394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4299a7-6f1c-4066-a21a-db2fc0e435ca service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:39.578518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1183/2367] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:28:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:28:49.575465 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=66 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:28:59.384481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02717d17-4166-4c94-a2e7-0dbea761331e service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:28:59.385976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-02717d17-4166-4c94-a2e7-0dbea761331e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:59.397596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02717d17-4166-4c94-a2e7-0dbea761331e service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:28:59.401130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a1333-4113-4cb1-bde9-f67936b19dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:28:59.401757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a1333-4113-4cb1-bde9-f67936b19dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:28:59.402038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a1333-4113-4cb1-bde9-f67936b19dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:28:59.402315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a1333-4113-4cb1-bde9-f67936b19dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:28:59.404469 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d02a1333-4113-4cb1-bde9-f67936b19dc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:28:59.417438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a1333-4113-4cb1-bde9-f67936b19dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:28:59.418843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a1333-4113-4cb1-bde9-f67936b19dc9 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:28:59.430183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1185/2368] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:28:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:29:09.425474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:13.159750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4299a7-6f1c-4066-a21a-db2fc0e435ca service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:13.168264 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4299a7-6f1c-4066-a21a-db2fc0e435ca service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:13.172449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf7bcf-e4e9-4dfc-adb9-a18f3493826f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:13.173143 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf7bcf-e4e9-4dfc-adb9-a18f3493826f service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:13.173429 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf7bcf-e4e9-4dfc-adb9-a18f3493826f service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:13.173709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf7bcf-e4e9-4dfc-adb9-a18f3493826f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:13.175470 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dbdf7bcf-e4e9-4dfc-adb9-a18f3493826f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:29:13.184701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf7bcf-e4e9-4dfc-adb9-a18f3493826f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:13.186774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf7bcf-e4e9-4dfc-adb9-a18f3493826f service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:13.194901 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1184/2369] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:29:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:29:23.191375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:29:37.899046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a1333-4113-4cb1-bde9-f67936b19dc9 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:29:37.900524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d02a1333-4113-4cb1-bde9-f67936b19dc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:29:37.915593 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a1333-4113-4cb1-bde9-f67936b19dc9 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:29:37.922650 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a17ab0-c0c4-4667-b95d-ac521aaff683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:29:37.923351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a17ab0-c0c4-4667-b95d-ac521aaff683 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:29:37.923687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a17ab0-c0c4-4667-b95d-ac521aaff683 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:29:37.923995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a17ab0-c0c4-4667-b95d-ac521aaff683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:29:37.926081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-07a17ab0-c0c4-4667-b95d-ac521aaff683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:29:37.990332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a17ab0-c0c4-4667-b95d-ac521aaff683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:29:37.991918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a17ab0-c0c4-4667-b95d-ac521aaff683 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:29:38.001744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1186/2370] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:29:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:29:47.997502 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=28 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:34.533869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf7bcf-e4e9-4dfc-adb9-a18f3493826f service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:34.535354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dbdf7bcf-e4e9-4dfc-adb9-a18f3493826f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:30:34.547033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf7bcf-e4e9-4dfc-adb9-a18f3493826f service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:34.552863 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90083a8a-81af-4aa6-88f7-8d43c1fea1e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:34.553511 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90083a8a-81af-4aa6-88f7-8d43c1fea1e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:34.553828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90083a8a-81af-4aa6-88f7-8d43c1fea1e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:34.554105 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90083a8a-81af-4aa6-88f7-8d43c1fea1e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:34.555929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-90083a8a-81af-4aa6-88f7-8d43c1fea1e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:30:34.615930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90083a8a-81af-4aa6-88f7-8d43c1fea1e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:34.617665 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90083a8a-81af-4aa6-88f7-8d43c1fea1e6 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:34.627761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1185/2371] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:30:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:30:44.189420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a17ab0-c0c4-4667-b95d-ac521aaff683 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:30:44.199232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a17ab0-c0c4-4667-b95d-ac521aaff683 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:30:44.202840 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8a49a-3722-4e80-8173-b5849f6b6c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:30:44.203476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8a49a-3722-4e80-8173-b5849f6b6c85 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:30:44.203760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8a49a-3722-4e80-8173-b5849f6b6c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:30:44.204036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8a49a-3722-4e80-8173-b5849f6b6c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:30:44.205835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7ce8a49a-3722-4e80-8173-b5849f6b6c85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:30:44.265198 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8a49a-3722-4e80-8173-b5849f6b6c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:30:44.266687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8a49a-3722-4e80-8173-b5849f6b6c85 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:30:44.275665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1187/2372] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:30:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:30:44.623173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=28 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:30:54.271585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=28 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:31:43.213959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90083a8a-81af-4aa6-88f7-8d43c1fea1e6 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:31:43.215383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-90083a8a-81af-4aa6-88f7-8d43c1fea1e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:43.232995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90083a8a-81af-4aa6-88f7-8d43c1fea1e6 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:31:43.238840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb6c60-6284-4347-b123-bdbdc92d839e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:31:43.239611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb6c60-6284-4347-b123-bdbdc92d839e service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:31:43.240132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb6c60-6284-4347-b123-bdbdc92d839e service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:31:43.240704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb6c60-6284-4347-b123-bdbdc92d839e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:31:43.243114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1dbb6c60-6284-4347-b123-bdbdc92d839e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:31:43.256541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb6c60-6284-4347-b123-bdbdc92d839e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:31:43.258241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb6c60-6284-4347-b123-bdbdc92d839e service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:31:43.269758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1186/2373] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:31:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:31:53.265179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:11.429874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8a49a-3722-4e80-8173-b5849f6b6c85 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:11.431260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7ce8a49a-3722-4e80-8173-b5849f6b6c85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:11.500097 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8a49a-3722-4e80-8173-b5849f6b6c85 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:11.505004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abb025-c392-45d7-bc78-2ef34c7fbf5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:11.505647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abb025-c392-45d7-bc78-2ef34c7fbf5e service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:11.505930 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abb025-c392-45d7-bc78-2ef34c7fbf5e service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:11.506206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abb025-c392-45d7-bc78-2ef34c7fbf5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:11.507951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-28abb025-c392-45d7-bc78-2ef34c7fbf5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:11.519494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abb025-c392-45d7-bc78-2ef34c7fbf5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:11.521108 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abb025-c392-45d7-bc78-2ef34c7fbf5e service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:11.531882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1188/2374] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:32:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:32:21.527168 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=32 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:40.754719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb6c60-6284-4347-b123-bdbdc92d839e service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:40.763916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb6c60-6284-4347-b123-bdbdc92d839e service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:40.767517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3e3cf-bd8a-4784-bbe1-0e1196825eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:40.768147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3e3cf-bd8a-4784-bbe1-0e1196825eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:40.768435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3e3cf-bd8a-4784-bbe1-0e1196825eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:40.768755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3e3cf-bd8a-4784-bbe1-0e1196825eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:40.778834 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3e3cf-bd8a-4784-bbe1-0e1196825eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:40.780502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3e3cf-bd8a-4784-bbe1-0e1196825eb8 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:40.791268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1187/2375] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:50.786531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:59.089805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abb025-c392-45d7-bc78-2ef34c7fbf5e service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.099845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abb025-c392-45d7-bc78-2ef34c7fbf5e service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:59.103418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7de02-5f7b-4cf8-aaa1-befcdc655b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.104048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7de02-5f7b-4cf8-aaa1-befcdc655b30 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.104328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7de02-5f7b-4cf8-aaa1-befcdc655b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.104599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7de02-5f7b-4cf8-aaa1-befcdc655b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.114678 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7de02-5f7b-4cf8-aaa1-befcdc655b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:59.116079 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7de02-5f7b-4cf8-aaa1-befcdc655b30 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:59.126686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1189/2376] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:34:03.558960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3e3cf-bd8a-4784-bbe1-0e1196825eb8 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:03.569378 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3e3cf-bd8a-4784-bbe1-0e1196825eb8 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:03.572972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1f4e5-f768-46c6-9baf-bb782e045633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:03.573618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1f4e5-f768-46c6-9baf-bb782e045633 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:03.573905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1f4e5-f768-46c6-9baf-bb782e045633 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:03.574187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1f4e5-f768-46c6-9baf-bb782e045633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:03.575927 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5ed1f4e5-f768-46c6-9baf-bb782e045633 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:03.657245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1f4e5-f768-46c6-9baf-bb782e045633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:03.658680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1f4e5-f768-46c6-9baf-bb782e045633 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:03.667821 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1188/2377] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:34:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:34:03.712477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7de02-5f7b-4cf8-aaa1-befcdc655b30 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:03.722147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7de02-5f7b-4cf8-aaa1-befcdc655b30 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:03.725727 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68d36-0d04-4a1b-bb52-0d01c129752e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:03.726353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68d36-0d04-4a1b-bb52-0d01c129752e service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:03.726740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68d36-0d04-4a1b-bb52-0d01c129752e service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:03.727015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68d36-0d04-4a1b-bb52-0d01c129752e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:03.735736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e68d36-0d04-4a1b-bb52-0d01c129752e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:03.737698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e68d36-0d04-4a1b-bb52-0d01c129752e service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:03.746477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1190/2378] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:34:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:34:03.789102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1f4e5-f768-46c6-9baf-bb782e045633 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:03.797565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1f4e5-f768-46c6-9baf-bb782e045633 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:03.801725 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a0986-1d6c-4d6f-90ca-8e788b2282a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:03.802297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a0986-1d6c-4d6f-90ca-8e788b2282a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:03.802580 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a0986-1d6c-4d6f-90ca-8e788b2282a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:03.802856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a0986-1d6c-4d6f-90ca-8e788b2282a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:03.804592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2b5a0986-1d6c-4d6f-90ca-8e788b2282a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:03.883009 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a0986-1d6c-4d6f-90ca-8e788b2282a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:03.884439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a0986-1d6c-4d6f-90ca-8e788b2282a3 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:03.901869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1189/2379] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:34:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:34:13.742502 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=12 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:13.899318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=78 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:17.136481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68d36-0d04-4a1b-bb52-0d01c129752e service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:17.145746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68d36-0d04-4a1b-bb52-0d01c129752e service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:17.149223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9222e0-a5de-45ef-86df-7c1cbeeabf76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:17.149850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9222e0-a5de-45ef-86df-7c1cbeeabf76 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:17.150130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9222e0-a5de-45ef-86df-7c1cbeeabf76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:17.150403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9222e0-a5de-45ef-86df-7c1cbeeabf76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:17.157808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9222e0-a5de-45ef-86df-7c1cbeeabf76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:17.159862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9222e0-a5de-45ef-86df-7c1cbeeabf76 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:17.167747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1191/2380] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:34:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:34:27.164230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:38.837225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a0986-1d6c-4d6f-90ca-8e788b2282a3 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:38.849572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a0986-1d6c-4d6f-90ca-8e788b2282a3 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:38.854944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650710d1-41ab-4445-95db-3638a8d7b295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:38.855605 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650710d1-41ab-4445-95db-3638a8d7b295 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:38.855911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650710d1-41ab-4445-95db-3638a8d7b295 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:38.856176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650710d1-41ab-4445-95db-3638a8d7b295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:38.864488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650710d1-41ab-4445-95db-3638a8d7b295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:38.866109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650710d1-41ab-4445-95db-3638a8d7b295 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:38.893755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1190/2381] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:34:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:34:48.891299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=13 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:33.617779 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9222e0-a5de-45ef-86df-7c1cbeeabf76 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:33.631656 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9222e0-a5de-45ef-86df-7c1cbeeabf76 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:33.637273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17d6c5-a054-4409-880b-4227594a9da6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:33.641632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17d6c5-a054-4409-880b-4227594a9da6 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:33.641632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17d6c5-a054-4409-880b-4227594a9da6 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:33.641632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17d6c5-a054-4409-880b-4227594a9da6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:33.646406 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17d6c5-a054-4409-880b-4227594a9da6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:33.648062 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17d6c5-a054-4409-880b-4227594a9da6 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:33.658060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1192/2382] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:35:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:35:43.652856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:04.261419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650710d1-41ab-4445-95db-3638a8d7b295 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:04.282492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650710d1-41ab-4445-95db-3638a8d7b295 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:04.286082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100cfa3-2ff5-4636-8087-e13a5a38922f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:04.286812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100cfa3-2ff5-4636-8087-e13a5a38922f service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:04.287101 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100cfa3-2ff5-4636-8087-e13a5a38922f service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:04.287380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100cfa3-2ff5-4636-8087-e13a5a38922f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:04.309305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100cfa3-2ff5-4636-8087-e13a5a38922f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:04.313893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100cfa3-2ff5-4636-8087-e13a5a38922f service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:04.337296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1191/2383] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:36:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:36:14.334755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=24 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:17.362314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17d6c5-a054-4409-880b-4227594a9da6 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:17.363690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fd17d6c5-a054-4409-880b-4227594a9da6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:17.446394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17d6c5-a054-4409-880b-4227594a9da6 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:17.451454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f1d0b-90c1-43c8-9ed5-980d528852fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:17.452091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f1d0b-90c1-43c8-9ed5-980d528852fc service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:17.452373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f1d0b-90c1-43c8-9ed5-980d528852fc service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:17.452646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f1d0b-90c1-43c8-9ed5-980d528852fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:17.461331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f1d0b-90c1-43c8-9ed5-980d528852fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:17.464996 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f1d0b-90c1-43c8-9ed5-980d528852fc service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:17.472907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1193/2384] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:37:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:37:27.468736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=37 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:39.918105 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507913c0-afbb-4108-b69a-02210a95bd4c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:39.918569 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507913c0-afbb-4108-b69a-02210a95bd4c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:39.918676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507913c0-afbb-4108-b69a-02210a95bd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:39.975313 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-507913c0-afbb-4108-b69a-02210a95bd4c None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:39.976434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-507913c0-afbb-4108-b69a-02210a95bd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:40.038929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1192/2385] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jun 23 13:37:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:37:40.175050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f1d0b-90c1-43c8-9ed5-980d528852fc service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:40.176447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-783f1d0b-90c1-43c8-9ed5-980d528852fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:40.262570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f1d0b-90c1-43c8-9ed5-980d528852fc service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:40.267593 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db65f1-d99e-4d25-aec9-3f9222755399 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:40.268264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db65f1-d99e-4d25-aec9-3f9222755399 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:40.268544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db65f1-d99e-4d25-aec9-3f9222755399 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:40.268849 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db65f1-d99e-4d25-aec9-3f9222755399 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:40.277094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db65f1-d99e-4d25-aec9-3f9222755399 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:40.278936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db65f1-d99e-4d25-aec9-3f9222755399 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:40.287321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1194/2386] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:37:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 13:37:41.525663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507913c0-afbb-4108-b69a-02210a95bd4c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:41.536485 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507913c0-afbb-4108-b69a-02210a95bd4c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:41.540052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f22dc-7c07-4cf8-a0cf-580848b3e8d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:41.540719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f22dc-7c07-4cf8-a0cf-580848b3e8d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:41.541008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f22dc-7c07-4cf8-a0cf-580848b3e8d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:41.541283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f22dc-7c07-4cf8-a0cf-580848b3e8d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:41.543113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-240f22dc-7c07-4cf8-a0cf-580848b3e8d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:41.604720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f22dc-7c07-4cf8-a0cf-580848b3e8d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:41.606154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f22dc-7c07-4cf8-a0cf-580848b3e8d4 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:41.616223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1193/2387] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:37:45.089405 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db65f1-d99e-4d25-aec9-3f9222755399 service swift] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:45.100793 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db65f1-d99e-4d25-aec9-3f9222755399 service swift] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:45.106059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4da1f-d62e-4229-abbc-58e24d0beca2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:45.107849 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4da1f-d62e-4229-abbc-58e24d0beca2 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:45.108204 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4da1f-d62e-4229-abbc-58e24d0beca2 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:45.108548 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4da1f-d62e-4229-abbc-58e24d0beca2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:45.110467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c1c4da1f-d62e-4229-abbc-58e24d0beca2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:45.122216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4da1f-d62e-4229-abbc-58e24d0beca2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:45.124329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4da1f-d62e-4229-abbc-58e24d0beca2 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:45.134560 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1195/2388] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:37:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:37:48.768627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f22dc-7c07-4cf8-a0cf-580848b3e8d4 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:48.770105 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-240f22dc-7c07-4cf8-a0cf-580848b3e8d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:48.783771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f22dc-7c07-4cf8-a0cf-580848b3e8d4 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:48.788404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:48.789380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:48.789668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:48.789944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] PATH_INFO: `/v3/users/e6beb6af188b412eb9ee3c38f4c6b94d` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:48.804151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6beb6af188b412eb9ee3c38f4c6b94d)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:48.806093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:49.030783 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:49.035558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6beb6af188b412eb9ee3c38f4c6b94d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:49.036207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6beb6af188b412eb9ee3c38f4c6b94d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:49.113111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6beb6af188b412eb9ee3c38f4c6b94d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:49.125402 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6beb6af188b412eb9ee3c38f4c6b94d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:49.132085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6beb6af188b412eb9ee3c38f4c6b94d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:49.137927 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1194/2389] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:37:48 2022] DELETE /identity/v3/users/e6beb6af188b412eb9ee3c38f4c6b94d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:37:49.414529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4da1f-d62e-4229-abbc-58e24d0beca2 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:49.425463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4da1f-d62e-4229-abbc-58e24d0beca2 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:49.484050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:49.484944 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:49.485229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:49.485504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] PATH_INFO: `/v3/projects/3d6a665bb8ef4873bb2330cfebb5770a` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:49.495629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6a665bb8ef4873bb2330cfebb5770a)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:49.497579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:49.618810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6a665bb8ef4873bb2330cfebb5770a', 'request_id': 'req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:49.620464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:49.688444 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6a665bb8ef4873bb2330cfebb5770a', 'request_id': 'req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:49.695638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6a665bb8ef4873bb2330cfebb5770a', 'request_id': 'req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:49.706706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] The token cache is being invalidate because project 3d6a665bb8ef4873bb2330cfebb5770a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:37:49.717306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:49.717306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:49.717306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1196/2390] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:37:49 2022] DELETE /identity/v3/projects/3d6a665bb8ef4873bb2330cfebb5770a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:37:49.717654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:49.717654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:49.728737 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f71ad-cb51-4f16-b794-56000d3b2bcb admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:49.787025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:49.787908 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:49.788191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:49.788496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] PATH_INFO: `/v3/users/f9600e93ccee48538ce4432e8d6a05a2` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:49.802651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9600e93ccee48538ce4432e8d6a05a2)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:49.804689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:50.073268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9600e93ccee48538ce4432e8d6a05a2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:50.073949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9600e93ccee48538ce4432e8d6a05a2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:50.147203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9600e93ccee48538ce4432e8d6a05a2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:50.159673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9600e93ccee48538ce4432e8d6a05a2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:50.166390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9600e93ccee48538ce4432e8d6a05a2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:50.173168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1195/2391] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:37:49 2022] DELETE /identity/v3/users/f9600e93ccee48538ce4432e8d6a05a2 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:37:50.433995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:50.433995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:50.445093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c01a1-ce2e-4b1e-a087-247f5fefc5cf admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:50.502081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:50.502876 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:50.503159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:50.503438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c admin admin] PATH_INFO: `/v3/projects/45d85c3d91014a48b4caac9c5c6349e4` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:50.513506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d85c3d91014a48b4caac9c5c6349e4)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:50.515454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:50.675196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d85c3d91014a48b4caac9c5c6349e4', 'request_id': 'req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:50.764464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d85c3d91014a48b4caac9c5c6349e4', 'request_id': 'req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:50.773853 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d85c3d91014a48b4caac9c5c6349e4', 'request_id': 'req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:50.786123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c admin admin] The token cache is being invalidate because project 45d85c3d91014a48b4caac9c5c6349e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:37:50.786395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:50.787074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-de29e8a4-05df-4dd7-b346-3d5d3d45e79c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:37:50.788945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1197/2392] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:37:50 2022] DELETE /identity/v3/projects/45d85c3d91014a48b4caac9c5c6349e4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:38:00.169014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=72,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:00.782663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=61 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:05.507597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:05.509262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:05.524508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c144e58-d489-4a68-8710-76a0032ef21f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:05.588056 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:05.588995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:05.589283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:05.589563 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] PATH_INFO: `/v3/users/25d6bcfab45b4ebea0c8a53f3b8e86ae` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:05.590771 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d6bcfab45b4ebea0c8a53f3b8e86ae)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:05.592867 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:05.848551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d6bcfab45b4ebea0c8a53f3b8e86ae'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:05.848551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d6bcfab45b4ebea0c8a53f3b8e86ae'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:05.944844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d6bcfab45b4ebea0c8a53f3b8e86ae'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:05.957105 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d6bcfab45b4ebea0c8a53f3b8e86ae'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:05.963779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d6bcfab45b4ebea0c8a53f3b8e86ae'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:05.969893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1196/2393] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:38:05 2022] DELETE /identity/v3/users/25d6bcfab45b4ebea0c8a53f3b8e86ae => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:38:05.974425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a139a18-fe5f-4777-8180-8234c2ac1235 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:05.974896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a139a18-fe5f-4777-8180-8234c2ac1235 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:05.975069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a139a18-fe5f-4777-8180-8234c2ac1235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:05.992912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7a139a18-fe5f-4777-8180-8234c2ac1235 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:05.994152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7a139a18-fe5f-4777-8180-8234c2ac1235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:06.053572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1198/2394] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:38:06.064133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:06.065555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:06.126011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777aaab-c060-42df-a22a-10c1bfdbf137 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:06.129681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84dda6-56b5-4699-a5f9-b9233f9b0d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:06.130330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84dda6-56b5-4699-a5f9-b9233f9b0d0f service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:06.130683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84dda6-56b5-4699-a5f9-b9233f9b0d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:06.130967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84dda6-56b5-4699-a5f9-b9233f9b0d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:06.140117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84dda6-56b5-4699-a5f9-b9233f9b0d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:06.142108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84dda6-56b5-4699-a5f9-b9233f9b0d0f service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:06.151080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1197/2395] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:06.563106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a139a18-fe5f-4777-8180-8234c2ac1235 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:06.564566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7a139a18-fe5f-4777-8180-8234c2ac1235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:06.576632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a139a18-fe5f-4777-8180-8234c2ac1235 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:06.581756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:06.582598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:06.582882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:06.583157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] PATH_INFO: `/v3/projects/f70efcef7d3943e192668ce4f8688bd2` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:06.584932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70efcef7d3943e192668ce4f8688bd2)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:06.586938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:06.705144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70efcef7d3943e192668ce4f8688bd2', 'request_id': 'req-906b6158-0ba9-4a0e-baf6-4f15468c57b2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:06.792140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70efcef7d3943e192668ce4f8688bd2', 'request_id': 'req-906b6158-0ba9-4a0e-baf6-4f15468c57b2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:06.798901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70efcef7d3943e192668ce4f8688bd2', 'request_id': 'req-906b6158-0ba9-4a0e-baf6-4f15468c57b2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:06.809185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] The token cache is being invalidate because project f70efcef7d3943e192668ce4f8688bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:38:06.809473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:06.810093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:06.811683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1199/2396] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:38:06 2022] DELETE /identity/v3/projects/f70efcef7d3943e192668ce4f8688bd2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:38:08.706353 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84dda6-56b5-4699-a5f9-b9233f9b0d0f service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:08.707828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dd84dda6-56b5-4699-a5f9-b9233f9b0d0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:08.735581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:08.787096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84dda6-56b5-4699-a5f9-b9233f9b0d0f service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:08.854750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef25c79-9018-4fe0-ab59-9249196643c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:08.855417 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef25c79-9018-4fe0-ab59-9249196643c2 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:08.855705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef25c79-9018-4fe0-ab59-9249196643c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:08.855985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef25c79-9018-4fe0-ab59-9249196643c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:08.857822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2ef25c79-9018-4fe0-ab59-9249196643c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:08.870240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef25c79-9018-4fe0-ab59-9249196643c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:08.871757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef25c79-9018-4fe0-ab59-9249196643c2 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:08.884136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1198/2397] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:14.474585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:14.475985 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:14.556569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b6158-0ba9-4a0e-baf6-4f15468c57b2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:14.560373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa9a9e-77e5-4e9a-b3ed-c278de10167e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:14.561061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa9a9e-77e5-4e9a-b3ed-c278de10167e service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:14.561347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa9a9e-77e5-4e9a-b3ed-c278de10167e service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:14.561628 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa9a9e-77e5-4e9a-b3ed-c278de10167e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:14.563509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-67fa9a9e-77e5-4e9a-b3ed-c278de10167e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:14.583407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:14.649572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa9a9e-77e5-4e9a-b3ed-c278de10167e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:14.651009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa9a9e-77e5-4e9a-b3ed-c278de10167e service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:14.672337 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1200/2398] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:18.278416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef25c79-9018-4fe0-ab59-9249196643c2 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:18.279868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2ef25c79-9018-4fe0-ab59-9249196643c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:18.349310 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef25c79-9018-4fe0-ab59-9249196643c2 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:18.354368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90589a3-5992-44c2-b9f2-db718cad572d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:18.355040 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90589a3-5992-44c2-b9f2-db718cad572d service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:18.355328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90589a3-5992-44c2-b9f2-db718cad572d service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:18.355604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90589a3-5992-44c2-b9f2-db718cad572d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:18.357438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b90589a3-5992-44c2-b9f2-db718cad572d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:18.369576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90589a3-5992-44c2-b9f2-db718cad572d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:18.371177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90589a3-5992-44c2-b9f2-db718cad572d service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:18.381486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1199/2399] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:18.416019 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa9a9e-77e5-4e9a-b3ed-c278de10167e service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:18.417579 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-67fa9a9e-77e5-4e9a-b3ed-c278de10167e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:18.430708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa9a9e-77e5-4e9a-b3ed-c278de10167e service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:18.435474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea4043-a23d-4f52-a4a8-1b4c828338f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:18.436338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea4043-a23d-4f52-a4a8-1b4c828338f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:18.436620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea4043-a23d-4f52-a4a8-1b4c828338f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:18.437036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea4043-a23d-4f52-a4a8-1b4c828338f5 admin admin] PATH_INFO: `/v3/users/2694401e38424109bce306728953c986` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:18.438243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea4043-a23d-4f52-a4a8-1b4c828338f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2694401e38424109bce306728953c986)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:18.440828 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea4043-a23d-4f52-a4a8-1b4c828338f5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:18.623116 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-57ea4043-a23d-4f52-a4a8-1b4c828338f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2694401e38424109bce306728953c986'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:18.623689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-57ea4043-a23d-4f52-a4a8-1b4c828338f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2694401e38424109bce306728953c986'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:18.624284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-57ea4043-a23d-4f52-a4a8-1b4c828338f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2694401e38424109bce306728953c986'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:18.635839 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-57ea4043-a23d-4f52-a4a8-1b4c828338f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2694401e38424109bce306728953c986'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:18.642533 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-57ea4043-a23d-4f52-a4a8-1b4c828338f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2694401e38424109bce306728953c986'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:18.757397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1201/2400] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:38:18 2022] DELETE /identity/v3/users/2694401e38424109bce306728953c986 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:38:18.992950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90589a3-5992-44c2-b9f2-db718cad572d service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:19.004622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90589a3-5992-44c2-b9f2-db718cad572d service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:19.039066 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:19.064132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afffe4f-8ba5-4d55-847d-a655bc15712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:19.065139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afffe4f-8ba5-4d55-847d-a655bc15712e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:19.065663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afffe4f-8ba5-4d55-847d-a655bc15712e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:19.066126 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afffe4f-8ba5-4d55-847d-a655bc15712e admin admin] PATH_INFO: `/v3/projects/e30048e6dd464482a72ca7cea538e9c7` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:19.067596 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afffe4f-8ba5-4d55-847d-a655bc15712e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e30048e6dd464482a72ca7cea538e9c7)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:19.069627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afffe4f-8ba5-4d55-847d-a655bc15712e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:19.191252 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3afffe4f-8ba5-4d55-847d-a655bc15712e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e30048e6dd464482a72ca7cea538e9c7', 'request_id': 'req-3afffe4f-8ba5-4d55-847d-a655bc15712e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:19.197374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3afffe4f-8ba5-4d55-847d-a655bc15712e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e30048e6dd464482a72ca7cea538e9c7', 'request_id': 'req-3afffe4f-8ba5-4d55-847d-a655bc15712e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:19.202763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3afffe4f-8ba5-4d55-847d-a655bc15712e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e30048e6dd464482a72ca7cea538e9c7', 'request_id': 'req-3afffe4f-8ba5-4d55-847d-a655bc15712e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:19.271373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3afffe4f-8ba5-4d55-847d-a655bc15712e admin admin] The token cache is being invalidate because project e30048e6dd464482a72ca7cea538e9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:38:19.271594 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3afffe4f-8ba5-4d55-847d-a655bc15712e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:19.272202 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-3afffe4f-8ba5-4d55-847d-a655bc15712e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:38:19.273761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1200/2401] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:38:18 2022] DELETE /identity/v3/projects/e30048e6dd464482a72ca7cea538e9c7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:38:19.280054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f542-ec1d-4cb9-848b-de9f4f10d1af None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:19.280347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f542-ec1d-4cb9-848b-de9f4f10d1af None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:19.280646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f542-ec1d-4cb9-848b-de9f4f10d1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:19.339781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8aa7f542-ec1d-4cb9-848b-de9f4f10d1af None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:19.341023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8aa7f542-ec1d-4cb9-848b-de9f4f10d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:19.362286 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:19.401943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1202/2402] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:19.410419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402903c-42c5-4d63-8018-7413311f6338 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:19.410920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402903c-42c5-4d63-8018-7413311f6338 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:19.411047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402903c-42c5-4d63-8018-7413311f6338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:19.429224 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0402903c-42c5-4d63-8018-7413311f6338 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:19.430426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0402903c-42c5-4d63-8018-7413311f6338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:19.439454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1201/2403] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:19.443641 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7f542-ec1d-4cb9-848b-de9f4f10d1af None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:19.453565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7f542-ec1d-4cb9-848b-de9f4f10d1af None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:19.458699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a56e5-1dcd-46ea-a11f-aedf03b60e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:19.459709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a56e5-1dcd-46ea-a11f-aedf03b60e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:19.459997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a56e5-1dcd-46ea-a11f-aedf03b60e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:19.460271 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a56e5-1dcd-46ea-a11f-aedf03b60e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:19.461084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a56e5-1dcd-46ea-a11f-aedf03b60e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:38:19.463542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a56e5-1dcd-46ea-a11f-aedf03b60e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:19.463542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a56e5-1dcd-46ea-a11f-aedf03b60e36 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:19.474792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1203/2404] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:38:19.478874 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402903c-42c5-4d63-8018-7413311f6338 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:19.488614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402903c-42c5-4d63-8018-7413311f6338 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:19.493299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e2d6c-019c-4f0d-99a0-6e343eba88c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:19.497986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e2d6c-019c-4f0d-99a0-6e343eba88c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:19.497986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e2d6c-019c-4f0d-99a0-6e343eba88c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:19.497986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e2d6c-019c-4f0d-99a0-6e343eba88c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:19.497986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e2d6c-019c-4f0d-99a0-6e343eba88c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:19.497986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e2d6c-019c-4f0d-99a0-6e343eba88c0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:19.582262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1202/2405] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:38:19 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:38:19.586312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a56e5-1dcd-46ea-a11f-aedf03b60e36 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:19.596131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a56e5-1dcd-46ea-a11f-aedf03b60e36 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:19.652887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eabba-8397-46d6-a814-0454fd41f8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:19.653562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eabba-8397-46d6-a814-0454fd41f8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:19.653847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eabba-8397-46d6-a814-0454fd41f8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:19.654129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eabba-8397-46d6-a814-0454fd41f8a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:19.654810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eabba-8397-46d6-a814-0454fd41f8a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:19.656898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eabba-8397-46d6-a814-0454fd41f8a3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:19.756103 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1204/2406] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:38:19 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:38:19.760119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e2d6c-019c-4f0d-99a0-6e343eba88c0 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:19.770446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e2d6c-019c-4f0d-99a0-6e343eba88c0 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:19.775068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2aa83-340b-432e-8630-1d02f7da37c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:19.775737 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2aa83-340b-432e-8630-1d02f7da37c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:19.776022 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2aa83-340b-432e-8630-1d02f7da37c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:19.776301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2aa83-340b-432e-8630-1d02f7da37c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:19.777124 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2aa83-340b-432e-8630-1d02f7da37c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:19.778971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2aa83-340b-432e-8630-1d02f7da37c9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:19.789213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1203/2407] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:38:19.793153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eabba-8397-46d6-a814-0454fd41f8a3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:19.803576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eabba-8397-46d6-a814-0454fd41f8a3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:19.808141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266199f-fb5a-4ff3-bd5a-842c97a2b5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:19.808819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266199f-fb5a-4ff3-bd5a-842c97a2b5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:19.809103 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266199f-fb5a-4ff3-bd5a-842c97a2b5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:19.809379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266199f-fb5a-4ff3-bd5a-842c97a2b5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:19.810095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266199f-fb5a-4ff3-bd5a-842c97a2b5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:19.811675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266199f-fb5a-4ff3-bd5a-842c97a2b5c6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:19.822092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1205/2408] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:38:19.825999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2aa83-340b-432e-8630-1d02f7da37c9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:19.835945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2aa83-340b-432e-8630-1d02f7da37c9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:19.840728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79dd83-32e4-45ef-9507-12f06003557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:19.841600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79dd83-32e4-45ef-9507-12f06003557a admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:19.841883 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79dd83-32e4-45ef-9507-12f06003557a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:19.842163 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79dd83-32e4-45ef-9507-12f06003557a admin admin] PATH_INFO: `/v3/projects/1cc6ea2ba13f4314b0f97d1bb5d7e872/users/149f6a3ec9e4483aa57780e82cdcb4c2/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:19.856916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79dd83-32e4-45ef-9507-12f06003557a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc6ea2ba13f4314b0f97d1bb5d7e872, user_id=149f6a3ec9e4483aa57780e82cdcb4c2, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:19.859594 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79dd83-32e4-45ef-9507-12f06003557a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:19.937697 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1204/2409] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:38:19 2022] PUT /identity/v3/projects/1cc6ea2ba13f4314b0f97d1bb5d7e872/users/149f6a3ec9e4483aa57780e82cdcb4c2/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:38:19.948381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e6433-1184-4737-b164-1c8912fa9cdd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:19.948706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e6433-1184-4737-b164-1c8912fa9cdd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:19.948993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e6433-1184-4737-b164-1c8912fa9cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:19.975535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-265e6433-1184-4737-b164-1c8912fa9cdd None None] MFA Rules not processed for user `149f6a3ec9e4483aa57780e82cdcb4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:19.976761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-265e6433-1184-4737-b164-1c8912fa9cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:20.039109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1206/2410] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:38:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:20.043514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79dd83-32e4-45ef-9507-12f06003557a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:20.093254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:20.103608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79dd83-32e4-45ef-9507-12f06003557a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:20.108242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665f754-be09-4edc-abb7-103fe46b1b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:20.108915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665f754-be09-4edc-abb7-103fe46b1b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:20.109198 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665f754-be09-4edc-abb7-103fe46b1b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:20.109472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665f754-be09-4edc-abb7-103fe46b1b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:20.110147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665f754-be09-4edc-abb7-103fe46b1b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:20.112703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665f754-be09-4edc-abb7-103fe46b1b18 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:20.213521 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1205/2411] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:38:20 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:38:20.217802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e6433-1184-4737-b164-1c8912fa9cdd None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:20.228517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e6433-1184-4737-b164-1c8912fa9cdd None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:20.246193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:20.283185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec1f43-0974-40b9-a440-aebffecb4c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:20.283852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec1f43-0974-40b9-a440-aebffecb4c6b admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:20.284138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec1f43-0974-40b9-a440-aebffecb4c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:20.284416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec1f43-0974-40b9-a440-aebffecb4c6b admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:20.285175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec1f43-0974-40b9-a440-aebffecb4c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:20.287094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec1f43-0974-40b9-a440-aebffecb4c6b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:20.363572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1207/2412] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:38:20 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:38:20.367499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665f754-be09-4edc-abb7-103fe46b1b18 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:20.378420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665f754-be09-4edc-abb7-103fe46b1b18 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:20.383085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae352e17-fd02-4e1b-881a-304850330f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:20.383741 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae352e17-fd02-4e1b-881a-304850330f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:20.384026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae352e17-fd02-4e1b-881a-304850330f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:20.384306 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae352e17-fd02-4e1b-881a-304850330f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:20.385119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae352e17-fd02-4e1b-881a-304850330f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:20.386715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae352e17-fd02-4e1b-881a-304850330f18 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:20.396998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1206/2413] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:38:20.400819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec1f43-0974-40b9-a440-aebffecb4c6b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:20.410950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec1f43-0974-40b9-a440-aebffecb4c6b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:20.415594 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db32b13-e9ea-477e-80b1-1417b8b25e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:20.416464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db32b13-e9ea-477e-80b1-1417b8b25e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:20.416776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db32b13-e9ea-477e-80b1-1417b8b25e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:20.417057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db32b13-e9ea-477e-80b1-1417b8b25e10 admin admin] PATH_INFO: `/v3/projects/467a71456f824484bbc2f5d124206a04/users/b96b478241d740d78a6aa23a9da7a14e/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:20.431807 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db32b13-e9ea-477e-80b1-1417b8b25e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467a71456f824484bbc2f5d124206a04, user_id=b96b478241d740d78a6aa23a9da7a14e, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:20.434503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db32b13-e9ea-477e-80b1-1417b8b25e10 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:20.509252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1208/2414] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:38:20 2022] PUT /identity/v3/projects/467a71456f824484bbc2f5d124206a04/users/b96b478241d740d78a6aa23a9da7a14e/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:38:20.514718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae352e17-fd02-4e1b-881a-304850330f18 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:20.527949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae352e17-fd02-4e1b-881a-304850330f18 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:20.603151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18242e-0078-4269-9b29-1a2534035296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:20.603986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18242e-0078-4269-9b29-1a2534035296 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:20.604388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18242e-0078-4269-9b29-1a2534035296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:20.604728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18242e-0078-4269-9b29-1a2534035296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:20.605738 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18242e-0078-4269-9b29-1a2534035296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:20.607909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18242e-0078-4269-9b29-1a2534035296 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:20.621647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1207/2415] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:38:20.624765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db32b13-e9ea-477e-80b1-1417b8b25e10 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:20.635609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db32b13-e9ea-477e-80b1-1417b8b25e10 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:20.640187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b320bfd-d7f2-4003-b2d1-2bb4f94d7d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:20.641086 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b320bfd-d7f2-4003-b2d1-2bb4f94d7d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:20.641370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b320bfd-d7f2-4003-b2d1-2bb4f94d7d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:20.641645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b320bfd-d7f2-4003-b2d1-2bb4f94d7d3a admin admin] PATH_INFO: `/v3/projects/467a71456f824484bbc2f5d124206a04/users/b96b478241d740d78a6aa23a9da7a14e/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:20.643609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b320bfd-d7f2-4003-b2d1-2bb4f94d7d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=467a71456f824484bbc2f5d124206a04, user_id=b96b478241d740d78a6aa23a9da7a14e, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:20.646282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b320bfd-d7f2-4003-b2d1-2bb4f94d7d3a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:20.656700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1209/2416] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:38:20 2022] PUT /identity/v3/projects/467a71456f824484bbc2f5d124206a04/users/b96b478241d740d78a6aa23a9da7a14e/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:38:20.666833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb4b1b-7501-491c-8ebe-03833ecd0f59 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:20.667129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb4b1b-7501-491c-8ebe-03833ecd0f59 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:20.667413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb4b1b-7501-491c-8ebe-03833ecd0f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:20.694822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-47cb4b1b-7501-491c-8ebe-03833ecd0f59 None None] MFA Rules not processed for user `b96b478241d740d78a6aa23a9da7a14e`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:20.696114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-47cb4b1b-7501-491c-8ebe-03833ecd0f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:20.762332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1208/2417] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:38:20 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:30.652848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=34,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:30.759343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:05.829458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b320bfd-d7f2-4003-b2d1-2bb4f94d7d3a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:05.831157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6b320bfd-d7f2-4003-b2d1-2bb4f94d7d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:05.912886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b320bfd-d7f2-4003-b2d1-2bb4f94d7d3a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:05.916551 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484e6b4-0c20-48bf-b43d-3a2c9e642919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:05.917240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484e6b4-0c20-48bf-b43d-3a2c9e642919 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:05.917527 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484e6b4-0c20-48bf-b43d-3a2c9e642919 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:05.917807 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484e6b4-0c20-48bf-b43d-3a2c9e642919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:05.919558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6484e6b4-0c20-48bf-b43d-3a2c9e642919 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:05.987979 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484e6b4-0c20-48bf-b43d-3a2c9e642919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:05.989454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484e6b4-0c20-48bf-b43d-3a2c9e642919 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:05.998380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1210/2418] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:40:06.025195 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb4b1b-7501-491c-8ebe-03833ecd0f59 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:06.034825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb4b1b-7501-491c-8ebe-03833ecd0f59 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:06.038410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bd738-f522-4866-b63d-d0f9bc941d29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:06.039044 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bd738-f522-4866-b63d-d0f9bc941d29 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.039332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bd738-f522-4866-b63d-d0f9bc941d29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.039610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bd738-f522-4866-b63d-d0f9bc941d29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.041363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-484bd738-f522-4866-b63d-d0f9bc941d29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:06.098965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bd738-f522-4866-b63d-d0f9bc941d29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:06.100406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bd738-f522-4866-b63d-d0f9bc941d29 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:06.118599 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1209/2419] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:06.307600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484e6b4-0c20-48bf-b43d-3a2c9e642919 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:06.315934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484e6b4-0c20-48bf-b43d-3a2c9e642919 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:06.319833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd446c-c756-4f49-b848-7da1c9a7387a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:06.320562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd446c-c756-4f49-b848-7da1c9a7387a service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.320909 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd446c-c756-4f49-b848-7da1c9a7387a service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.325740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd446c-c756-4f49-b848-7da1c9a7387a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.332257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd446c-c756-4f49-b848-7da1c9a7387a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:06.333765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd446c-c756-4f49-b848-7da1c9a7387a service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:06.343409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1211/2420] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:16.116007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=32 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:16.339031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=68 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:06.616220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bd738-f522-4866-b63d-d0f9bc941d29 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:06.617693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-484bd738-f522-4866-b63d-d0f9bc941d29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:06.628647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bd738-f522-4866-b63d-d0f9bc941d29 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:06.632431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626781b9-26a1-45e6-9a61-fdca1a6be6e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:06.633113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626781b9-26a1-45e6-9a61-fdca1a6be6e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:06.633403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626781b9-26a1-45e6-9a61-fdca1a6be6e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:06.633683 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626781b9-26a1-45e6-9a61-fdca1a6be6e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:06.636258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-626781b9-26a1-45e6-9a61-fdca1a6be6e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:06.710003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626781b9-26a1-45e6-9a61-fdca1a6be6e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:06.711445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626781b9-26a1-45e6-9a61-fdca1a6be6e6 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:06.721951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1210/2421] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:06.826437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd446c-c756-4f49-b848-7da1c9a7387a service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:06.900535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd446c-c756-4f49-b848-7da1c9a7387a service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:06.905143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:06.906048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:06.906852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:06.907078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] PATH_INFO: `/v3/users/149f6a3ec9e4483aa57780e82cdcb4c2` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:06.908270 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=149f6a3ec9e4483aa57780e82cdcb4c2)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:06.910244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:07.105157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149f6a3ec9e4483aa57780e82cdcb4c2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:07.105825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149f6a3ec9e4483aa57780e82cdcb4c2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:07.106436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149f6a3ec9e4483aa57780e82cdcb4c2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:07.119171 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149f6a3ec9e4483aa57780e82cdcb4c2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:07.126732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149f6a3ec9e4483aa57780e82cdcb4c2'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:07.200041 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1212/2422] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:42:06 2022] DELETE /identity/v3/users/149f6a3ec9e4483aa57780e82cdcb4c2 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:07.204628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b52a1-928c-4d0d-a5fa-0bfb2fff4400 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:07.205007 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b52a1-928c-4d0d-a5fa-0bfb2fff4400 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:07.205304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b52a1-928c-4d0d-a5fa-0bfb2fff4400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:07.223509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-bf9b52a1-928c-4d0d-a5fa-0bfb2fff4400 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:07.224743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bf9b52a1-928c-4d0d-a5fa-0bfb2fff4400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:07.281210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1211/2423] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:07.291461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:07.293007 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:07.349796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b4513-5cb7-42a6-901e-bbf60be40b8e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:07.353404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33864059-7a3b-4213-9333-cc004f68c064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:07.354047 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33864059-7a3b-4213-9333-cc004f68c064 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:07.354332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33864059-7a3b-4213-9333-cc004f68c064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:07.355219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33864059-7a3b-4213-9333-cc004f68c064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:07.365614 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33864059-7a3b-4213-9333-cc004f68c064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:07.367043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33864059-7a3b-4213-9333-cc004f68c064 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:07.376748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1213/2424] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:07.801561 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b52a1-928c-4d0d-a5fa-0bfb2fff4400 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:07.803669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-bf9b52a1-928c-4d0d-a5fa-0bfb2fff4400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:07.817827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b52a1-928c-4d0d-a5fa-0bfb2fff4400 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:07.832245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:07.832404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:07.832741 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:07.833030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] PATH_INFO: `/v3/projects/1cc6ea2ba13f4314b0f97d1bb5d7e872` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:07.834744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc6ea2ba13f4314b0f97d1bb5d7e872)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:07.836713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:07.950819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc6ea2ba13f4314b0f97d1bb5d7e872', 'request_id': 'req-69900b58-4c6e-40bb-aaae-148d72227093'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:07.957853 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc6ea2ba13f4314b0f97d1bb5d7e872', 'request_id': 'req-69900b58-4c6e-40bb-aaae-148d72227093'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:07.964134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc6ea2ba13f4314b0f97d1bb5d7e872', 'request_id': 'req-69900b58-4c6e-40bb-aaae-148d72227093'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:08.029751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] The token cache is being invalidate because project 1cc6ea2ba13f4314b0f97d1bb5d7e872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:42:08.030048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:08.030777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:08.033137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1212/2425] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:42:07 2022] DELETE /identity/v3/projects/1cc6ea2ba13f4314b0f97d1bb5d7e872 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:08.037092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33864059-7a3b-4213-9333-cc004f68c064 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:08.047036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33864059-7a3b-4213-9333-cc004f68c064 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:08.066526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:08.109343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24348aac-457f-4fd7-a96c-6f8cd56e31c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:08.109343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24348aac-457f-4fd7-a96c-6f8cd56e31c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:08.109343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24348aac-457f-4fd7-a96c-6f8cd56e31c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:08.109343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24348aac-457f-4fd7-a96c-6f8cd56e31c0 admin admin] PATH_INFO: `/v3/users/b96b478241d740d78a6aa23a9da7a14e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:08.109937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24348aac-457f-4fd7-a96c-6f8cd56e31c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96b478241d740d78a6aa23a9da7a14e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:08.111204 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24348aac-457f-4fd7-a96c-6f8cd56e31c0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:08.313257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-24348aac-457f-4fd7-a96c-6f8cd56e31c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96b478241d740d78a6aa23a9da7a14e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:08.315757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-24348aac-457f-4fd7-a96c-6f8cd56e31c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96b478241d740d78a6aa23a9da7a14e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:08.315757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-24348aac-457f-4fd7-a96c-6f8cd56e31c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96b478241d740d78a6aa23a9da7a14e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:08.327608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-24348aac-457f-4fd7-a96c-6f8cd56e31c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96b478241d740d78a6aa23a9da7a14e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:08.334719 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-24348aac-457f-4fd7-a96c-6f8cd56e31c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96b478241d740d78a6aa23a9da7a14e'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:08.420120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1214/2426] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:42:08 2022] DELETE /identity/v3/users/b96b478241d740d78a6aa23a9da7a14e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:08.806513 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:08.808072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:08.822800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69900b58-4c6e-40bb-aaae-148d72227093 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:08.832153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:08.882641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae776566-4d99-4593-9111-48c37d19fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:08.883538 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae776566-4d99-4593-9111-48c37d19fc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:08.883822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae776566-4d99-4593-9111-48c37d19fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:08.884101 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae776566-4d99-4593-9111-48c37d19fc02 admin admin] PATH_INFO: `/v3/projects/467a71456f824484bbc2f5d124206a04` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:08.885297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae776566-4d99-4593-9111-48c37d19fc02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=467a71456f824484bbc2f5d124206a04)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:08.887195 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae776566-4d99-4593-9111-48c37d19fc02 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:08.985322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ae776566-4d99-4593-9111-48c37d19fc02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467a71456f824484bbc2f5d124206a04', 'request_id': 'req-ae776566-4d99-4593-9111-48c37d19fc02'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:08.991416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ae776566-4d99-4593-9111-48c37d19fc02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467a71456f824484bbc2f5d124206a04', 'request_id': 'req-ae776566-4d99-4593-9111-48c37d19fc02'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:08.997463 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ae776566-4d99-4593-9111-48c37d19fc02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467a71456f824484bbc2f5d124206a04', 'request_id': 'req-ae776566-4d99-4593-9111-48c37d19fc02'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:09.103153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ae776566-4d99-4593-9111-48c37d19fc02 admin admin] The token cache is being invalidate because project 467a71456f824484bbc2f5d124206a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:42:09.103447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ae776566-4d99-4593-9111-48c37d19fc02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:09.104072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ae776566-4d99-4593-9111-48c37d19fc02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:09.105679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1213/2427] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:42:08 2022] DELETE /identity/v3/projects/467a71456f824484bbc2f5d124206a04 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:09.110548 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccd3e0-8b29-4be3-8410-e6583b253b65 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:09.112640 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccd3e0-8b29-4be3-8410-e6583b253b65 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:09.112640 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccd3e0-8b29-4be3-8410-e6583b253b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:09.128934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-edccd3e0-8b29-4be3-8410-e6583b253b65 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:09.130074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-edccd3e0-8b29-4be3-8410-e6583b253b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:09.187137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1215/2428] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:09.196902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8101224-e174-403c-8b71-18df9e5c0a7f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:09.197200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8101224-e174-403c-8b71-18df9e5c0a7f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:09.197489 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8101224-e174-403c-8b71-18df9e5c0a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:09.216300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e8101224-e174-403c-8b71-18df9e5c0a7f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:09.217541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e8101224-e174-403c-8b71-18df9e5c0a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:09.225407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1214/2429] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:09.229411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccd3e0-8b29-4be3-8410-e6583b253b65 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:09.239499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccd3e0-8b29-4be3-8410-e6583b253b65 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:09.244128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d25873-755f-41ad-a6f8-818dc9574c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:09.244821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d25873-755f-41ad-a6f8-818dc9574c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:09.245110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d25873-755f-41ad-a6f8-818dc9574c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:09.245386 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d25873-755f-41ad-a6f8-818dc9574c2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:09.246099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d25873-755f-41ad-a6f8-818dc9574c2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:42:09.246406 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d25873-755f-41ad-a6f8-818dc9574c2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:09.247992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d25873-755f-41ad-a6f8-818dc9574c2c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:09.260055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1216/2430] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:42:09.264078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8101224-e174-403c-8b71-18df9e5c0a7f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:09.273059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8101224-e174-403c-8b71-18df9e5c0a7f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:09.277949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f654343-9e12-41cd-af4f-75b8c1784431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:09.278586 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f654343-9e12-41cd-af4f-75b8c1784431 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:09.278872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f654343-9e12-41cd-af4f-75b8c1784431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:09.279156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f654343-9e12-41cd-af4f-75b8c1784431 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:09.279849 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f654343-9e12-41cd-af4f-75b8c1784431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:09.281797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f654343-9e12-41cd-af4f-75b8c1784431 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:09.413850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1215/2431] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:42:09 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:42:09.418020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d25873-755f-41ad-a6f8-818dc9574c2c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:09.428470 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d25873-755f-41ad-a6f8-818dc9574c2c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:09.454163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:09.483400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfdbea-5eb6-4aad-86ce-208bd58c7274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:09.484061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfdbea-5eb6-4aad-86ce-208bd58c7274 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:09.484864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfdbea-5eb6-4aad-86ce-208bd58c7274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:09.485162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfdbea-5eb6-4aad-86ce-208bd58c7274 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:09.485870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfdbea-5eb6-4aad-86ce-208bd58c7274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:09.488158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfdbea-5eb6-4aad-86ce-208bd58c7274 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:09.589397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1217/2432] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:42:09 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:42:09.594191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f654343-9e12-41cd-af4f-75b8c1784431 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:09.604453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f654343-9e12-41cd-af4f-75b8c1784431 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:09.609078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3307e7a-5c03-4563-814a-337a7fcd9160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:09.610656 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3307e7a-5c03-4563-814a-337a7fcd9160 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:09.610941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3307e7a-5c03-4563-814a-337a7fcd9160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:09.611217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3307e7a-5c03-4563-814a-337a7fcd9160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:09.611969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3307e7a-5c03-4563-814a-337a7fcd9160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:09.613596 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3307e7a-5c03-4563-814a-337a7fcd9160 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:09.627755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1216/2433] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:09.630008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfdbea-5eb6-4aad-86ce-208bd58c7274 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:09.640089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfdbea-5eb6-4aad-86ce-208bd58c7274 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:09.645462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc0051-e11e-4ab9-8f74-c7c0cfc5271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:09.646119 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc0051-e11e-4ab9-8f74-c7c0cfc5271f admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:09.646401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc0051-e11e-4ab9-8f74-c7c0cfc5271f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:09.646757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc0051-e11e-4ab9-8f74-c7c0cfc5271f admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:09.647479 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc0051-e11e-4ab9-8f74-c7c0cfc5271f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:09.649104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc0051-e11e-4ab9-8f74-c7c0cfc5271f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:09.659244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1218/2434] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:09.663282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3307e7a-5c03-4563-814a-337a7fcd9160 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:09.673371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3307e7a-5c03-4563-814a-337a7fcd9160 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:09.677850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb72276-5040-4803-947e-1611d5bc0d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:09.685945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb72276-5040-4803-947e-1611d5bc0d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:09.685945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb72276-5040-4803-947e-1611d5bc0d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:09.685945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb72276-5040-4803-947e-1611d5bc0d51 admin admin] PATH_INFO: `/v3/projects/3bd0701422cf4ee28b81071a1bb1e4b1/users/a072419b78ac4339b36b1363598fdda2/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:09.694111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb72276-5040-4803-947e-1611d5bc0d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd0701422cf4ee28b81071a1bb1e4b1, user_id=a072419b78ac4339b36b1363598fdda2, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:09.696899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb72276-5040-4803-947e-1611d5bc0d51 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:09.782624 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1217/2435] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:09 2022] PUT /identity/v3/projects/3bd0701422cf4ee28b81071a1bb1e4b1/users/a072419b78ac4339b36b1363598fdda2/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:09.792728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276a5d2-13e0-457e-af69-cb31c41e9f63 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:09.797875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276a5d2-13e0-457e-af69-cb31c41e9f63 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:09.797875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276a5d2-13e0-457e-af69-cb31c41e9f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:09.819601 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b276a5d2-13e0-457e-af69-cb31c41e9f63 None None] MFA Rules not processed for user `a072419b78ac4339b36b1363598fdda2`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:09.820841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b276a5d2-13e0-457e-af69-cb31c41e9f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:09.882980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1219/2436] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:09.887359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb72276-5040-4803-947e-1611d5bc0d51 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:09.928364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:09.948314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb72276-5040-4803-947e-1611d5bc0d51 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:09.953832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04fe23-fffb-45aa-a8c8-2e6ccf265ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:09.954520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04fe23-fffb-45aa-a8c8-2e6ccf265ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:09.954806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04fe23-fffb-45aa-a8c8-2e6ccf265ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:09.955086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04fe23-fffb-45aa-a8c8-2e6ccf265ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:09.955766 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04fe23-fffb-45aa-a8c8-2e6ccf265ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:09.957739 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04fe23-fffb-45aa-a8c8-2e6ccf265ae9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:10.071213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1218/2437] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:42:09 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:42:10.075221 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276a5d2-13e0-457e-af69-cb31c41e9f63 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:10.087419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276a5d2-13e0-457e-af69-cb31c41e9f63 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:10.142297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5d310-8803-4305-ad13-8048702276d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:10.142969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5d310-8803-4305-ad13-8048702276d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.143259 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5d310-8803-4305-ad13-8048702276d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.143541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5d310-8803-4305-ad13-8048702276d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.144276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5d310-8803-4305-ad13-8048702276d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:10.146238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5d310-8803-4305-ad13-8048702276d1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:10.227751 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1220/2438] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:42:10 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:42:10.231676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04fe23-fffb-45aa-a8c8-2e6ccf265ae9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:10.242686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04fe23-fffb-45aa-a8c8-2e6ccf265ae9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:10.247323 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb2c5-e4c2-4c47-92f3-c5afc27845b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:10.247971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb2c5-e4c2-4c47-92f3-c5afc27845b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.248254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb2c5-e4c2-4c47-92f3-c5afc27845b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.248528 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb2c5-e4c2-4c47-92f3-c5afc27845b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.249316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cb2c5-e4c2-4c47-92f3-c5afc27845b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:10.251494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cb2c5-e4c2-4c47-92f3-c5afc27845b2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:10.262093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1219/2439] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:10.266032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5d310-8803-4305-ad13-8048702276d1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:10.276228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5d310-8803-4305-ad13-8048702276d1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:10.280804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debfa51-3b70-4834-846d-df731f15cb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:10.281673 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debfa51-3b70-4834-846d-df731f15cb71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.282314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debfa51-3b70-4834-846d-df731f15cb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.282599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debfa51-3b70-4834-846d-df731f15cb71 admin admin] PATH_INFO: `/v3/projects/b798965da3e34ee4a8a8398139ee63d9/users/1032b9e276894878aa9808506053e67f/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.297281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debfa51-3b70-4834-846d-df731f15cb71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b798965da3e34ee4a8a8398139ee63d9, user_id=1032b9e276894878aa9808506053e67f, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:10.300031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debfa51-3b70-4834-846d-df731f15cb71 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:10.365550 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1221/2440] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:10 2022] PUT /identity/v3/projects/b798965da3e34ee4a8a8398139ee63d9/users/1032b9e276894878aa9808506053e67f/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:10.369380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb2c5-e4c2-4c47-92f3-c5afc27845b2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:10.379363 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb2c5-e4c2-4c47-92f3-c5afc27845b2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:10.433789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22806e8-74e9-498f-9119-6d9763d572e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:10.434456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22806e8-74e9-498f-9119-6d9763d572e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.434746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22806e8-74e9-498f-9119-6d9763d572e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.435028 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22806e8-74e9-498f-9119-6d9763d572e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.435761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22806e8-74e9-498f-9119-6d9763d572e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:10.437434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22806e8-74e9-498f-9119-6d9763d572e6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:10.447070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1220/2441] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:42:10.451181 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debfa51-3b70-4834-846d-df731f15cb71 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:10.456577 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:10.462004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debfa51-3b70-4834-846d-df731f15cb71 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:10.466745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e954ae-12d9-425a-b926-07a7ab8673ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:10.471125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e954ae-12d9-425a-b926-07a7ab8673ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.471125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e954ae-12d9-425a-b926-07a7ab8673ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.471125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e954ae-12d9-425a-b926-07a7ab8673ee admin admin] PATH_INFO: `/v3/projects/b798965da3e34ee4a8a8398139ee63d9/users/1032b9e276894878aa9808506053e67f/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.471125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e954ae-12d9-425a-b926-07a7ab8673ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b798965da3e34ee4a8a8398139ee63d9, user_id=1032b9e276894878aa9808506053e67f, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:10.473295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e954ae-12d9-425a-b926-07a7ab8673ee admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:10.483294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1222/2442] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:10 2022] PUT /identity/v3/projects/b798965da3e34ee4a8a8398139ee63d9/users/1032b9e276894878aa9808506053e67f/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:42:10.494653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea8ca6-a7c2-4b07-af06-e482c8f45b3d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.494951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea8ca6-a7c2-4b07-af06-e482c8f45b3d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.495235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea8ca6-a7c2-4b07-af06-e482c8f45b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.521164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-c2ea8ca6-a7c2-4b07-af06-e482c8f45b3d None None] MFA Rules not processed for user `1032b9e276894878aa9808506053e67f`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:10.522379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c2ea8ca6-a7c2-4b07-af06-e482c8f45b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:10.589817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1221/2443] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:10.600690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e954ae-12d9-425a-b926-07a7ab8673ee admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:10.602368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e6e954ae-12d9-425a-b926-07a7ab8673ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:10.660531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e954ae-12d9-425a-b926-07a7ab8673ee admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:10.664243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edb63a-be78-470a-9f92-99c4f4c40526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:10.664929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb63a-be78-470a-9f92-99c4f4c40526 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:10.665211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb63a-be78-470a-9f92-99c4f4c40526 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:10.665490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb63a-be78-470a-9f92-99c4f4c40526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:10.675066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edb63a-be78-470a-9f92-99c4f4c40526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:10.676482 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edb63a-be78-470a-9f92-99c4f4c40526 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:10.685829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1223/2444] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:13.565255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea8ca6-a7c2-4b07-af06-e482c8f45b3d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:13.599392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:13.626820 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea8ca6-a7c2-4b07-af06-e482c8f45b3d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:13.631417 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:13.632280 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:13.632560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:13.632865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] PATH_INFO: `/v3/users/a072419b78ac4339b36b1363598fdda2` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:13.634032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a072419b78ac4339b36b1363598fdda2)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:13.635940 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:13.836580 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a072419b78ac4339b36b1363598fdda2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:13.837250 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a072419b78ac4339b36b1363598fdda2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:13.914797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a072419b78ac4339b36b1363598fdda2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:13.926493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a072419b78ac4339b36b1363598fdda2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:13.933189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a072419b78ac4339b36b1363598fdda2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:13.939049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1222/2445] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:42:13 2022] DELETE /identity/v3/users/a072419b78ac4339b36b1363598fdda2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:13.943716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed5cab-3761-4b00-af52-d794ff30bbea None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:13.944217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed5cab-3761-4b00-af52-d794ff30bbea None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:13.944348 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed5cab-3761-4b00-af52-d794ff30bbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:13.962073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-04ed5cab-3761-4b00-af52-d794ff30bbea None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:13.966624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-04ed5cab-3761-4b00-af52-d794ff30bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:14.020246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1224/2446] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:14.030660 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:14.032080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:14.089224 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb5529-160b-401c-bde7-ac84c3d5feea admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:14.092699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dddfd9-8f89-4fa8-af04-615c7319dfd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:14.093337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dddfd9-8f89-4fa8-af04-615c7319dfd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:14.093618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dddfd9-8f89-4fa8-af04-615c7319dfd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:14.093895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dddfd9-8f89-4fa8-af04-615c7319dfd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:14.103043 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dddfd9-8f89-4fa8-af04-615c7319dfd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:14.104454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dddfd9-8f89-4fa8-af04-615c7319dfd5 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:14.114224 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1223/2447] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:14.504845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed5cab-3761-4b00-af52-d794ff30bbea None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:14.506361 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-04ed5cab-3761-4b00-af52-d794ff30bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:14.520906 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed5cab-3761-4b00-af52-d794ff30bbea None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:14.526020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:14.526915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:14.527269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:14.527549 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] PATH_INFO: `/v3/projects/3bd0701422cf4ee28b81071a1bb1e4b1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:14.528759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd0701422cf4ee28b81071a1bb1e4b1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:14.532387 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:14.649907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd0701422cf4ee28b81071a1bb1e4b1', 'request_id': 'req-2cc1242e-4a36-4617-827c-cd26f51085ed'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:14.721463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd0701422cf4ee28b81071a1bb1e4b1', 'request_id': 'req-2cc1242e-4a36-4617-827c-cd26f51085ed'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:14.728128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd0701422cf4ee28b81071a1bb1e4b1', 'request_id': 'req-2cc1242e-4a36-4617-827c-cd26f51085ed'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:14.738438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] The token cache is being invalidate because project 3bd0701422cf4ee28b81071a1bb1e4b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:42:14.738726 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:14.739342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:14.740930 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1225/2448] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:42:14 2022] DELETE /identity/v3/projects/3bd0701422cf4ee28b81071a1bb1e4b1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:42:14.750095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dddfd9-8f89-4fa8-af04-615c7319dfd5 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:14.760302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dddfd9-8f89-4fa8-af04-615c7319dfd5 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:14.811705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:14.818958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb883-36e3-4faa-b633-3e3030e0d5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:14.822383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb883-36e3-4faa-b633-3e3030e0d5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:14.822383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb883-36e3-4faa-b633-3e3030e0d5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:14.822383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb883-36e3-4faa-b633-3e3030e0d5e7 admin admin] PATH_INFO: `/v3/users/1032b9e276894878aa9808506053e67f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:14.822383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeb883-36e3-4faa-b633-3e3030e0d5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1032b9e276894878aa9808506053e67f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:14.823564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeb883-36e3-4faa-b633-3e3030e0d5e7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:15.041430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5feeb883-36e3-4faa-b633-3e3030e0d5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1032b9e276894878aa9808506053e67f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:15.042081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5feeb883-36e3-4faa-b633-3e3030e0d5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1032b9e276894878aa9808506053e67f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:15.142803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5feeb883-36e3-4faa-b633-3e3030e0d5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1032b9e276894878aa9808506053e67f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:15.156378 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5feeb883-36e3-4faa-b633-3e3030e0d5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1032b9e276894878aa9808506053e67f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:15.163857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-5feeb883-36e3-4faa-b633-3e3030e0d5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1032b9e276894878aa9808506053e67f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:15.170491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1224/2449] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:42:14 2022] DELETE /identity/v3/users/1032b9e276894878aa9808506053e67f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:15.577930 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:15.579394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:15.592716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1242e-4a36-4617-827c-cd26f51085ed admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:15.605583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:15.649632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe36f67-f677-4b39-bf4a-7e40742090c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:15.650780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe36f67-f677-4b39-bf4a-7e40742090c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:15.651059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe36f67-f677-4b39-bf4a-7e40742090c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:15.651330 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe36f67-f677-4b39-bf4a-7e40742090c7 admin admin] PATH_INFO: `/v3/projects/b798965da3e34ee4a8a8398139ee63d9` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:15.652507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe36f67-f677-4b39-bf4a-7e40742090c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b798965da3e34ee4a8a8398139ee63d9)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:15.654490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe36f67-f677-4b39-bf4a-7e40742090c7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:15.794948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4fe36f67-f677-4b39-bf4a-7e40742090c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b798965da3e34ee4a8a8398139ee63d9', 'request_id': 'req-4fe36f67-f677-4b39-bf4a-7e40742090c7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:15.846303 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4fe36f67-f677-4b39-bf4a-7e40742090c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b798965da3e34ee4a8a8398139ee63d9', 'request_id': 'req-4fe36f67-f677-4b39-bf4a-7e40742090c7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:15.852505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4fe36f67-f677-4b39-bf4a-7e40742090c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b798965da3e34ee4a8a8398139ee63d9', 'request_id': 'req-4fe36f67-f677-4b39-bf4a-7e40742090c7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:15.863342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4fe36f67-f677-4b39-bf4a-7e40742090c7 admin admin] The token cache is being invalidate because project b798965da3e34ee4a8a8398139ee63d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:42:15.863627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4fe36f67-f677-4b39-bf4a-7e40742090c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:15.864262 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-4fe36f67-f677-4b39-bf4a-7e40742090c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:15.865968 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1226/2450] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:42:15 2022] DELETE /identity/v3/projects/b798965da3e34ee4a8a8398139ee63d9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:15.871301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4021e-320a-42ba-96d6-104951dad00b None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:15.871900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4021e-320a-42ba-96d6-104951dad00b None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:15.872049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4021e-320a-42ba-96d6-104951dad00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:15.890456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b8e4021e-320a-42ba-96d6-104951dad00b None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:15.891651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b8e4021e-320a-42ba-96d6-104951dad00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:15.948364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1225/2451] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:15.956323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77791b-f138-4148-bcf4-a8dd4ca2b4ba None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:15.956612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77791b-f138-4148-bcf4-a8dd4ca2b4ba None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:15.956917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77791b-f138-4148-bcf4-a8dd4ca2b4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:15.975432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1d77791b-f138-4148-bcf4-a8dd4ca2b4ba None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:15.978046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1d77791b-f138-4148-bcf4-a8dd4ca2b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:15.984486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1227/2452] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:15.988582 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4021e-320a-42ba-96d6-104951dad00b None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:15.998311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4021e-320a-42ba-96d6-104951dad00b None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:16.002879 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d55cd-e7ec-486b-b464-ef9502c0c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:16.003521 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d55cd-e7ec-486b-b464-ef9502c0c837 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.003805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d55cd-e7ec-486b-b464-ef9502c0c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.004082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d55cd-e7ec-486b-b464-ef9502c0c837 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.004838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d55cd-e7ec-486b-b464-ef9502c0c837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:42:16.005147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d55cd-e7ec-486b-b464-ef9502c0c837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:16.006732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d55cd-e7ec-486b-b464-ef9502c0c837 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:16.018545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1226/2453] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:42:16.022452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77791b-f138-4148-bcf4-a8dd4ca2b4ba None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:16.031890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77791b-f138-4148-bcf4-a8dd4ca2b4ba None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:16.037252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae54fcb-36b7-454f-a4c2-da33d3f41c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:16.037922 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae54fcb-36b7-454f-a4c2-da33d3f41c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.038209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae54fcb-36b7-454f-a4c2-da33d3f41c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.038485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae54fcb-36b7-454f-a4c2-da33d3f41c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.039180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae54fcb-36b7-454f-a4c2-da33d3f41c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:16.041144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae54fcb-36b7-454f-a4c2-da33d3f41c98 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:16.126234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1228/2454] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:42:16 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:42:16.130215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d55cd-e7ec-486b-b464-ef9502c0c837 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:16.140167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d55cd-e7ec-486b-b464-ef9502c0c837 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:16.199161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a31d93-7c23-4d82-901b-75fcec744182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:16.199838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a31d93-7c23-4d82-901b-75fcec744182 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.200122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a31d93-7c23-4d82-901b-75fcec744182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.200401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a31d93-7c23-4d82-901b-75fcec744182 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.201137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a31d93-7c23-4d82-901b-75fcec744182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:16.203078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a31d93-7c23-4d82-901b-75fcec744182 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:16.210997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:16.319828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1227/2455] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:42:16 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:42:16.324017 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae54fcb-36b7-454f-a4c2-da33d3f41c98 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:16.335020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae54fcb-36b7-454f-a4c2-da33d3f41c98 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:16.339582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f369b-9483-4501-810c-bc2d3da627e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:16.340237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f369b-9483-4501-810c-bc2d3da627e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.340516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f369b-9483-4501-810c-bc2d3da627e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.340822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f369b-9483-4501-810c-bc2d3da627e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.341545 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f369b-9483-4501-810c-bc2d3da627e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:16.343159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f369b-9483-4501-810c-bc2d3da627e1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:16.353427 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1229/2456] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:16.357406 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a31d93-7c23-4d82-901b-75fcec744182 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:16.367275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a31d93-7c23-4d82-901b-75fcec744182 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:16.371946 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fc96d-4ffb-42a0-9f40-9594eb936783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:16.372594 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fc96d-4ffb-42a0-9f40-9594eb936783 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.372922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fc96d-4ffb-42a0-9f40-9594eb936783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.373204 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fc96d-4ffb-42a0-9f40-9594eb936783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.373924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fc96d-4ffb-42a0-9f40-9594eb936783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:16.375552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fc96d-4ffb-42a0-9f40-9594eb936783 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:16.386813 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1228/2457] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:16.390722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f369b-9483-4501-810c-bc2d3da627e1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:16.401728 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f369b-9483-4501-810c-bc2d3da627e1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:16.406354 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef01e21-5542-4104-b2d6-8a64009a6a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:16.407230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef01e21-5542-4104-b2d6-8a64009a6a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.407507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef01e21-5542-4104-b2d6-8a64009a6a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.407804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef01e21-5542-4104-b2d6-8a64009a6a85 admin admin] PATH_INFO: `/v3/projects/af59860023ae4300bdd3a57df9f543cf/users/5096d5ee4c2f46b39a32d7fd8cf01f05/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.422184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef01e21-5542-4104-b2d6-8a64009a6a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af59860023ae4300bdd3a57df9f543cf, user_id=5096d5ee4c2f46b39a32d7fd8cf01f05, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:16.424829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef01e21-5542-4104-b2d6-8a64009a6a85 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:16.490608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1230/2458] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:16 2022] PUT /identity/v3/projects/af59860023ae4300bdd3a57df9f543cf/users/5096d5ee4c2f46b39a32d7fd8cf01f05/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:42:16.500822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddf95b-60e6-4c85-8603-99e2653844ab None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.501143 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddf95b-60e6-4c85-8603-99e2653844ab None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.501917 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddf95b-60e6-4c85-8603-99e2653844ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.528603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-44ddf95b-60e6-4c85-8603-99e2653844ab None None] MFA Rules not processed for user `5096d5ee4c2f46b39a32d7fd8cf01f05`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:16.529835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-44ddf95b-60e6-4c85-8603-99e2653844ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:16.593486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1229/2459] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:42:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:16.597800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef01e21-5542-4104-b2d6-8a64009a6a85 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:16.641066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:16.658042 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef01e21-5542-4104-b2d6-8a64009a6a85 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:16.662653 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720acd1-3822-475d-a216-dfcf4fabdac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:16.663304 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720acd1-3822-475d-a216-dfcf4fabdac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.663586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720acd1-3822-475d-a216-dfcf4fabdac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.663862 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720acd1-3822-475d-a216-dfcf4fabdac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.664546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720acd1-3822-475d-a216-dfcf4fabdac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:16.666484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720acd1-3822-475d-a216-dfcf4fabdac0 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:16.743575 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1231/2460] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:42:16 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:42:16.747963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddf95b-60e6-4c85-8603-99e2653844ab None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:16.759206 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddf95b-60e6-4c85-8603-99e2653844ab None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:16.815855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975df7a-271d-47b3-931a-fbbc534ae117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:16.816523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975df7a-271d-47b3-931a-fbbc534ae117 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.816838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975df7a-271d-47b3-931a-fbbc534ae117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.817115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975df7a-271d-47b3-931a-fbbc534ae117 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.817790 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975df7a-271d-47b3-931a-fbbc534ae117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:16.819694 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975df7a-271d-47b3-931a-fbbc534ae117 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:16.890803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1230/2461] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:42:16 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:42:16.894699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720acd1-3822-475d-a216-dfcf4fabdac0 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:16.905281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720acd1-3822-475d-a216-dfcf4fabdac0 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:16.910034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387554fd-f229-40ba-acd4-cacee8813797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:16.910693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387554fd-f229-40ba-acd4-cacee8813797 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.910975 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387554fd-f229-40ba-acd4-cacee8813797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.911251 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387554fd-f229-40ba-acd4-cacee8813797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.911969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387554fd-f229-40ba-acd4-cacee8813797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:16.913662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387554fd-f229-40ba-acd4-cacee8813797 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:16.925392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1232/2462] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:16.929532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975df7a-271d-47b3-931a-fbbc534ae117 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:16.940640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975df7a-271d-47b3-931a-fbbc534ae117 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:16.945239 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de0dc-0db3-4e32-a020-03863c1627d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:16.946109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de0dc-0db3-4e32-a020-03863c1627d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:16.946387 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de0dc-0db3-4e32-a020-03863c1627d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:16.946678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de0dc-0db3-4e32-a020-03863c1627d8 admin admin] PATH_INFO: `/v3/projects/2cbbdf08c120498c83747de0887d3d40/users/1f7fe289266946d188ab5340293021c9/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:16.960988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519de0dc-0db3-4e32-a020-03863c1627d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbbdf08c120498c83747de0887d3d40, user_id=1f7fe289266946d188ab5340293021c9, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:16.963597 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519de0dc-0db3-4e32-a020-03863c1627d8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:17.058058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1231/2463] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:16 2022] PUT /identity/v3/projects/2cbbdf08c120498c83747de0887d3d40/users/1f7fe289266946d188ab5340293021c9/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:42:17.061857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387554fd-f229-40ba-acd4-cacee8813797 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:17.072437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387554fd-f229-40ba-acd4-cacee8813797 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:17.127624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae503e1-55ff-48fd-9f7b-2d0d894c312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:17.128292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae503e1-55ff-48fd-9f7b-2d0d894c312c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.128580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae503e1-55ff-48fd-9f7b-2d0d894c312c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.128895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae503e1-55ff-48fd-9f7b-2d0d894c312c admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.129614 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae503e1-55ff-48fd-9f7b-2d0d894c312c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:17.131222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae503e1-55ff-48fd-9f7b-2d0d894c312c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:17.140835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1233/2464] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:17.144923 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de0dc-0db3-4e32-a020-03863c1627d8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:17.155277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de0dc-0db3-4e32-a020-03863c1627d8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:17.160380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376210f-5020-416f-8a8f-da5d90e5acd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:17.161301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376210f-5020-416f-8a8f-da5d90e5acd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.161584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376210f-5020-416f-8a8f-da5d90e5acd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.161866 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376210f-5020-416f-8a8f-da5d90e5acd6 admin admin] PATH_INFO: `/v3/projects/2cbbdf08c120498c83747de0887d3d40/users/1f7fe289266946d188ab5340293021c9/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.163840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376210f-5020-416f-8a8f-da5d90e5acd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbbdf08c120498c83747de0887d3d40, user_id=1f7fe289266946d188ab5340293021c9, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:17.166491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376210f-5020-416f-8a8f-da5d90e5acd6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:17.177061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1232/2465] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:17 2022] PUT /identity/v3/projects/2cbbdf08c120498c83747de0887d3d40/users/1f7fe289266946d188ab5340293021c9/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:42:17.187676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c1f90-8fe7-4138-b1cc-8a36da66619c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.187966 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c1f90-8fe7-4138-b1cc-8a36da66619c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.188244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c1f90-8fe7-4138-b1cc-8a36da66619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.214081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c69c1f90-8fe7-4138-b1cc-8a36da66619c None None] MFA Rules not processed for user `1f7fe289266946d188ab5340293021c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:17.215284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c69c1f90-8fe7-4138-b1cc-8a36da66619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:17.281188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1234/2466] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:17.299726 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376210f-5020-416f-8a8f-da5d90e5acd6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:17.301465 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6376210f-5020-416f-8a8f-da5d90e5acd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:17.326857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:17.356786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376210f-5020-416f-8a8f-da5d90e5acd6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:17.360446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77895fb-946f-4bbd-996f-948fc64a984e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:17.361646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77895fb-946f-4bbd-996f-948fc64a984e service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:17.361929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77895fb-946f-4bbd-996f-948fc64a984e service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:17.362205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77895fb-946f-4bbd-996f-948fc64a984e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:17.417323 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77895fb-946f-4bbd-996f-948fc64a984e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:17.418674 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77895fb-946f-4bbd-996f-948fc64a984e service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:17.427862 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1233/2467] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:24.369713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c1f90-8fe7-4138-b1cc-8a36da66619c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:24.371174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c69c1f90-8fe7-4138-b1cc-8a36da66619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:24.421992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:24.447864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c1f90-8fe7-4138-b1cc-8a36da66619c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:24.453275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317557-7ec6-407f-ab9a-fc833f230db6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:24.454420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317557-7ec6-407f-ab9a-fc833f230db6 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:24.454704 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317557-7ec6-407f-ab9a-fc833f230db6 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:24.454978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317557-7ec6-407f-ab9a-fc833f230db6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:24.457407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-58317557-7ec6-407f-ab9a-fc833f230db6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:24.468730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58317557-7ec6-407f-ab9a-fc833f230db6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:24.471069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58317557-7ec6-407f-ab9a-fc833f230db6 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:24.481051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1235/2468] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:27.423374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=38 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:34.485558 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=15 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:05.539859 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77895fb-946f-4bbd-996f-948fc64a984e service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:05.541265 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c77895fb-946f-4bbd-996f-948fc64a984e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:05.552196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77895fb-946f-4bbd-996f-948fc64a984e service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:05.555792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eabf3-7a88-4d79-a9e9-ce0f2fd4e902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:05.556447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eabf3-7a88-4d79-a9e9-ce0f2fd4e902 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:05.556763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eabf3-7a88-4d79-a9e9-ce0f2fd4e902 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:05.557039 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eabf3-7a88-4d79-a9e9-ce0f2fd4e902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:05.558696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e40eabf3-7a88-4d79-a9e9-ce0f2fd4e902 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:05.635873 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40eabf3-7a88-4d79-a9e9-ce0f2fd4e902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:05.637339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40eabf3-7a88-4d79-a9e9-ce0f2fd4e902 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:05.646337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1234/2469] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:05.724410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317557-7ec6-407f-ab9a-fc833f230db6 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:45:05.733750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317557-7ec6-407f-ab9a-fc833f230db6 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:45:05.737475 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ab797-fbdc-4e17-a6e8-bac5daf534e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:45:05.738141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ab797-fbdc-4e17-a6e8-bac5daf534e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:45:05.738428 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ab797-fbdc-4e17-a6e8-bac5daf534e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:45:05.738711 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ab797-fbdc-4e17-a6e8-bac5daf534e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:45:05.740476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d22ab797-fbdc-4e17-a6e8-bac5daf534e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:45:05.806977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ab797-fbdc-4e17-a6e8-bac5daf534e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:45:05.808866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ab797-fbdc-4e17-a6e8-bac5daf534e4 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:45:05.827183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1236/2470] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:45:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:45:15.642046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=37 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:15.824565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=36 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:06.662099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eabf3-7a88-4d79-a9e9-ce0f2fd4e902 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:06.664164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e40eabf3-7a88-4d79-a9e9-ce0f2fd4e902 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:06.715147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ab797-fbdc-4e17-a6e8-bac5daf534e4 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:06.715873 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d22ab797-fbdc-4e17-a6e8-bac5daf534e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:06.742331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eabf3-7a88-4d79-a9e9-ce0f2fd4e902 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:06.746489 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684ebd9-6db6-4bea-b674-417eb8001dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:06.747134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ebd9-6db6-4bea-b674-417eb8001dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:06.747425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ebd9-6db6-4bea-b674-417eb8001dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:06.747698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ebd9-6db6-4bea-b674-417eb8001dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:06.749586 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f684ebd9-6db6-4bea-b674-417eb8001dd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:06.778624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ab797-fbdc-4e17-a6e8-bac5daf534e4 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:06.782926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a67b24-4007-4d7a-a735-768d66bebc38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:06.783583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a67b24-4007-4d7a-a735-768d66bebc38 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:06.784103 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a67b24-4007-4d7a-a735-768d66bebc38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:06.784260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a67b24-4007-4d7a-a735-768d66bebc38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:06.786234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-74a67b24-4007-4d7a-a735-768d66bebc38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:06.823276 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684ebd9-6db6-4bea-b674-417eb8001dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:06.824739 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684ebd9-6db6-4bea-b674-417eb8001dd0 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:06.835081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1235/2471] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:06.853725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a67b24-4007-4d7a-a735-768d66bebc38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:06.855213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a67b24-4007-4d7a-a735-768d66bebc38 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:06.866785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1237/2472] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:46:11.801332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684ebd9-6db6-4bea-b674-417eb8001dd0 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:11.814003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684ebd9-6db6-4bea-b674-417eb8001dd0 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:11.820608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176a44d-6d07-4976-9ca3-ccd39582fed9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:11.821550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a44d-6d07-4976-9ca3-ccd39582fed9 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:11.822332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a44d-6d07-4976-9ca3-ccd39582fed9 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:11.822332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a44d-6d07-4976-9ca3-ccd39582fed9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:11.824365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-c176a44d-6d07-4976-9ca3-ccd39582fed9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:11.838615 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176a44d-6d07-4976-9ca3-ccd39582fed9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:11.841630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176a44d-6d07-4976-9ca3-ccd39582fed9 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:11.855029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1236/2473] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:11.907700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a67b24-4007-4d7a-a735-768d66bebc38 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:11.911584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-74a67b24-4007-4d7a-a735-768d66bebc38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:11.938936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a67b24-4007-4d7a-a735-768d66bebc38 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:11.948586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:11.949674 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:11.949954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:11.950232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] PATH_INFO: `/v3/users/fc8869f1b56b46e1844d5f7937fc8986` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:11.951454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8869f1b56b46e1844d5f7937fc8986)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:11.953408 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:12.049257 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176a44d-6d07-4976-9ca3-ccd39582fed9 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:12.061843 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176a44d-6d07-4976-9ca3-ccd39582fed9 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:12.067018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a29b-ae19-4a31-90fe-289caccee56b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:12.067667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a29b-ae19-4a31-90fe-289caccee56b service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:12.067957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a29b-ae19-4a31-90fe-289caccee56b service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:12.068237 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a29b-ae19-4a31-90fe-289caccee56b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:12.070080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-15c9a29b-ae19-4a31-90fe-289caccee56b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:12.083549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a29b-ae19-4a31-90fe-289caccee56b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:12.085198 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a29b-ae19-4a31-90fe-289caccee56b service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:12.096985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1237/2474] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:12.171538 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a29b-ae19-4a31-90fe-289caccee56b service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:12.173135 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-15c9a29b-ae19-4a31-90fe-289caccee56b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:12.194474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a29b-ae19-4a31-90fe-289caccee56b service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:12.195463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8869f1b56b46e1844d5f7937fc8986'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.196786 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8869f1b56b46e1844d5f7937fc8986'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.197302 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8869f1b56b46e1844d5f7937fc8986'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.200390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:12.201708 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:12.201998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:12.202304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] PATH_INFO: `/v3/users/7d740fb903c24d8f851fe03e05cb8afa` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:12.210217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d740fb903c24d8f851fe03e05cb8afa)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:12.210217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:12.212849 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8869f1b56b46e1844d5f7937fc8986'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.220184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8869f1b56b46e1844d5f7937fc8986'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.300820 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1238/2475] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:11 2022] DELETE /identity/v3/users/fc8869f1b56b46e1844d5f7937fc8986 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:12.417196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d740fb903c24d8f851fe03e05cb8afa'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.417851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d740fb903c24d8f851fe03e05cb8afa'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.517472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d740fb903c24d8f851fe03e05cb8afa'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.531688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d740fb903c24d8f851fe03e05cb8afa'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.536894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:12.538819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d740fb903c24d8f851fe03e05cb8afa'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.545493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1238/2476] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:12 2022] DELETE /identity/v3/users/7d740fb903c24d8f851fe03e05cb8afa => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:12.572815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:12.574585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:12.602957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:12.644982 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31271d8d-400d-496b-9b76-101fc3eaceba admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:12.701516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13756b4d-84c3-4f68-8da1-4038058f4865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:12.702430 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13756b4d-84c3-4f68-8da1-4038058f4865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:12.702710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13756b4d-84c3-4f68-8da1-4038058f4865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:12.702987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13756b4d-84c3-4f68-8da1-4038058f4865 admin admin] PATH_INFO: `/v3/projects/3099acc816d04980b81787fd2c432eb4` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:12.713281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13756b4d-84c3-4f68-8da1-4038058f4865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3099acc816d04980b81787fd2c432eb4)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:12.715193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13756b4d-84c3-4f68-8da1-4038058f4865 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:12.833238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:12.840192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:12.846329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-13756b4d-84c3-4f68-8da1-4038058f4865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3099acc816d04980b81787fd2c432eb4', 'request_id': 'req-13756b4d-84c3-4f68-8da1-4038058f4865'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.850331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7b22-e501-457f-88bf-e422b61f27da admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:12.888815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-13756b4d-84c3-4f68-8da1-4038058f4865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3099acc816d04980b81787fd2c432eb4', 'request_id': 'req-13756b4d-84c3-4f68-8da1-4038058f4865'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.896620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-13756b4d-84c3-4f68-8da1-4038058f4865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3099acc816d04980b81787fd2c432eb4', 'request_id': 'req-13756b4d-84c3-4f68-8da1-4038058f4865'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.908626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-13756b4d-84c3-4f68-8da1-4038058f4865 admin admin] The token cache is being invalidate because project 3099acc816d04980b81787fd2c432eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:12.909240 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-13756b4d-84c3-4f68-8da1-4038058f4865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.909318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82a673-7b8e-4719-83ea-f7ede8a8d500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:12.909709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-13756b4d-84c3-4f68-8da1-4038058f4865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:12.910126 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82a673-7b8e-4719-83ea-f7ede8a8d500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:12.910439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82a673-7b8e-4719-83ea-f7ede8a8d500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:12.910747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82a673-7b8e-4719-83ea-f7ede8a8d500 admin admin] PATH_INFO: `/v3/projects/5b8bf9b5dc74423c9c9f7792dbc60bed` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:12.911736 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1239/2477] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:12 2022] DELETE /identity/v3/projects/3099acc816d04980b81787fd2c432eb4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:12.912008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82a673-7b8e-4719-83ea-f7ede8a8d500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8bf9b5dc74423c9c9f7792dbc60bed)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:12.914024 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82a673-7b8e-4719-83ea-f7ede8a8d500 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:12.918094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b6cfe-e232-4ab9-ab34-8af50027b6e4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:12.918449 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b6cfe-e232-4ab9-ab34-8af50027b6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:12.918792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b6cfe-e232-4ab9-ab34-8af50027b6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:12.936943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-108b6cfe-e232-4ab9-ab34-8af50027b6e4 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:12.938235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-108b6cfe-e232-4ab9-ab34-8af50027b6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:12.946363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1240/2478] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:12.953775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e22f1c-2402-4886-8161-e16572a778a3 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:12.954064 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e22f1c-2402-4886-8161-e16572a778a3 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:12.954346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e22f1c-2402-4886-8161-e16572a778a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:12.971607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a7e22f1c-2402-4886-8161-e16572a778a3 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:12.972823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a7e22f1c-2402-4886-8161-e16572a778a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:12.981232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1241/2479] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:12.985090 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e22f1c-2402-4886-8161-e16572a778a3 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:12.994503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e22f1c-2402-4886-8161-e16572a778a3 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:12.999352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098e4de-1aa4-42dd-a2ed-be93fa10c821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:12.999997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098e4de-1aa4-42dd-a2ed-be93fa10c821 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.000279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098e4de-1aa4-42dd-a2ed-be93fa10c821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.000561 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098e4de-1aa4-42dd-a2ed-be93fa10c821 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.001343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098e4de-1aa4-42dd-a2ed-be93fa10c821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:13.001680 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098e4de-1aa4-42dd-a2ed-be93fa10c821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.003432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098e4de-1aa4-42dd-a2ed-be93fa10c821 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.015183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1242/2480] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:46:13.019529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098e4de-1aa4-42dd-a2ed-be93fa10c821 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.031376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098e4de-1aa4-42dd-a2ed-be93fa10c821 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.035978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ac82a673-7b8e-4719-83ea-f7ede8a8d500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8bf9b5dc74423c9c9f7792dbc60bed', 'request_id': 'req-ac82a673-7b8e-4719-83ea-f7ede8a8d500'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:13.043030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ac82a673-7b8e-4719-83ea-f7ede8a8d500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8bf9b5dc74423c9c9f7792dbc60bed', 'request_id': 'req-ac82a673-7b8e-4719-83ea-f7ede8a8d500'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:13.048487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ac82a673-7b8e-4719-83ea-f7ede8a8d500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8bf9b5dc74423c9c9f7792dbc60bed', 'request_id': 'req-ac82a673-7b8e-4719-83ea-f7ede8a8d500'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:13.053678 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:13.093305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab22f2-9302-49d3-8ac2-4ed0df846619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.093983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab22f2-9302-49d3-8ac2-4ed0df846619 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.094247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab22f2-9302-49d3-8ac2-4ed0df846619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.094521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab22f2-9302-49d3-8ac2-4ed0df846619 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.095197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab22f2-9302-49d3-8ac2-4ed0df846619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.097135 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab22f2-9302-49d3-8ac2-4ed0df846619 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.106081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ac82a673-7b8e-4719-83ea-f7ede8a8d500 admin admin] The token cache is being invalidate because project 5b8bf9b5dc74423c9c9f7792dbc60bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:13.106440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ac82a673-7b8e-4719-83ea-f7ede8a8d500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:13.111445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ac82a673-7b8e-4719-83ea-f7ede8a8d500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:13.111445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1239/2481] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:12 2022] DELETE /identity/v3/projects/5b8bf9b5dc74423c9c9f7792dbc60bed => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:13.115130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddf916-e38d-41f3-abc3-2fae0d6f384c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.115417 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddf916-e38d-41f3-abc3-2fae0d6f384c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.115697 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddf916-e38d-41f3-abc3-2fae0d6f384c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.135322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-edddf916-e38d-41f3-abc3-2fae0d6f384c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:13.136508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-edddf916-e38d-41f3-abc3-2fae0d6f384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:13.145487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1240/2482] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:13.153138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7e342-ef51-4c07-99bc-6f621f81aaee None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.153460 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7e342-ef51-4c07-99bc-6f621f81aaee None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.153739 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7e342-ef51-4c07-99bc-6f621f81aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.171228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-74a7e342-ef51-4c07-99bc-6f621f81aaee None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:13.172390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-74a7e342-ef51-4c07-99bc-6f621f81aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:13.175868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1243/2483] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:13 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:46:13.182113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1241/2484] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:13.183856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab22f2-9302-49d3-8ac2-4ed0df846619 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.185230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-deab22f2-9302-49d3-8ac2-4ed0df846619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:13.186133 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7e342-ef51-4c07-99bc-6f621f81aaee None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.195148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7e342-ef51-4c07-99bc-6f621f81aaee None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.248565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab22f2-9302-49d3-8ac2-4ed0df846619 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.249887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18640ca1-d78c-4ffe-9c19-4d6b89b35764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.250543 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640ca1-d78c-4ffe-9c19-4d6b89b35764 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.250829 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640ca1-d78c-4ffe-9c19-4d6b89b35764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.251109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640ca1-d78c-4ffe-9c19-4d6b89b35764 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.251830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18640ca1-d78c-4ffe-9c19-4d6b89b35764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:13.252138 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18640ca1-d78c-4ffe-9c19-4d6b89b35764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.253495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eae1d-7e56-4344-b462-617ac4c5dea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.253756 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18640ca1-d78c-4ffe-9c19-4d6b89b35764 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.254327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eae1d-7e56-4344-b462-617ac4c5dea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.254688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eae1d-7e56-4344-b462-617ac4c5dea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.255145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eae1d-7e56-4344-b462-617ac4c5dea7 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.255921 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952eae1d-7e56-4344-b462-617ac4c5dea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.257907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952eae1d-7e56-4344-b462-617ac4c5dea7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.265277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1242/2485] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:46:13.269150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18640ca1-d78c-4ffe-9c19-4d6b89b35764 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.279335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18640ca1-d78c-4ffe-9c19-4d6b89b35764 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.283957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b395-f6b4-4b8f-bb4d-8e681e313cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.284589 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b395-f6b4-4b8f-bb4d-8e681e313cac admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.284906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b395-f6b4-4b8f-bb4d-8e681e313cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.285185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b395-f6b4-4b8f-bb4d-8e681e313cac admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.285858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b395-f6b4-4b8f-bb4d-8e681e313cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.287736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b395-f6b4-4b8f-bb4d-8e681e313cac admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.291562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:13.370216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1244/2486] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:13 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:13.374009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eae1d-7e56-4344-b462-617ac4c5dea7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.383874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eae1d-7e56-4344-b462-617ac4c5dea7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.388538 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe6ef2-760b-4daf-aed0-ff7992912690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.389201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe6ef2-760b-4daf-aed0-ff7992912690 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.389485 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe6ef2-760b-4daf-aed0-ff7992912690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.389762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe6ef2-760b-4daf-aed0-ff7992912690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.390519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe6ef2-760b-4daf-aed0-ff7992912690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.392100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe6ef2-760b-4daf-aed0-ff7992912690 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.401892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1243/2487] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:13 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:13.404476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1245/2488] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:46:13.407408 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b395-f6b4-4b8f-bb4d-8e681e313cac admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.408892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe6ef2-760b-4daf-aed0-ff7992912690 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.419017 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe6ef2-760b-4daf-aed0-ff7992912690 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.470015 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b395-f6b4-4b8f-bb4d-8e681e313cac admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.474825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a146844-08a2-4bc8-9ac6-0db82b968e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.475590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a146844-08a2-4bc8-9ac6-0db82b968e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.475931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a146844-08a2-4bc8-9ac6-0db82b968e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.476268 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a146844-08a2-4bc8-9ac6-0db82b968e25 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.477499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21355e73-863b-43fc-a7ee-4a1338bfe1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.478903 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a146844-08a2-4bc8-9ac6-0db82b968e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.478988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21355e73-863b-43fc-a7ee-4a1338bfe1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.478988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21355e73-863b-43fc-a7ee-4a1338bfe1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.478988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21355e73-863b-43fc-a7ee-4a1338bfe1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.479607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21355e73-863b-43fc-a7ee-4a1338bfe1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.480753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a146844-08a2-4bc8-9ac6-0db82b968e25 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.481377 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21355e73-863b-43fc-a7ee-4a1338bfe1a7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.491657 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1246/2489] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:46:13.495633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21355e73-863b-43fc-a7ee-4a1338bfe1a7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.506217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21355e73-863b-43fc-a7ee-4a1338bfe1a7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.510939 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9a007-8c9a-45ec-9ae0-1012b9e3c911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.511799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9a007-8c9a-45ec-9ae0-1012b9e3c911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.512095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9a007-8c9a-45ec-9ae0-1012b9e3c911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.512376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9a007-8c9a-45ec-9ae0-1012b9e3c911 admin admin] PATH_INFO: `/v3/projects/18a6aaf8050e410dad9b864d159f7285/users/9e9efab6d5ff460c9fa5fbe7659a83da/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.528612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9a007-8c9a-45ec-9ae0-1012b9e3c911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a6aaf8050e410dad9b864d159f7285, user_id=9e9efab6d5ff460c9fa5fbe7659a83da, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.531301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9a007-8c9a-45ec-9ae0-1012b9e3c911 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.595085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1244/2490] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:13 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:46:13.596325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a146844-08a2-4bc8-9ac6-0db82b968e25 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.606553 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a146844-08a2-4bc8-9ac6-0db82b968e25 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.611142 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6b2fc-b7b3-4d8b-b409-e1734917c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.611792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6b2fc-b7b3-4d8b-b409-e1734917c2ef admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.612165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6b2fc-b7b3-4d8b-b409-e1734917c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.612447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6b2fc-b7b3-4d8b-b409-e1734917c2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.613212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6b2fc-b7b3-4d8b-b409-e1734917c2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.614805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6b2fc-b7b3-4d8b-b409-e1734917c2ef admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.625312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1245/2491] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:13.628472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:13.629181 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6b2fc-b7b3-4d8b-b409-e1734917c2ef admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.633969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1247/2492] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:13 2022] PUT /identity/v3/projects/18a6aaf8050e410dad9b864d159f7285/users/9e9efab6d5ff460c9fa5fbe7659a83da/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:13.640880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6b2fc-b7b3-4d8b-b409-e1734917c2ef admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.644925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02acd5-8532-4fc8-a7ff-c8b19599b782 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.645239 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02acd5-8532-4fc8-a7ff-c8b19599b782 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.645516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02acd5-8532-4fc8-a7ff-c8b19599b782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.672951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-fe02acd5-8532-4fc8-a7ff-c8b19599b782 None None] MFA Rules not processed for user `9e9efab6d5ff460c9fa5fbe7659a83da`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:13.674194 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fe02acd5-8532-4fc8-a7ff-c8b19599b782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:13.699093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9825a8-1486-4a54-afb8-1eba55a491ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.699780 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9825a8-1486-4a54-afb8-1eba55a491ef admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.700049 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9825a8-1486-4a54-afb8-1eba55a491ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.700355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9825a8-1486-4a54-afb8-1eba55a491ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.701188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9825a8-1486-4a54-afb8-1eba55a491ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.702767 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9825a8-1486-4a54-afb8-1eba55a491ef admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.712560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1246/2493] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:46:13.718836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9825a8-1486-4a54-afb8-1eba55a491ef admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.729391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9825a8-1486-4a54-afb8-1eba55a491ef admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.734570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff83e7c-2c61-4760-b91f-b29508feaae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.735470 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff83e7c-2c61-4760-b91f-b29508feaae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.735757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff83e7c-2c61-4760-b91f-b29508feaae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.736035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff83e7c-2c61-4760-b91f-b29508feaae2 admin admin] PATH_INFO: `/v3/projects/82ed5f25a098427ba0812fcc79a2f8ba/users/9761c9cfadac4ca788cd869224b058d9/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.742859 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1248/2494] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:46:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:13.746843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02acd5-8532-4fc8-a7ff-c8b19599b782 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.752218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff83e7c-2c61-4760-b91f-b29508feaae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ed5f25a098427ba0812fcc79a2f8ba, user_id=9761c9cfadac4ca788cd869224b058d9, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.755097 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff83e7c-2c61-4760-b91f-b29508feaae2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.757748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02acd5-8532-4fc8-a7ff-c8b19599b782 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.762341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd3c17-aa5a-414e-a7da-a69935e11da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.762992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd3c17-aa5a-414e-a7da-a69935e11da9 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.763269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd3c17-aa5a-414e-a7da-a69935e11da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.763552 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd3c17-aa5a-414e-a7da-a69935e11da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.764233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd3c17-aa5a-414e-a7da-a69935e11da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.766163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd3c17-aa5a-414e-a7da-a69935e11da9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.803070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1247/2495] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:13 2022] PUT /identity/v3/projects/82ed5f25a098427ba0812fcc79a2f8ba/users/9761c9cfadac4ca788cd869224b058d9/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:13.808780 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39cca7-51ea-4c64-baa8-407e187edf85 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.809072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39cca7-51ea-4c64-baa8-407e187edf85 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.809359 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39cca7-51ea-4c64-baa8-407e187edf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.826141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1a39cca7-51ea-4c64-baa8-407e187edf85 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:13.827337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1a39cca7-51ea-4c64-baa8-407e187edf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:13.856708 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:13.862039 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1249/2496] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:13 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:46:13.866011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd3c17-aa5a-414e-a7da-a69935e11da9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.886466 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1248/2497] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:13.896020 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39cca7-51ea-4c64-baa8-407e187edf85 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:13.897422 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1a39cca7-51ea-4c64-baa8-407e187edf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:13.928011 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd3c17-aa5a-414e-a7da-a69935e11da9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:13.933428 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbd3e5-80ea-45d9-a5ee-08d0da20adc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:13.934197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbd3e5-80ea-45d9-a5ee-08d0da20adc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:13.934488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbd3e5-80ea-45d9-a5ee-08d0da20adc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:13.934775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbd3e5-80ea-45d9-a5ee-08d0da20adc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:13.935462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbd3e5-80ea-45d9-a5ee-08d0da20adc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:13.937438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbd3e5-80ea-45d9-a5ee-08d0da20adc3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:13.955285 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39cca7-51ea-4c64-baa8-407e187edf85 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:14.004955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f38402-fc47-4c38-b395-ee4bab8875c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:14.005600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f38402-fc47-4c38-b395-ee4bab8875c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:14.005885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f38402-fc47-4c38-b395-ee4bab8875c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:14.006166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f38402-fc47-4c38-b395-ee4bab8875c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:14.014585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1250/2498] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:13 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:46:14.015906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f38402-fc47-4c38-b395-ee4bab8875c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:14.017469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f38402-fc47-4c38-b395-ee4bab8875c3 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:14.018471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbd3e5-80ea-45d9-a5ee-08d0da20adc3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:14.028185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1249/2499] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:46:14.028549 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbd3e5-80ea-45d9-a5ee-08d0da20adc3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:14.033349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b8987-c6e6-493c-b010-471a78ff6432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:14.034008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b8987-c6e6-493c-b010-471a78ff6432 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:14.034293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b8987-c6e6-493c-b010-471a78ff6432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:14.034589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b8987-c6e6-493c-b010-471a78ff6432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:14.035296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b8987-c6e6-493c-b010-471a78ff6432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:14.036937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b8987-c6e6-493c-b010-471a78ff6432 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:14.050756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1251/2500] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:14.056720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f38402-fc47-4c38-b395-ee4bab8875c3 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:14.066195 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f38402-fc47-4c38-b395-ee4bab8875c3 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:14.071187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea4e1b-0613-40e5-b67d-519a6bf49b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:14.072153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea4e1b-0613-40e5-b67d-519a6bf49b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:14.072508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea4e1b-0613-40e5-b67d-519a6bf49b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:14.072888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea4e1b-0613-40e5-b67d-519a6bf49b0f admin admin] PATH_INFO: `/v3/projects/eadb8d9887294cc090b5c139ed6b5dd6/users/4c00b55826664f969425a6db2713b995/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:14.089712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea4e1b-0613-40e5-b67d-519a6bf49b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadb8d9887294cc090b5c139ed6b5dd6, user_id=4c00b55826664f969425a6db2713b995, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:14.092361 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea4e1b-0613-40e5-b67d-519a6bf49b0f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:14.174613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1250/2501] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:14 2022] PUT /identity/v3/projects/eadb8d9887294cc090b5c139ed6b5dd6/users/4c00b55826664f969425a6db2713b995/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:14.178517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b8987-c6e6-493c-b010-471a78ff6432 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:14.189665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b8987-c6e6-493c-b010-471a78ff6432 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:14.235510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:14.247848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18676b75-8929-4c34-8f51-86f2093945ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:14.248518 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18676b75-8929-4c34-8f51-86f2093945ff admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:14.248837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18676b75-8929-4c34-8f51-86f2093945ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:14.249118 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18676b75-8929-4c34-8f51-86f2093945ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:14.249969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18676b75-8929-4c34-8f51-86f2093945ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:14.251571 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18676b75-8929-4c34-8f51-86f2093945ff admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:14.261045 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1252/2502] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:14.265375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea4e1b-0613-40e5-b67d-519a6bf49b0f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:14.277236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea4e1b-0613-40e5-b67d-519a6bf49b0f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:14.281998 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdf1ee-1352-49be-bab4-1b3eb680f1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:14.282881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdf1ee-1352-49be-bab4-1b3eb680f1ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:14.283810 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdf1ee-1352-49be-bab4-1b3eb680f1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:14.284103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdf1ee-1352-49be-bab4-1b3eb680f1ae admin admin] PATH_INFO: `/v3/projects/eadb8d9887294cc090b5c139ed6b5dd6/users/4c00b55826664f969425a6db2713b995/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:14.286153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdf1ee-1352-49be-bab4-1b3eb680f1ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadb8d9887294cc090b5c139ed6b5dd6, user_id=4c00b55826664f969425a6db2713b995, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:14.288835 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdf1ee-1352-49be-bab4-1b3eb680f1ae admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:14.300381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1251/2503] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:14 2022] PUT /identity/v3/projects/eadb8d9887294cc090b5c139ed6b5dd6/users/4c00b55826664f969425a6db2713b995/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:14.311227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c1b5-ce24-4064-a92b-8398136313c5 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:14.311643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c1b5-ce24-4064-a92b-8398136313c5 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:14.311936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c1b5-ce24-4064-a92b-8398136313c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:14.340992 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b336c1b5-ce24-4064-a92b-8398136313c5 None None] MFA Rules not processed for user `4c00b55826664f969425a6db2713b995`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:14.342290 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b336c1b5-ce24-4064-a92b-8398136313c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:14.411536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1253/2504] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:46:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:14.422740 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdf1ee-1352-49be-bab4-1b3eb680f1ae admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:14.425443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-36cdf1ee-1352-49be-bab4-1b3eb680f1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:14.485106 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdf1ee-1352-49be-bab4-1b3eb680f1ae admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:14.488982 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0eb77-43f5-4e50-b68a-2c56a8b3bd2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:14.489632 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0eb77-43f5-4e50-b68a-2c56a8b3bd2f service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:14.489916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0eb77-43f5-4e50-b68a-2c56a8b3bd2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:14.490195 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0eb77-43f5-4e50-b68a-2c56a8b3bd2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:14.499332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0eb77-43f5-4e50-b68a-2c56a8b3bd2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:14.500854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0eb77-43f5-4e50-b68a-2c56a8b3bd2f service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:14.506462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:14.512266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1252/2505] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:46:14.744115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336c1b5-ce24-4064-a92b-8398136313c5 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:14.754601 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336c1b5-ce24-4064-a92b-8398136313c5 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:14.759050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42d21a-ffd1-4e1d-83d9-7b22f3ce63d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:14.759740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d21a-ffd1-4e1d-83d9-7b22f3ce63d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:14.760017 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d21a-ffd1-4e1d-83d9-7b22f3ce63d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:14.760299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d21a-ffd1-4e1d-83d9-7b22f3ce63d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:14.822301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42d21a-ffd1-4e1d-83d9-7b22f3ce63d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:14.823771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42d21a-ffd1-4e1d-83d9-7b22f3ce63d9 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:14.832885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1254/2506] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:18.915328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21fb3c-2101-48f4-b92a-b278a9f5a411 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.915799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21fb3c-2101-48f4-b92a-b278a9f5a411 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.915885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21fb3c-2101-48f4-b92a-b278a9f5a411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.945457 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4b21fb3c-2101-48f4-b92a-b278a9f5a411 None None] MFA Rules not processed for user `9761c9cfadac4ca788cd869224b058d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.946754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4b21fb3c-2101-48f4-b92a-b278a9f5a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:19.014017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1253/2507] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:19.029383 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42d21a-ffd1-4e1d-83d9-7b22f3ce63d9 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.031415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-da42d21a-ffd1-4e1d-83d9-7b22f3ce63d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:19.106969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:19.150584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42d21a-ffd1-4e1d-83d9-7b22f3ce63d9 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.156068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7fdc3-38fe-45a1-924b-85b8890641a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.156749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7fdc3-38fe-45a1-924b-85b8890641a2 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.157036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7fdc3-38fe-45a1-924b-85b8890641a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.157310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7fdc3-38fe-45a1-924b-85b8890641a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.165542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7fdc3-38fe-45a1-924b-85b8890641a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.167130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7fdc3-38fe-45a1-924b-85b8890641a2 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.176489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1255/2508] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:21.621973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2842d-e8e8-4c83-8bfc-6b2bf1a8fb3d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.622444 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2842d-e8e8-4c83-8bfc-6b2bf1a8fb3d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.622585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2842d-e8e8-4c83-8bfc-6b2bf1a8fb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.640472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-43f2842d-e8e8-4c83-8bfc-6b2bf1a8fb3d None None] MFA Rules not processed for user `9761c9cfadac4ca788cd869224b058d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:21.642833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-43f2842d-e8e8-4c83-8bfc-6b2bf1a8fb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:21.649923 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1254/2509] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:46:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:21.714764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7fdc3-38fe-45a1-924b-85b8890641a2 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.716781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-10f7fdc3-38fe-45a1-924b-85b8890641a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:21.825048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7fdc3-38fe-45a1-924b-85b8890641a2 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.828908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c4eae-e860-4b2a-abb5-67773ba9e9d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '711d53a7deb94849b577c08dc9165ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.829559 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c4eae-e860-4b2a-abb5-67773ba9e9d3 service glance] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.829845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c4eae-e860-4b2a-abb5-67773ba9e9d3 service glance] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.830123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c4eae-e860-4b2a-abb5-67773ba9e9d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.831931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b67c4eae-e860-4b2a-abb5-67773ba9e9d3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:21.846817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c4eae-e860-4b2a-abb5-67773ba9e9d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.848310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c4eae-e860-4b2a-abb5-67773ba9e9d3 service glance] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.860303 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1256/2510] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:22.149892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2842d-e8e8-4c83-8bfc-6b2bf1a8fb3d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:22.215414 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2842d-e8e8-4c83-8bfc-6b2bf1a8fb3d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:22.219218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0690e9-ae24-46eb-a827-b195d2193cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:22.219903 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0690e9-ae24-46eb-a827-b195d2193cfe service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.220182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0690e9-ae24-46eb-a827-b195d2193cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.220457 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0690e9-ae24-46eb-a827-b195d2193cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.222371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6a0690e9-ae24-46eb-a827-b195d2193cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:22.234721 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0690e9-ae24-46eb-a827-b195d2193cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:22.236175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0690e9-ae24-46eb-a827-b195d2193cfe service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:22.247816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1255/2511] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:46:23.705471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c4eae-e860-4b2a-abb5-67773ba9e9d3 service glance] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:23.706954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b67c4eae-e860-4b2a-abb5-67773ba9e9d3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:23.718334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c4eae-e860-4b2a-abb5-67773ba9e9d3 service glance] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:23.721871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00224a-f4d6-4002-b215-46dbe2f3eddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:23.722506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00224a-f4d6-4002-b215-46dbe2f3eddd service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:23.722797 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00224a-f4d6-4002-b215-46dbe2f3eddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:23.723079 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00224a-f4d6-4002-b215-46dbe2f3eddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:23.724820 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fd00224a-f4d6-4002-b215-46dbe2f3eddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:23.737838 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00224a-f4d6-4002-b215-46dbe2f3eddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:23.739258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00224a-f4d6-4002-b215-46dbe2f3eddd service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:23.750706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1257/2512] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:24.704251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0690e9-ae24-46eb-a827-b195d2193cfe service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:24.705751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-6a0690e9-ae24-46eb-a827-b195d2193cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:24.778265 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0690e9-ae24-46eb-a827-b195d2193cfe service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:24.783466 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686b548-8c17-46ee-8e31-2ffdc04cb722 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:24.784110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686b548-8c17-46ee-8e31-2ffdc04cb722 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:24.784397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686b548-8c17-46ee-8e31-2ffdc04cb722 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:24.784699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686b548-8c17-46ee-8e31-2ffdc04cb722 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:24.786451 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9686b548-8c17-46ee-8e31-2ffdc04cb722 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:24.798399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686b548-8c17-46ee-8e31-2ffdc04cb722 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:24.800000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686b548-8c17-46ee-8e31-2ffdc04cb722 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:24.810500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1256/2513] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:30.622506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00224a-f4d6-4002-b215-46dbe2f3eddd service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:30.631934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00224a-f4d6-4002-b215-46dbe2f3eddd service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:30.636477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f684a9-2c43-4b03-8d99-699db7d807ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:30.637157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f684a9-2c43-4b03-8d99-699db7d807ba service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:30.637438 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f684a9-2c43-4b03-8d99-699db7d807ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:30.637711 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f684a9-2c43-4b03-8d99-699db7d807ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:30.639582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-06f684a9-2c43-4b03-8d99-699db7d807ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:30.649790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f684a9-2c43-4b03-8d99-699db7d807ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:30.651223 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f684a9-2c43-4b03-8d99-699db7d807ba service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:30.660164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1258/2514] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:31.452576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686b548-8c17-46ee-8e31-2ffdc04cb722 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:31.468475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686b548-8c17-46ee-8e31-2ffdc04cb722 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:31.475965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f136d-9d70-4428-9dc1-14bb9eccd643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:31.476809 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f136d-9d70-4428-9dc1-14bb9eccd643 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:31.477266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f136d-9d70-4428-9dc1-14bb9eccd643 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:31.477564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f136d-9d70-4428-9dc1-14bb9eccd643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:31.480360 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-996f136d-9d70-4428-9dc1-14bb9eccd643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:31.494890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f136d-9d70-4428-9dc1-14bb9eccd643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:31.496943 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f136d-9d70-4428-9dc1-14bb9eccd643 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:31.510011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1257/2515] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:37.507093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f684a9-2c43-4b03-8d99-699db7d807ba service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:37.509234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-06f684a9-2c43-4b03-8d99-699db7d807ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:37.526349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f684a9-2c43-4b03-8d99-699db7d807ba service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:37.532269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24cc7f-fa08-48c3-8853-10b2396f586c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:37.533063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24cc7f-fa08-48c3-8853-10b2396f586c service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:37.533350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24cc7f-fa08-48c3-8853-10b2396f586c service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:37.533631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24cc7f-fa08-48c3-8853-10b2396f586c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:37.535414 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5a24cc7f-fa08-48c3-8853-10b2396f586c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:37.548744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24cc7f-fa08-48c3-8853-10b2396f586c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:37.550404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24cc7f-fa08-48c3-8853-10b2396f586c service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:37.562119 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1259/2516] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:41.504675 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:47.558030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=69 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:16.981868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f136d-9d70-4428-9dc1-14bb9eccd643 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:16.991594 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f136d-9d70-4428-9dc1-14bb9eccd643 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:16.995257 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee38d3-2d98-49da-a343-f7ae96cf01b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:16.995894 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee38d3-2d98-49da-a343-f7ae96cf01b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:16.996207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee38d3-2d98-49da-a343-f7ae96cf01b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:16.996489 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee38d3-2d98-49da-a343-f7ae96cf01b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:16.998311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-12ee38d3-2d98-49da-a343-f7ae96cf01b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:17.056850 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee38d3-2d98-49da-a343-f7ae96cf01b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:17.058310 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee38d3-2d98-49da-a343-f7ae96cf01b9 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:17.067549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1258/2517] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:26.400812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24cc7f-fa08-48c3-8853-10b2396f586c service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:26.402321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5a24cc7f-fa08-48c3-8853-10b2396f586c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:26.483947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24cc7f-fa08-48c3-8853-10b2396f586c service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:26.489013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7031b2a-4645-44a5-8f79-ce597b2de563 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:26.489652 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7031b2a-4645-44a5-8f79-ce597b2de563 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:26.489935 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7031b2a-4645-44a5-8f79-ce597b2de563 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:26.490210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7031b2a-4645-44a5-8f79-ce597b2de563 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:26.492038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e7031b2a-4645-44a5-8f79-ce597b2de563 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:26.504144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7031b2a-4645-44a5-8f79-ce597b2de563 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:26.505750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7031b2a-4645-44a5-8f79-ce597b2de563 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:26.516128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1260/2518] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:27.063373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=28 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:36.511764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=37 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:02.454227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee38d3-2d98-49da-a343-f7ae96cf01b9 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:02.473443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee38d3-2d98-49da-a343-f7ae96cf01b9 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:02.477110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21440f-f140-46fd-a3c7-118367a78b95 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '711d53a7deb94849b577c08dc9165ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:02.477749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21440f-f140-46fd-a3c7-118367a78b95 service glance] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:02.478033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21440f-f140-46fd-a3c7-118367a78b95 service glance] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:02.478312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21440f-f140-46fd-a3c7-118367a78b95 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:02.480096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ca21440f-f140-46fd-a3c7-118367a78b95 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application [None req-ca21440f-f140-46fd-a3c7-118367a78b95 service glance] Could not find project: f70efcef7d3943e192668ce4f8688bd2.: keystone.exception.ProjectNotFound: Could not find project: f70efcef7d3943e192668ce4f8688bd2. Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 23 13:48:02.499792 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:48:02.504183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:48:02.505389 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application with Lock( Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:48:02.506449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:48:02.507482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f70efcef7d3943e192668ce4f8688bd2. Jun 23 13:48:02.507482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: ERROR keystone.server.flask.application Jun 23 13:48:02.507482 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1259/2519] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:02 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 23 13:48:02.984628 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7031b2a-4645-44a5-8f79-ce597b2de563 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:02.993829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7031b2a-4645-44a5-8f79-ce597b2de563 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:02.997318 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcb364-e10a-4691-9b9c-b2089e7d7fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:02.997942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcb364-e10a-4691-9b9c-b2089e7d7fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:02.998224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcb364-e10a-4691-9b9c-b2089e7d7fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:02.998497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcb364-e10a-4691-9b9c-b2089e7d7fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:03.000216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-33dcb364-e10a-4691-9b9c-b2089e7d7fc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:03.062542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcb364-e10a-4691-9b9c-b2089e7d7fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:03.063976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcb364-e10a-4691-9b9c-b2089e7d7fc3 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:03.073620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1261/2520] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:12.483709 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=9 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:13.069267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=30 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:15.161147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21440f-f140-46fd-a3c7-118367a78b95 service glance] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:15.260139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21440f-f140-46fd-a3c7-118367a78b95 service glance] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:15.265483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:15.266356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:15.266645 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:15.266924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] PATH_INFO: `/v3/users/9e9efab6d5ff460c9fa5fbe7659a83da` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:15.268120 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9efab6d5ff460c9fa5fbe7659a83da)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:15.270208 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:15.418816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9efab6d5ff460c9fa5fbe7659a83da'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:15.419528 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9efab6d5ff460c9fa5fbe7659a83da'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:15.478826 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9efab6d5ff460c9fa5fbe7659a83da'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:15.491173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9efab6d5ff460c9fa5fbe7659a83da'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:15.498623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9efab6d5ff460c9fa5fbe7659a83da'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:15.504514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1260/2521] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:15 2022] DELETE /identity/v3/users/9e9efab6d5ff460c9fa5fbe7659a83da => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:15.509099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e691891-2f10-46b9-a44f-5bee2602cd64 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:15.519840 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e691891-2f10-46b9-a44f-5bee2602cd64 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:15.519840 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e691891-2f10-46b9-a44f-5bee2602cd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:15.539044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6e691891-2f10-46b9-a44f-5bee2602cd64 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:15.540199 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6e691891-2f10-46b9-a44f-5bee2602cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:15.596954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1262/2522] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:15.607048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:15.608462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:15.677867 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:15.686747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdc643-c640-4e7e-a47b-87762552c099 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:15.690445 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c592f-3790-46ec-9ada-8bc45c50a3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:15.691083 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c592f-3790-46ec-9ada-8bc45c50a3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:15.691366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c592f-3790-46ec-9ada-8bc45c50a3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:15.691643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c592f-3790-46ec-9ada-8bc45c50a3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:15.700685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c592f-3790-46ec-9ada-8bc45c50a3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:15.702100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c592f-3790-46ec-9ada-8bc45c50a3d8 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:15.711451 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1261/2523] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:16.128418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e691891-2f10-46b9-a44f-5bee2602cd64 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:16.130166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6e691891-2f10-46b9-a44f-5bee2602cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:16.144160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e691891-2f10-46b9-a44f-5bee2602cd64 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:16.149413 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:16.150302 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.150584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.150875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] PATH_INFO: `/v3/projects/18a6aaf8050e410dad9b864d159f7285` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:16.152884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a6aaf8050e410dad9b864d159f7285)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:16.154817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:16.277801 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a6aaf8050e410dad9b864d159f7285', 'request_id': 'req-dcf2a723-ec15-4439-9837-9f823108da39'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.358965 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a6aaf8050e410dad9b864d159f7285', 'request_id': 'req-dcf2a723-ec15-4439-9837-9f823108da39'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.366202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a6aaf8050e410dad9b864d159f7285', 'request_id': 'req-dcf2a723-ec15-4439-9837-9f823108da39'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.376785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] The token cache is being invalidate because project 18a6aaf8050e410dad9b864d159f7285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:16.377115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.377799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.379344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1263/2524] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:16 2022] DELETE /identity/v3/projects/18a6aaf8050e410dad9b864d159f7285 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:16.383324 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c592f-3790-46ec-9ada-8bc45c50a3d8 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:16.393560 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c592f-3790-46ec-9ada-8bc45c50a3d8 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:16.450874 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b55695-39f2-4747-907e-3a63f161dca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:16.451728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b55695-39f2-4747-907e-3a63f161dca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.452011 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b55695-39f2-4747-907e-3a63f161dca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.452282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b55695-39f2-4747-907e-3a63f161dca4 admin admin] PATH_INFO: `/v3/users/4c00b55826664f969425a6db2713b995` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:16.453506 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b55695-39f2-4747-907e-3a63f161dca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c00b55826664f969425a6db2713b995)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:16.455385 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b55695-39f2-4747-907e-3a63f161dca4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:16.635404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f1b55695-39f2-4747-907e-3a63f161dca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c00b55826664f969425a6db2713b995'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.636897 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f1b55695-39f2-4747-907e-3a63f161dca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c00b55826664f969425a6db2713b995'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.701766 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f1b55695-39f2-4747-907e-3a63f161dca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c00b55826664f969425a6db2713b995'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.714742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f1b55695-39f2-4747-907e-3a63f161dca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c00b55826664f969425a6db2713b995'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.721613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f1b55695-39f2-4747-907e-3a63f161dca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c00b55826664f969425a6db2713b995'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.727677 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1262/2525] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:16 2022] DELETE /identity/v3/users/4c00b55826664f969425a6db2713b995 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:17.097274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:17.098804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:17.115336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2a723-ec15-4439-9837-9f823108da39 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:17.174368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:17.175622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:17.176070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:17.176528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4 admin admin] PATH_INFO: `/v3/projects/eadb8d9887294cc090b5c139ed6b5dd6` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:17.178425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadb8d9887294cc090b5c139ed6b5dd6)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:17.181727 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:17.197524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:17.296455 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadb8d9887294cc090b5c139ed6b5dd6', 'request_id': 'req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:17.387569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadb8d9887294cc090b5c139ed6b5dd6', 'request_id': 'req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:17.394498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadb8d9887294cc090b5c139ed6b5dd6', 'request_id': 'req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:17.406174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4 admin admin] The token cache is being invalidate because project eadb8d9887294cc090b5c139ed6b5dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:17.406462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:17.407084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7957ab2b-0d9b-49d8-9e10-30af839d9dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:17.408625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1264/2526] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:17 2022] DELETE /identity/v3/projects/eadb8d9887294cc090b5c139ed6b5dd6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:17.413525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53dfe2-4b15-4182-9230-133c83b1d509 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:17.413997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53dfe2-4b15-4182-9230-133c83b1d509 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:17.414194 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53dfe2-4b15-4182-9230-133c83b1d509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:17.432617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2e53dfe2-4b15-4182-9230-133c83b1d509 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:17.433772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2e53dfe2-4b15-4182-9230-133c83b1d509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:17.489541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1263/2527] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:17.498477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c6b0e-beb1-469b-9a98-fd63b5a5e10e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:17.498777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c6b0e-beb1-469b-9a98-fd63b5a5e10e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:17.499087 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c6b0e-beb1-469b-9a98-fd63b5a5e10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:17.517715 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-341c6b0e-beb1-469b-9a98-fd63b5a5e10e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:17.518907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-341c6b0e-beb1-469b-9a98-fd63b5a5e10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:17.526943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1265/2528] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:17.530931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53dfe2-4b15-4182-9230-133c83b1d509 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:17.536837 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:17.540454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53dfe2-4b15-4182-9230-133c83b1d509 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:17.545624 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf94b8a-0123-40ca-8b33-537c131721f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:17.546316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf94b8a-0123-40ca-8b33-537c131721f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:17.549540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf94b8a-0123-40ca-8b33-537c131721f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:17.549540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf94b8a-0123-40ca-8b33-537c131721f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:17.549540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf94b8a-0123-40ca-8b33-537c131721f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:48:17.549540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf94b8a-0123-40ca-8b33-537c131721f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:17.549960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf94b8a-0123-40ca-8b33-537c131721f3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:17.561713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1264/2529] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:48:17.565759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c6b0e-beb1-469b-9a98-fd63b5a5e10e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:17.574812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c6b0e-beb1-469b-9a98-fd63b5a5e10e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:17.579367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a958f-b067-488a-8739-c1b4afdbfb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:17.580004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a958f-b067-488a-8739-c1b4afdbfb3d admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:17.580296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a958f-b067-488a-8739-c1b4afdbfb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:17.580604 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a958f-b067-488a-8739-c1b4afdbfb3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:17.581312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a958f-b067-488a-8739-c1b4afdbfb3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:17.583205 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a958f-b067-488a-8739-c1b4afdbfb3d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:17.651993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1266/2530] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:17 2022] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:17.656234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf94b8a-0123-40ca-8b33-537c131721f3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:17.666147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf94b8a-0123-40ca-8b33-537c131721f3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:17.721600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90c1cf-fa35-4df4-b69a-3d579bc70c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:17.722298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90c1cf-fa35-4df4-b69a-3d579bc70c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:17.722581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90c1cf-fa35-4df4-b69a-3d579bc70c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:17.722854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90c1cf-fa35-4df4-b69a-3d579bc70c49 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:17.723532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90c1cf-fa35-4df4-b69a-3d579bc70c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:17.725483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90c1cf-fa35-4df4-b69a-3d579bc70c49 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:17.799308 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1265/2531] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:17 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:17.803458 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a958f-b067-488a-8739-c1b4afdbfb3d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:17.814512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a958f-b067-488a-8739-c1b4afdbfb3d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:17.819066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94b23e-c0db-4dc7-b01d-839abb2be843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:17.819717 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94b23e-c0db-4dc7-b01d-839abb2be843 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:17.820003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94b23e-c0db-4dc7-b01d-839abb2be843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:17.820278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94b23e-c0db-4dc7-b01d-839abb2be843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:17.821035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94b23e-c0db-4dc7-b01d-839abb2be843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:17.822630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94b23e-c0db-4dc7-b01d-839abb2be843 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:17.833054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1267/2532] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:17.836838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90c1cf-fa35-4df4-b69a-3d579bc70c49 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:17.846698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90c1cf-fa35-4df4-b69a-3d579bc70c49 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:17.851510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422a7de-09d5-4ee7-abb6-908fc2903aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:17.852167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422a7de-09d5-4ee7-abb6-908fc2903aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:17.852478 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422a7de-09d5-4ee7-abb6-908fc2903aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:17.852799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422a7de-09d5-4ee7-abb6-908fc2903aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:17.853526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422a7de-09d5-4ee7-abb6-908fc2903aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:17.855617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422a7de-09d5-4ee7-abb6-908fc2903aa7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:17.865401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1266/2533] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:17.869212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94b23e-c0db-4dc7-b01d-839abb2be843 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:17.879701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94b23e-c0db-4dc7-b01d-839abb2be843 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:17.884281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc008fdf-3a56-40ca-ab65-36ea34a38c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:17.885179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc008fdf-3a56-40ca-ab65-36ea34a38c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:17.885469 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc008fdf-3a56-40ca-ab65-36ea34a38c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:17.885753 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc008fdf-3a56-40ca-ab65-36ea34a38c75 admin admin] PATH_INFO: `/v3/projects/87c533d7afea4b259a01a39d99c8317a/users/d98c7de64fdd424aafcb496397b81d15/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:17.900406 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc008fdf-3a56-40ca-ab65-36ea34a38c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c533d7afea4b259a01a39d99c8317a, user_id=d98c7de64fdd424aafcb496397b81d15, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:17.903599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc008fdf-3a56-40ca-ab65-36ea34a38c75 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:17.970117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1268/2534] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:17 2022] PUT /identity/v3/projects/87c533d7afea4b259a01a39d99c8317a/users/d98c7de64fdd424aafcb496397b81d15/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:17.981056 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf39b58-3027-413c-bad0-556ea8369c73 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:17.981302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf39b58-3027-413c-bad0-556ea8369c73 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:17.981558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf39b58-3027-413c-bad0-556ea8369c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:18.006855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2cf39b58-3027-413c-bad0-556ea8369c73 None None] MFA Rules not processed for user `d98c7de64fdd424aafcb496397b81d15`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:18.008041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2cf39b58-3027-413c-bad0-556ea8369c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:18.071146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1267/2535] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:18.075716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc008fdf-3a56-40ca-ab65-36ea34a38c75 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:18.135556 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc008fdf-3a56-40ca-ab65-36ea34a38c75 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:18.140224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9557525-6285-4a74-97cf-3bc4d19c5f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:18.140904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9557525-6285-4a74-97cf-3bc4d19c5f3f admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:18.141192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9557525-6285-4a74-97cf-3bc4d19c5f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:18.141471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9557525-6285-4a74-97cf-3bc4d19c5f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:18.142163 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9557525-6285-4a74-97cf-3bc4d19c5f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:18.144069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9557525-6285-4a74-97cf-3bc4d19c5f3f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:18.228403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1269/2536] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:18 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:18.233141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf39b58-3027-413c-bad0-556ea8369c73 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:18.243785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf39b58-3027-413c-bad0-556ea8369c73 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:18.306740 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbfea9-ac17-4933-97c5-d2350037704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:18.307451 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbfea9-ac17-4933-97c5-d2350037704a admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:18.307737 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbfea9-ac17-4933-97c5-d2350037704a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:18.308017 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbfea9-ac17-4933-97c5-d2350037704a admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:18.308787 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbfea9-ac17-4933-97c5-d2350037704a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:18.310764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbfea9-ac17-4933-97c5-d2350037704a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:18.317653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:18.439412 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1268/2537] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:18 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:18.443622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9557525-6285-4a74-97cf-3bc4d19c5f3f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:18.454532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9557525-6285-4a74-97cf-3bc4d19c5f3f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:18.459158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfe920-69e1-4b3e-810a-61afc5fc1116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:18.459830 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfe920-69e1-4b3e-810a-61afc5fc1116 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:18.460120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfe920-69e1-4b3e-810a-61afc5fc1116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:18.460402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfe920-69e1-4b3e-810a-61afc5fc1116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:18.461171 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfe920-69e1-4b3e-810a-61afc5fc1116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:18.462775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfe920-69e1-4b3e-810a-61afc5fc1116 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:18.474827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1270/2538] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:18.478824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbfea9-ac17-4933-97c5-d2350037704a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:18.489067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbfea9-ac17-4933-97c5-d2350037704a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:18.493645 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ced8e-bd54-4671-94f2-6939019220dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:18.494522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ced8e-bd54-4671-94f2-6939019220dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:18.494828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ced8e-bd54-4671-94f2-6939019220dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:18.495108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ced8e-bd54-4671-94f2-6939019220dc admin admin] PATH_INFO: `/v3/projects/98c296ef318f4f4eacef0e98bc595ba6/users/ac5fffdea79249149bbf097bf89488b3/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:18.509735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ced8e-bd54-4671-94f2-6939019220dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c296ef318f4f4eacef0e98bc595ba6, user_id=ac5fffdea79249149bbf097bf89488b3, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:18.512924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ced8e-bd54-4671-94f2-6939019220dc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:18.587283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1269/2539] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:18 2022] PUT /identity/v3/projects/98c296ef318f4f4eacef0e98bc595ba6/users/ac5fffdea79249149bbf097bf89488b3/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:18.591821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfe920-69e1-4b3e-810a-61afc5fc1116 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:18.602177 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfe920-69e1-4b3e-810a-61afc5fc1116 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:18.610931 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:18.659616 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86078ee2-dc86-4c90-a752-17a9fec68a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:18.660338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86078ee2-dc86-4c90-a752-17a9fec68a29 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:18.660837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86078ee2-dc86-4c90-a752-17a9fec68a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:18.661123 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86078ee2-dc86-4c90-a752-17a9fec68a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:18.661919 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86078ee2-dc86-4c90-a752-17a9fec68a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:18.663822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86078ee2-dc86-4c90-a752-17a9fec68a29 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:18.674238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1271/2540] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:18.678216 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ced8e-bd54-4671-94f2-6939019220dc admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:18.689089 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ced8e-bd54-4671-94f2-6939019220dc admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:18.693650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72374105-cd1c-4a09-8c16-b20221e90b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:18.694517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374105-cd1c-4a09-8c16-b20221e90b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:18.694799 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374105-cd1c-4a09-8c16-b20221e90b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:18.695077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374105-cd1c-4a09-8c16-b20221e90b47 admin admin] PATH_INFO: `/v3/projects/98c296ef318f4f4eacef0e98bc595ba6/users/ac5fffdea79249149bbf097bf89488b3/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:18.697129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72374105-cd1c-4a09-8c16-b20221e90b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c296ef318f4f4eacef0e98bc595ba6, user_id=ac5fffdea79249149bbf097bf89488b3, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:18.700450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72374105-cd1c-4a09-8c16-b20221e90b47 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:18.710685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1270/2541] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:18 2022] PUT /identity/v3/projects/98c296ef318f4f4eacef0e98bc595ba6/users/ac5fffdea79249149bbf097bf89488b3/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:18.720585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b691-169b-423d-a143-20ecdc03aa84 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:18.720906 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b691-169b-423d-a143-20ecdc03aa84 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:18.721189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b691-169b-423d-a143-20ecdc03aa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:18.750528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a8b6b691-169b-423d-a143-20ecdc03aa84 None None] MFA Rules not processed for user `ac5fffdea79249149bbf097bf89488b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:18.751669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a8b6b691-169b-423d-a143-20ecdc03aa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:18.817873 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1272/2542] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:18.829754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72374105-cd1c-4a09-8c16-b20221e90b47 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:18.831520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-72374105-cd1c-4a09-8c16-b20221e90b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:18.887700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72374105-cd1c-4a09-8c16-b20221e90b47 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:18.891401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5ab15-1dc4-4584-b631-92fe83034024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:18.892033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5ab15-1dc4-4584-b631-92fe83034024 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:18.892314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5ab15-1dc4-4584-b631-92fe83034024 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:18.892618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5ab15-1dc4-4584-b631-92fe83034024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:18.902247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5ab15-1dc4-4584-b631-92fe83034024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:18.903658 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5ab15-1dc4-4584-b631-92fe83034024 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:18.912832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1271/2543] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:18.976546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b691-169b-423d-a143-20ecdc03aa84 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:19.037537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b691-169b-423d-a143-20ecdc03aa84 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:19.042569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:19.043429 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:19.043713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:19.043989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] PATH_INFO: `/v3/users/d98c7de64fdd424aafcb496397b81d15` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:19.045196 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98c7de64fdd424aafcb496397b81d15)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:19.047103 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:19.181245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:19.189328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98c7de64fdd424aafcb496397b81d15'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:19.189989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98c7de64fdd424aafcb496397b81d15'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:19.190604 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98c7de64fdd424aafcb496397b81d15'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:19.202603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98c7de64fdd424aafcb496397b81d15'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:19.209279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98c7de64fdd424aafcb496397b81d15'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:19.295429 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1273/2544] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:18 2022] DELETE /identity/v3/users/d98c7de64fdd424aafcb496397b81d15 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:19.299911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857a264-faef-4a74-a1b7-557f33c57146 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:19.300531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857a264-faef-4a74-a1b7-557f33c57146 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:19.300758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857a264-faef-4a74-a1b7-557f33c57146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:19.322464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8857a264-faef-4a74-a1b7-557f33c57146 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:19.324180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8857a264-faef-4a74-a1b7-557f33c57146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:19.383368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1272/2545] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:19.393549 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:19.394989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:19.454416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9e340-aa07-46a4-bc05-f9bff9cbc78a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:19.458102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cf4a0-a207-4df9-96cc-22c79950c781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:19.458891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cf4a0-a207-4df9-96cc-22c79950c781 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:19.459491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cf4a0-a207-4df9-96cc-22c79950c781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:19.459780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cf4a0-a207-4df9-96cc-22c79950c781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:19.469174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cf4a0-a207-4df9-96cc-22c79950c781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:19.470613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cf4a0-a207-4df9-96cc-22c79950c781 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:19.480217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1274/2546] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:19.839154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857a264-faef-4a74-a1b7-557f33c57146 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:19.840626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8857a264-faef-4a74-a1b7-557f33c57146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:19.853896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857a264-faef-4a74-a1b7-557f33c57146 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:19.859542 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:19.860491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:19.860742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:19.861047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] PATH_INFO: `/v3/projects/87c533d7afea4b259a01a39d99c8317a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:19.862203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c533d7afea4b259a01a39d99c8317a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:19.864149 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:19.970372 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c533d7afea4b259a01a39d99c8317a', 'request_id': 'req-301c13b3-a76b-4197-a813-c04a0939029e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:19.971453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:19.976878 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c533d7afea4b259a01a39d99c8317a', 'request_id': 'req-301c13b3-a76b-4197-a813-c04a0939029e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:19.982476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c533d7afea4b259a01a39d99c8317a', 'request_id': 'req-301c13b3-a76b-4197-a813-c04a0939029e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:20.048920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] The token cache is being invalidate because project 87c533d7afea4b259a01a39d99c8317a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:20.049206 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:20.049825 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:20.051401 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1273/2547] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:19 2022] DELETE /identity/v3/projects/87c533d7afea4b259a01a39d99c8317a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:20.055489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cf4a0-a207-4df9-96cc-22c79950c781 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:20.065509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cf4a0-a207-4df9-96cc-22c79950c781 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:20.120929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260458e-6547-4c43-81cc-f1393806068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:20.121800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260458e-6547-4c43-81cc-f1393806068f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:20.122083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260458e-6547-4c43-81cc-f1393806068f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:20.122354 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260458e-6547-4c43-81cc-f1393806068f admin admin] PATH_INFO: `/v3/users/ac5fffdea79249149bbf097bf89488b3` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:20.123528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260458e-6547-4c43-81cc-f1393806068f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5fffdea79249149bbf097bf89488b3)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:20.125463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260458e-6547-4c43-81cc-f1393806068f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:20.297835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0260458e-6547-4c43-81cc-f1393806068f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5fffdea79249149bbf097bf89488b3'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:20.298494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0260458e-6547-4c43-81cc-f1393806068f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5fffdea79249149bbf097bf89488b3'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:20.299104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0260458e-6547-4c43-81cc-f1393806068f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5fffdea79249149bbf097bf89488b3'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:20.306857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:20.311888 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0260458e-6547-4c43-81cc-f1393806068f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5fffdea79249149bbf097bf89488b3'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:20.318597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-0260458e-6547-4c43-81cc-f1393806068f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5fffdea79249149bbf097bf89488b3'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:20.404651 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1275/2548] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:20 2022] DELETE /identity/v3/users/ac5fffdea79249149bbf097bf89488b3 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:20.777839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:20.779391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:20.793562 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c13b3-a76b-4197-a813-c04a0939029e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:20.850025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7422087-39c8-4555-abe3-b8e23c730149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:20.851289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7422087-39c8-4555-abe3-b8e23c730149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:20.851581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7422087-39c8-4555-abe3-b8e23c730149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:20.851863 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7422087-39c8-4555-abe3-b8e23c730149 admin admin] PATH_INFO: `/v3/projects/98c296ef318f4f4eacef0e98bc595ba6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:20.853081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7422087-39c8-4555-abe3-b8e23c730149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c296ef318f4f4eacef0e98bc595ba6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:20.855536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7422087-39c8-4555-abe3-b8e23c730149 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:20.987410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f7422087-39c8-4555-abe3-b8e23c730149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c296ef318f4f4eacef0e98bc595ba6', 'request_id': 'req-f7422087-39c8-4555-abe3-b8e23c730149'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:20.993593 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f7422087-39c8-4555-abe3-b8e23c730149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c296ef318f4f4eacef0e98bc595ba6', 'request_id': 'req-f7422087-39c8-4555-abe3-b8e23c730149'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:20.998980 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f7422087-39c8-4555-abe3-b8e23c730149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c296ef318f4f4eacef0e98bc595ba6', 'request_id': 'req-f7422087-39c8-4555-abe3-b8e23c730149'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:21.072307 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f7422087-39c8-4555-abe3-b8e23c730149 admin admin] The token cache is being invalidate because project 98c296ef318f4f4eacef0e98bc595ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:21.072596 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f7422087-39c8-4555-abe3-b8e23c730149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:21.073241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f7422087-39c8-4555-abe3-b8e23c730149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:21.075048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1274/2549] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:20 2022] DELETE /identity/v3/projects/98c296ef318f4f4eacef0e98bc595ba6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:21.079901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7435a9d-3125-4c25-b329-11efb79a483a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:21.080195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7435a9d-3125-4c25-b329-11efb79a483a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:21.080478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7435a9d-3125-4c25-b329-11efb79a483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:21.136052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b7435a9d-3125-4c25-b329-11efb79a483a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:21.137225 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b7435a9d-3125-4c25-b329-11efb79a483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:21.195094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1276/2550] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:21.248491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6e8e9-06ba-4686-b043-9b3b98080baa None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:21.248813 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6e8e9-06ba-4686-b043-9b3b98080baa None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:21.249106 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6e8e9-06ba-4686-b043-9b3b98080baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:21.267266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f9c6e8e9-06ba-4686-b043-9b3b98080baa None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:21.268454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f9c6e8e9-06ba-4686-b043-9b3b98080baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:21.277525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1275/2551] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:21.281822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7435a9d-3125-4c25-b329-11efb79a483a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:21.292362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7435a9d-3125-4c25-b329-11efb79a483a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:21.297195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040ed21-4a46-41b4-ab09-0455d1c27108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:21.297854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040ed21-4a46-41b4-ab09-0455d1c27108 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:21.298402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040ed21-4a46-41b4-ab09-0455d1c27108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:21.298402 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040ed21-4a46-41b4-ab09-0455d1c27108 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:21.299126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040ed21-4a46-41b4-ab09-0455d1c27108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:48:21.299437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040ed21-4a46-41b4-ab09-0455d1c27108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:21.301107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040ed21-4a46-41b4-ab09-0455d1c27108 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:21.312638 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1277/2552] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:48:21.316749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6e8e9-06ba-4686-b043-9b3b98080baa None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:21.326290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6e8e9-06ba-4686-b043-9b3b98080baa None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:21.330882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f6e60-5275-472d-bca0-811dec4bdcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:21.331527 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f6e60-5275-472d-bca0-811dec4bdcef admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:21.331812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f6e60-5275-472d-bca0-811dec4bdcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:21.332092 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f6e60-5275-472d-bca0-811dec4bdcef admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:21.332817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f6e60-5275-472d-bca0-811dec4bdcef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:21.334700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f6e60-5275-472d-bca0-811dec4bdcef admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:21.440009 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1276/2553] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:21 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:21.444003 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040ed21-4a46-41b4-ab09-0455d1c27108 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:21.454551 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040ed21-4a46-41b4-ab09-0455d1c27108 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:21.521918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c55da-8213-4b99-97a5-fe6d92eb574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:21.522620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c55da-8213-4b99-97a5-fe6d92eb574d admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:21.522904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c55da-8213-4b99-97a5-fe6d92eb574d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:21.523181 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c55da-8213-4b99-97a5-fe6d92eb574d admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:21.523868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c55da-8213-4b99-97a5-fe6d92eb574d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:21.526676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c55da-8213-4b99-97a5-fe6d92eb574d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:21.604841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1278/2554] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:21 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:21.608898 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f6e60-5275-472d-bca0-811dec4bdcef admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:21.618930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f6e60-5275-472d-bca0-811dec4bdcef admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:21.623493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065392b-7848-427f-a87a-a74f933ffb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:21.624142 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065392b-7848-427f-a87a-a74f933ffb93 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:21.624421 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065392b-7848-427f-a87a-a74f933ffb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:21.624731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065392b-7848-427f-a87a-a74f933ffb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:21.625450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065392b-7848-427f-a87a-a74f933ffb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:21.627021 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065392b-7848-427f-a87a-a74f933ffb93 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:21.637188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1277/2555] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:21.641203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c55da-8213-4b99-97a5-fe6d92eb574d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:21.653206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c55da-8213-4b99-97a5-fe6d92eb574d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:21.658048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617e795-69f4-4679-9210-fca9699b0ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:21.658695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617e795-69f4-4679-9210-fca9699b0ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:21.658981 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617e795-69f4-4679-9210-fca9699b0ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:21.659263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617e795-69f4-4679-9210-fca9699b0ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:21.659987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617e795-69f4-4679-9210-fca9699b0ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:21.661757 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617e795-69f4-4679-9210-fca9699b0ba8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:21.672512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1279/2556] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:21.676712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065392b-7848-427f-a87a-a74f933ffb93 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:21.687130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065392b-7848-427f-a87a-a74f933ffb93 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:21.692141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69389c8e-475f-4fbe-a55e-4455a672405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:21.693102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69389c8e-475f-4fbe-a55e-4455a672405d admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:21.693386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69389c8e-475f-4fbe-a55e-4455a672405d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:21.693665 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69389c8e-475f-4fbe-a55e-4455a672405d admin admin] PATH_INFO: `/v3/projects/a7b2b26774614fc494056bf8b4a972d4/users/25c1fd6ec74841f4ada0bf66ba7b5460/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:21.710731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69389c8e-475f-4fbe-a55e-4455a672405d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b2b26774614fc494056bf8b4a972d4, user_id=25c1fd6ec74841f4ada0bf66ba7b5460, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:21.717178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69389c8e-475f-4fbe-a55e-4455a672405d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:21.717355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:21.844637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1278/2557] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:21 2022] PUT /identity/v3/projects/a7b2b26774614fc494056bf8b4a972d4/users/25c1fd6ec74841f4ada0bf66ba7b5460/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:21.855139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898f29e-6d45-4f5f-af6f-d13c7e91b41b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:21.855432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898f29e-6d45-4f5f-af6f-d13c7e91b41b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:21.855713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898f29e-6d45-4f5f-af6f-d13c7e91b41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:21.874261 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:21.882984 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6898f29e-6d45-4f5f-af6f-d13c7e91b41b None None] MFA Rules not processed for user `25c1fd6ec74841f4ada0bf66ba7b5460`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:21.884146 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6898f29e-6d45-4f5f-af6f-d13c7e91b41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:21.946409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1280/2558] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:21.957525 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69389c8e-475f-4fbe-a55e-4455a672405d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:21.959311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-69389c8e-475f-4fbe-a55e-4455a672405d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:22.016170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69389c8e-475f-4fbe-a55e-4455a672405d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:22.019796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3bc6a-c20d-41d2-81f2-7337ef73e03d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:22.020557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3bc6a-c20d-41d2-81f2-7337ef73e03d service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:22.020868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3bc6a-c20d-41d2-81f2-7337ef73e03d service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:22.021147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3bc6a-c20d-41d2-81f2-7337ef73e03d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:22.029659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3bc6a-c20d-41d2-81f2-7337ef73e03d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:22.031066 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3bc6a-c20d-41d2-81f2-7337ef73e03d service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:22.039706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1279/2559] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:32.033245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=27 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:32.035759 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=28 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:33.486602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898f29e-6d45-4f5f-af6f-d13c7e91b41b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:33.548724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898f29e-6d45-4f5f-af6f-d13c7e91b41b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:33.553313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:33.554215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:33.554507 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:33.554789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] PATH_INFO: `/v3/users/25c1fd6ec74841f4ada0bf66ba7b5460` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:33.555991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c1fd6ec74841f4ada0bf66ba7b5460)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:33.557996 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:33.767470 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c1fd6ec74841f4ada0bf66ba7b5460'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.768086 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c1fd6ec74841f4ada0bf66ba7b5460'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.769025 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c1fd6ec74841f4ada0bf66ba7b5460'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.784501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c1fd6ec74841f4ada0bf66ba7b5460'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.791462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c1fd6ec74841f4ada0bf66ba7b5460'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:33.891052 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1281/2560] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:33 2022] DELETE /identity/v3/users/25c1fd6ec74841f4ada0bf66ba7b5460 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:33.895966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dba57c-dbe6-4868-b3ea-7810f5861154 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:33.896715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dba57c-dbe6-4868-b3ea-7810f5861154 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:33.896816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dba57c-dbe6-4868-b3ea-7810f5861154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:33.913951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-14dba57c-dbe6-4868-b3ea-7810f5861154 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:33.915139 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-14dba57c-dbe6-4868-b3ea-7810f5861154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:33.973670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1280/2561] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:33.983397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:33.984883 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:34.042937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d811-7d7a-4731-a2fd-cafb849dbb75 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:34.046433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a3493-db17-4bc5-8481-f9c8529b6cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:34.047075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a3493-db17-4bc5-8481-f9c8529b6cdd service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:34.047360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a3493-db17-4bc5-8481-f9c8529b6cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:34.047667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a3493-db17-4bc5-8481-f9c8529b6cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:34.057315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a3493-db17-4bc5-8481-f9c8529b6cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:34.058748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a3493-db17-4bc5-8481-f9c8529b6cdd service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:34.068422 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1282/2562] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:34.491682 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dba57c-dbe6-4868-b3ea-7810f5861154 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:34.494912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-14dba57c-dbe6-4868-b3ea-7810f5861154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:34.519532 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dba57c-dbe6-4868-b3ea-7810f5861154 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:34.524492 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcebf3-4047-4bfb-80a1-3a4b72a34878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:34.525939 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcebf3-4047-4bfb-80a1-3a4b72a34878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:34.526249 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcebf3-4047-4bfb-80a1-3a4b72a34878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:34.526524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcebf3-4047-4bfb-80a1-3a4b72a34878 admin admin] PATH_INFO: `/v3/projects/a7b2b26774614fc494056bf8b4a972d4` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:34.527775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcebf3-4047-4bfb-80a1-3a4b72a34878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b2b26774614fc494056bf8b4a972d4)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:34.529978 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcebf3-4047-4bfb-80a1-3a4b72a34878 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:34.653424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-46dcebf3-4047-4bfb-80a1-3a4b72a34878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b2b26774614fc494056bf8b4a972d4', 'request_id': 'req-46dcebf3-4047-4bfb-80a1-3a4b72a34878'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:34.661517 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-46dcebf3-4047-4bfb-80a1-3a4b72a34878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b2b26774614fc494056bf8b4a972d4', 'request_id': 'req-46dcebf3-4047-4bfb-80a1-3a4b72a34878'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:34.669629 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-46dcebf3-4047-4bfb-80a1-3a4b72a34878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b2b26774614fc494056bf8b4a972d4', 'request_id': 'req-46dcebf3-4047-4bfb-80a1-3a4b72a34878'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:34.758154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-46dcebf3-4047-4bfb-80a1-3a4b72a34878 admin admin] The token cache is being invalidate because project a7b2b26774614fc494056bf8b4a972d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:34.758452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-46dcebf3-4047-4bfb-80a1-3a4b72a34878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:34.759072 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-46dcebf3-4047-4bfb-80a1-3a4b72a34878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:34.760650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1281/2563] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:34 2022] DELETE /identity/v3/projects/a7b2b26774614fc494056bf8b4a972d4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:34.765641 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cddf5f-921b-4514-9c44-a53fce4a903e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:34.766104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cddf5f-921b-4514-9c44-a53fce4a903e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:34.766252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cddf5f-921b-4514-9c44-a53fce4a903e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:34.784160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b8cddf5f-921b-4514-9c44-a53fce4a903e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:34.785461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b8cddf5f-921b-4514-9c44-a53fce4a903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:34.802958 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:34.844831 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1283/2564] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:34.852405 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf3a9b-049e-46ac-a8ad-5c1d33166d2e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:34.860938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf3a9b-049e-46ac-a8ad-5c1d33166d2e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:34.860938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf3a9b-049e-46ac-a8ad-5c1d33166d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:34.870958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-7eaf3a9b-049e-46ac-a8ad-5c1d33166d2e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:34.872107 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-7eaf3a9b-049e-46ac-a8ad-5c1d33166d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:34.879953 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1282/2565] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:34.884000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cddf5f-921b-4514-9c44-a53fce4a903e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:34.894687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cddf5f-921b-4514-9c44-a53fce4a903e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:34.899866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db955ade-7f31-4e10-9163-a57b128bfe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:34.901325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db955ade-7f31-4e10-9163-a57b128bfe9f admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:34.901325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db955ade-7f31-4e10-9163-a57b128bfe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:34.901597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db955ade-7f31-4e10-9163-a57b128bfe9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:34.902334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db955ade-7f31-4e10-9163-a57b128bfe9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:48:34.902696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db955ade-7f31-4e10-9163-a57b128bfe9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:34.904265 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db955ade-7f31-4e10-9163-a57b128bfe9f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:34.920521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1284/2566] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:48:34.922326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf3a9b-049e-46ac-a8ad-5c1d33166d2e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:34.932711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf3a9b-049e-46ac-a8ad-5c1d33166d2e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:34.937458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060fc77-a7f8-402c-ac17-3feb0eef21c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:34.938120 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060fc77-a7f8-402c-ac17-3feb0eef21c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:34.938403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060fc77-a7f8-402c-ac17-3feb0eef21c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:34.938684 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060fc77-a7f8-402c-ac17-3feb0eef21c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:34.939486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060fc77-a7f8-402c-ac17-3feb0eef21c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:34.941353 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060fc77-a7f8-402c-ac17-3feb0eef21c2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:35.074153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1283/2567] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:34 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:35.081793 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db955ade-7f31-4e10-9163-a57b128bfe9f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:35.092624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db955ade-7f31-4e10-9163-a57b128bfe9f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:35.149155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac3526-5140-4bae-be5a-78016c022ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:35.149835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac3526-5140-4bae-be5a-78016c022ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.150712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac3526-5140-4bae-be5a-78016c022ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.151017 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac3526-5140-4bae-be5a-78016c022ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.151740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac3526-5140-4bae-be5a-78016c022ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:35.153765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac3526-5140-4bae-be5a-78016c022ba6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:35.256344 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1285/2568] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:35 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:35.262730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060fc77-a7f8-402c-ac17-3feb0eef21c2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:35.273674 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060fc77-a7f8-402c-ac17-3feb0eef21c2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:35.278676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7e163-948c-4efe-bf09-1836fac855a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:35.279349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7e163-948c-4efe-bf09-1836fac855a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.280232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7e163-948c-4efe-bf09-1836fac855a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.280232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7e163-948c-4efe-bf09-1836fac855a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.280870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7e163-948c-4efe-bf09-1836fac855a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:35.283200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7e163-948c-4efe-bf09-1836fac855a9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:35.295732 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1284/2569] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:35.299753 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac3526-5140-4bae-be5a-78016c022ba6 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:35.310464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac3526-5140-4bae-be5a-78016c022ba6 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:35.315106 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba3f89-435a-4f7a-a3ed-9ee9ca4aed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:35.316110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba3f89-435a-4f7a-a3ed-9ee9ca4aed0c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.316110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba3f89-435a-4f7a-a3ed-9ee9ca4aed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.316447 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba3f89-435a-4f7a-a3ed-9ee9ca4aed0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.317030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba3f89-435a-4f7a-a3ed-9ee9ca4aed0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:35.318656 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba3f89-435a-4f7a-a3ed-9ee9ca4aed0c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:35.329124 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1286/2570] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:35.333218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7e163-948c-4efe-bf09-1836fac855a9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:35.343423 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7e163-948c-4efe-bf09-1836fac855a9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:35.348151 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812b9e0-526d-43b5-9d31-4219ae3b9737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:35.349054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812b9e0-526d-43b5-9d31-4219ae3b9737 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.349336 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812b9e0-526d-43b5-9d31-4219ae3b9737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.349610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812b9e0-526d-43b5-9d31-4219ae3b9737 admin admin] PATH_INFO: `/v3/projects/9ac1c12493da4a9c82bfe5ba14a8a6ee/users/9cf90dac6b7546b1952c310f7da6fc8c/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.363946 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812b9e0-526d-43b5-9d31-4219ae3b9737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac1c12493da4a9c82bfe5ba14a8a6ee, user_id=9cf90dac6b7546b1952c310f7da6fc8c, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:35.366621 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812b9e0-526d-43b5-9d31-4219ae3b9737 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:35.461620 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1285/2571] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:35 2022] PUT /identity/v3/projects/9ac1c12493da4a9c82bfe5ba14a8a6ee/users/9cf90dac6b7546b1952c310f7da6fc8c/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:35.471719 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c1362-41e2-4dc0-b37e-0a75ba39abb4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.472049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c1362-41e2-4dc0-b37e-0a75ba39abb4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.472362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c1362-41e2-4dc0-b37e-0a75ba39abb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.499476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e86c1362-41e2-4dc0-b37e-0a75ba39abb4 None None] MFA Rules not processed for user `9cf90dac6b7546b1952c310f7da6fc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:35.500768 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e86c1362-41e2-4dc0-b37e-0a75ba39abb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:35.567215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1287/2572] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:35.571690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812b9e0-526d-43b5-9d31-4219ae3b9737 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:35.592239 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:35.632536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812b9e0-526d-43b5-9d31-4219ae3b9737 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:35.637916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6f87-7116-400b-a6dc-490885ce0b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:35.638976 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6f87-7116-400b-a6dc-490885ce0b0e admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.639800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6f87-7116-400b-a6dc-490885ce0b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.640293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6f87-7116-400b-a6dc-490885ce0b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.641028 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d6f87-7116-400b-a6dc-490885ce0b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:35.642969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d6f87-7116-400b-a6dc-490885ce0b0e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:35.735707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1286/2573] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:35 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:35.739271 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c1362-41e2-4dc0-b37e-0a75ba39abb4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:35.751160 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c1362-41e2-4dc0-b37e-0a75ba39abb4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:35.763707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:35.807867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5c74d-c6d1-4756-b38e-4b10a2ad7387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:35.808840 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5c74d-c6d1-4756-b38e-4b10a2ad7387 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.809382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5c74d-c6d1-4756-b38e-4b10a2ad7387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.809833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5c74d-c6d1-4756-b38e-4b10a2ad7387 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.811181 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5c74d-c6d1-4756-b38e-4b10a2ad7387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:35.813211 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5c74d-c6d1-4756-b38e-4b10a2ad7387 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:35.880209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1288/2574] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:35 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:35.881477 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6f87-7116-400b-a6dc-490885ce0b0e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:35.892254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6f87-7116-400b-a6dc-490885ce0b0e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:35.897322 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5bd54-6a39-4633-b983-64922d94f6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:35.897992 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5bd54-6a39-4633-b983-64922d94f6cc admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.898281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5bd54-6a39-4633-b983-64922d94f6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.898563 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5bd54-6a39-4633-b983-64922d94f6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.899292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5bd54-6a39-4633-b983-64922d94f6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:35.901476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5bd54-6a39-4633-b983-64922d94f6cc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:35.912557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1287/2575] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:35.917723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5c74d-c6d1-4756-b38e-4b10a2ad7387 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:35.929445 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5c74d-c6d1-4756-b38e-4b10a2ad7387 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:35.935875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14043958-3578-46d5-b7d0-856a5a5ece23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:35.935875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14043958-3578-46d5-b7d0-856a5a5ece23 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.935875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14043958-3578-46d5-b7d0-856a5a5ece23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.935875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14043958-3578-46d5-b7d0-856a5a5ece23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.936231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14043958-3578-46d5-b7d0-856a5a5ece23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:35.937781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14043958-3578-46d5-b7d0-856a5a5ece23 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:35.948279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1289/2576] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:35.952522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5bd54-6a39-4633-b983-64922d94f6cc admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:35.963294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5bd54-6a39-4633-b983-64922d94f6cc admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:35.968274 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1537151-1166-4f7b-964b-f4828bda026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:35.969168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1537151-1166-4f7b-964b-f4828bda026b admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.969456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1537151-1166-4f7b-964b-f4828bda026b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.969735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1537151-1166-4f7b-964b-f4828bda026b admin admin] PATH_INFO: `/v3/projects/7e1d71bc106b4644aa96b302daaf7b6f/users/11d500e9fd2d4a75821008e877721e11/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.985302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1537151-1166-4f7b-964b-f4828bda026b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1d71bc106b4644aa96b302daaf7b6f, user_id=11d500e9fd2d4a75821008e877721e11, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:35.987948 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1537151-1166-4f7b-964b-f4828bda026b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:36.073292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1288/2577] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:35 2022] PUT /identity/v3/projects/7e1d71bc106b4644aa96b302daaf7b6f/users/11d500e9fd2d4a75821008e877721e11/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:36.085312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd969-81cd-4c0a-a8e2-4d4c61ab1de0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:36.085312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd969-81cd-4c0a-a8e2-4d4c61ab1de0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:36.085312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd969-81cd-4c0a-a8e2-4d4c61ab1de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:36.118092 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e90dd969-81cd-4c0a-a8e2-4d4c61ab1de0 None None] MFA Rules not processed for user `11d500e9fd2d4a75821008e877721e11`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:36.119496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e90dd969-81cd-4c0a-a8e2-4d4c61ab1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:36.184482 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1290/2578] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:36.188885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1537151-1166-4f7b-964b-f4828bda026b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:36.255469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1537151-1166-4f7b-964b-f4828bda026b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:36.261685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeeea4-7640-4301-ae44-b37c7e3a1f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:36.272035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeeea4-7640-4301-ae44-b37c7e3a1f11 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:36.272035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeeea4-7640-4301-ae44-b37c7e3a1f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:36.272035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeeea4-7640-4301-ae44-b37c7e3a1f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:36.272035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeeea4-7640-4301-ae44-b37c7e3a1f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:36.272035 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeeea4-7640-4301-ae44-b37c7e3a1f11 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:36.348861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1289/2579] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:36 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:36.352732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dd969-81cd-4c0a-a8e2-4d4c61ab1de0 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:36.363401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dd969-81cd-4c0a-a8e2-4d4c61ab1de0 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:36.422269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645cc6d-e70c-41e4-90ed-ffea16d52568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:36.422999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645cc6d-e70c-41e4-90ed-ffea16d52568 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:36.423285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645cc6d-e70c-41e4-90ed-ffea16d52568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:36.423565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645cc6d-e70c-41e4-90ed-ffea16d52568 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:36.424255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645cc6d-e70c-41e4-90ed-ffea16d52568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:36.426213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645cc6d-e70c-41e4-90ed-ffea16d52568 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:36.496294 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1291/2580] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:36 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:36.500317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeeea4-7640-4301-ae44-b37c7e3a1f11 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:36.513060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeeea4-7640-4301-ae44-b37c7e3a1f11 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:36.517697 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fed49-978a-48a7-afe8-33a26c58a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:36.518676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fed49-978a-48a7-afe8-33a26c58a2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:36.519067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fed49-978a-48a7-afe8-33a26c58a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:36.519346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fed49-978a-48a7-afe8-33a26c58a2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:36.520071 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fed49-978a-48a7-afe8-33a26c58a2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:36.522023 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fed49-978a-48a7-afe8-33a26c58a2a3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:36.536965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1290/2581] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:36.538098 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645cc6d-e70c-41e4-90ed-ffea16d52568 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:36.548366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645cc6d-e70c-41e4-90ed-ffea16d52568 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:36.553437 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd86064-b235-4895-9201-54a37f3e6228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:36.554314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd86064-b235-4895-9201-54a37f3e6228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:36.554593 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd86064-b235-4895-9201-54a37f3e6228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:36.554871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd86064-b235-4895-9201-54a37f3e6228 admin admin] PATH_INFO: `/v3/projects/b6cb0ca998444618858a886b6833a6f5/users/e02e9c6474c148c2a31fe9fa22da0da6/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:36.567165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:36.570204 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd86064-b235-4895-9201-54a37f3e6228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cb0ca998444618858a886b6833a6f5, user_id=e02e9c6474c148c2a31fe9fa22da0da6, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:36.573632 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd86064-b235-4895-9201-54a37f3e6228 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:36.633706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1292/2582] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:36 2022] PUT /identity/v3/projects/b6cb0ca998444618858a886b6833a6f5/users/e02e9c6474c148c2a31fe9fa22da0da6/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:36.638356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fed49-978a-48a7-afe8-33a26c58a2a3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:36.648499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fed49-978a-48a7-afe8-33a26c58a2a3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:36.691844 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:36.707425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a5bcf-a43b-4555-8e87-f4a60cb66b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:36.708395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a5bcf-a43b-4555-8e87-f4a60cb66b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:36.708395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a5bcf-a43b-4555-8e87-f4a60cb66b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:36.708712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a5bcf-a43b-4555-8e87-f4a60cb66b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:36.709439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a5bcf-a43b-4555-8e87-f4a60cb66b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:36.711023 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a5bcf-a43b-4555-8e87-f4a60cb66b37 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:36.721545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1291/2583] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:36.725442 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd86064-b235-4895-9201-54a37f3e6228 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:36.735837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd86064-b235-4895-9201-54a37f3e6228 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:36.740644 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35780d39-60ee-4ee0-934d-e920d42ffa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:36.741668 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35780d39-60ee-4ee0-934d-e920d42ffa7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:36.741954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35780d39-60ee-4ee0-934d-e920d42ffa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:36.742229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35780d39-60ee-4ee0-934d-e920d42ffa7f admin admin] PATH_INFO: `/v3/projects/b6cb0ca998444618858a886b6833a6f5/users/e02e9c6474c148c2a31fe9fa22da0da6/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:36.744882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35780d39-60ee-4ee0-934d-e920d42ffa7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cb0ca998444618858a886b6833a6f5, user_id=e02e9c6474c148c2a31fe9fa22da0da6, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:36.747718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35780d39-60ee-4ee0-934d-e920d42ffa7f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:36.758465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1293/2584] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:36 2022] PUT /identity/v3/projects/b6cb0ca998444618858a886b6833a6f5/users/e02e9c6474c148c2a31fe9fa22da0da6/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:36.768868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a6077-eb57-4f42-b167-8c3a1a3da0b2 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:36.769149 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a6077-eb57-4f42-b167-8c3a1a3da0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:36.769430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a6077-eb57-4f42-b167-8c3a1a3da0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:36.771618 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d88db2-228f-496c-a563-4390ceb9c0f4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:36.771915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d88db2-228f-496c-a563-4390ceb9c0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:36.772202 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d88db2-228f-496c-a563-4390ceb9c0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:36.787572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3f0a6077-eb57-4f42-b167-8c3a1a3da0b2 None None] MFA Rules not processed for user `9761c9cfadac4ca788cd869224b058d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:36.793416 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3f0a6077-eb57-4f42-b167-8c3a1a3da0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:36.798180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-60d88db2-228f-496c-a563-4390ceb9c0f4 None None] MFA Rules not processed for user `e02e9c6474c148c2a31fe9fa22da0da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:36.799378 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-60d88db2-228f-496c-a563-4390ceb9c0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:36.845205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1292/2585] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:36.874031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1294/2586] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:36.886171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a6077-eb57-4f42-b167-8c3a1a3da0b2 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:36.887556 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3f0a6077-eb57-4f42-b167-8c3a1a3da0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:36.946152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a6077-eb57-4f42-b167-8c3a1a3da0b2 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:36.950572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131821e9-829f-4eb6-90ab-becb4b0b7de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:36.951225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131821e9-829f-4eb6-90ab-becb4b0b7de3 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:36.951566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131821e9-829f-4eb6-90ab-becb4b0b7de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:36.951852 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131821e9-829f-4eb6-90ab-becb4b0b7de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:37.010673 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131821e9-829f-4eb6-90ab-becb4b0b7de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:37.012062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131821e9-829f-4eb6-90ab-becb4b0b7de3 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:37.021159 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1293/2587] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:37.168409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d88db2-228f-496c-a563-4390ceb9c0f4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:37.179623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-60d88db2-228f-496c-a563-4390ceb9c0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:37.225083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d88db2-228f-496c-a563-4390ceb9c0f4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:37.228644 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ecbe7-18f7-4bab-a49c-633fe40f6f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:37.229306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ecbe7-18f7-4bab-a49c-633fe40f6f7a service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:37.229588 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ecbe7-18f7-4bab-a49c-633fe40f6f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:37.229865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ecbe7-18f7-4bab-a49c-633fe40f6f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:37.231616 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b91ecbe7-18f7-4bab-a49c-633fe40f6f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:37.241081 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ecbe7-18f7-4bab-a49c-633fe40f6f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:37.243210 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ecbe7-18f7-4bab-a49c-633fe40f6f7a service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:37.250995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1295/2588] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:41.005720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131821e9-829f-4eb6-90ab-becb4b0b7de3 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:41.007897 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-131821e9-829f-4eb6-90ab-becb4b0b7de3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:41.020518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131821e9-829f-4eb6-90ab-becb4b0b7de3 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:41.024540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421bc91-111c-441f-a5e7-78f94df028d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:41.025534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421bc91-111c-441f-a5e7-78f94df028d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:41.025966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421bc91-111c-441f-a5e7-78f94df028d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:41.026383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421bc91-111c-441f-a5e7-78f94df028d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:41.067502 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:41.096383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421bc91-111c-441f-a5e7-78f94df028d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:41.096383 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421bc91-111c-441f-a5e7-78f94df028d1 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:41.100443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1294/2589] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:48:42.770976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ecbe7-18f7-4bab-a49c-633fe40f6f7a service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:42.780426 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ecbe7-18f7-4bab-a49c-633fe40f6f7a service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:42.784014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4453644-3fc8-45ee-8102-e1168850a112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:42.784671 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4453644-3fc8-45ee-8102-e1168850a112 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:42.784983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4453644-3fc8-45ee-8102-e1168850a112 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:42.785271 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4453644-3fc8-45ee-8102-e1168850a112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:42.794851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4453644-3fc8-45ee-8102-e1168850a112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:42.796296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4453644-3fc8-45ee-8102-e1168850a112 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:42.806932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1296/2590] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:45.406103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421bc91-111c-441f-a5e7-78f94df028d1 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:45.407504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a421bc91-111c-441f-a5e7-78f94df028d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:45.471342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421bc91-111c-441f-a5e7-78f94df028d1 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:45.475886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:45.476784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:45.477075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:45.477357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] PATH_INFO: `/v3/users/5096d5ee4c2f46b39a32d7fd8cf01f05` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:45.478582 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5096d5ee4c2f46b39a32d7fd8cf01f05)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:45.480496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:45.669025 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5096d5ee4c2f46b39a32d7fd8cf01f05'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:45.669697 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5096d5ee4c2f46b39a32d7fd8cf01f05'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:46.129650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5096d5ee4c2f46b39a32d7fd8cf01f05'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:46.141972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5096d5ee4c2f46b39a32d7fd8cf01f05'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:46.149042 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5096d5ee4c2f46b39a32d7fd8cf01f05'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:46.155053 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1295/2591] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:45 2022] DELETE /identity/v3/users/5096d5ee4c2f46b39a32d7fd8cf01f05 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:46.159673 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6546025-4393-494f-aaad-ea6eb80992c0 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:46.163611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6546025-4393-494f-aaad-ea6eb80992c0 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:46.163611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6546025-4393-494f-aaad-ea6eb80992c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:46.179208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a6546025-4393-494f-aaad-ea6eb80992c0 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:46.186409 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a6546025-4393-494f-aaad-ea6eb80992c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:46.228732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:46.241166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1297/2592] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:46.251466 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:46.255101 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:46.312565 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a852e-6499-4760-8df8-63d7d93f16d9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:46.316183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc533a-522e-4ae0-917e-c2734f7bfb22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:46.316863 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc533a-522e-4ae0-917e-c2734f7bfb22 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:46.318580 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc533a-522e-4ae0-917e-c2734f7bfb22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:46.318580 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc533a-522e-4ae0-917e-c2734f7bfb22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:46.326388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc533a-522e-4ae0-917e-c2734f7bfb22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:46.327811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc533a-522e-4ae0-917e-c2734f7bfb22 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:46.332815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:46.337461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1296/2593] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:46.714379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6546025-4393-494f-aaad-ea6eb80992c0 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:46.715836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a6546025-4393-494f-aaad-ea6eb80992c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:46.731549 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6546025-4393-494f-aaad-ea6eb80992c0 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:46.736265 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:46.738293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:46.738587 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:46.738865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] PATH_INFO: `/v3/projects/af59860023ae4300bdd3a57df9f543cf` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:46.740108 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af59860023ae4300bdd3a57df9f543cf)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:46.750201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:46.914228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af59860023ae4300bdd3a57df9f543cf', 'request_id': 'req-60822b41-5183-4273-8611-71f7c7535ff4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:47.037530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af59860023ae4300bdd3a57df9f543cf', 'request_id': 'req-60822b41-5183-4273-8611-71f7c7535ff4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:47.041564 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af59860023ae4300bdd3a57df9f543cf', 'request_id': 'req-60822b41-5183-4273-8611-71f7c7535ff4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:47.052102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] The token cache is being invalidate because project af59860023ae4300bdd3a57df9f543cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:47.052394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:47.053069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:47.054797 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1298/2594] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:46 2022] DELETE /identity/v3/projects/af59860023ae4300bdd3a57df9f543cf => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:47.058641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc533a-522e-4ae0-917e-c2734f7bfb22 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:47.069367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc533a-522e-4ae0-917e-c2734f7bfb22 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:47.136047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbae22-d5bd-48b1-aba3-dfa77464fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:47.136946 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbae22-d5bd-48b1-aba3-dfa77464fb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:47.137229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbae22-d5bd-48b1-aba3-dfa77464fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:47.137506 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbae22-d5bd-48b1-aba3-dfa77464fb4f admin admin] PATH_INFO: `/v3/users/1f7fe289266946d188ab5340293021c9` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:47.138669 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbae22-d5bd-48b1-aba3-dfa77464fb4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7fe289266946d188ab5340293021c9)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:47.140604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbae22-d5bd-48b1-aba3-dfa77464fb4f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:47.280336 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-10fbae22-d5bd-48b1-aba3-dfa77464fb4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7fe289266946d188ab5340293021c9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:47.281028 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-10fbae22-d5bd-48b1-aba3-dfa77464fb4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7fe289266946d188ab5340293021c9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:47.352283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-10fbae22-d5bd-48b1-aba3-dfa77464fb4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7fe289266946d188ab5340293021c9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:47.364762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-10fbae22-d5bd-48b1-aba3-dfa77464fb4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7fe289266946d188ab5340293021c9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:47.371914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-10fbae22-d5bd-48b1-aba3-dfa77464fb4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7fe289266946d188ab5340293021c9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:47.377833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1297/2595] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:47 2022] DELETE /identity/v3/users/1f7fe289266946d188ab5340293021c9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:47.816770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:47.818358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:47.836000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60822b41-5183-4273-8611-71f7c7535ff4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:47.895978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a1a19-634b-4377-b68f-024bda2f57a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:47.897136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a1a19-634b-4377-b68f-024bda2f57a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:47.897598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a1a19-634b-4377-b68f-024bda2f57a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:47.897891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a1a19-634b-4377-b68f-024bda2f57a4 admin admin] PATH_INFO: `/v3/projects/2cbbdf08c120498c83747de0887d3d40` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:47.899124 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a1a19-634b-4377-b68f-024bda2f57a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbbdf08c120498c83747de0887d3d40)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:47.901662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a1a19-634b-4377-b68f-024bda2f57a4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:48.021636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c42a1a19-634b-4377-b68f-024bda2f57a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbbdf08c120498c83747de0887d3d40', 'request_id': 'req-c42a1a19-634b-4377-b68f-024bda2f57a4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:48.118359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c42a1a19-634b-4377-b68f-024bda2f57a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbbdf08c120498c83747de0887d3d40', 'request_id': 'req-c42a1a19-634b-4377-b68f-024bda2f57a4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:48.125248 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c42a1a19-634b-4377-b68f-024bda2f57a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbbdf08c120498c83747de0887d3d40', 'request_id': 'req-c42a1a19-634b-4377-b68f-024bda2f57a4'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:48.136974 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c42a1a19-634b-4377-b68f-024bda2f57a4 admin admin] The token cache is being invalidate because project 2cbbdf08c120498c83747de0887d3d40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:48.137266 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c42a1a19-634b-4377-b68f-024bda2f57a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:48.137950 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-c42a1a19-634b-4377-b68f-024bda2f57a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:48.139996 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1299/2596] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:47 2022] DELETE /identity/v3/projects/2cbbdf08c120498c83747de0887d3d40 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:48.144946 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1cf6b-4389-417c-ac0a-edce4eac8dbd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:48.145493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1cf6b-4389-417c-ac0a-edce4eac8dbd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:48.145493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1cf6b-4389-417c-ac0a-edce4eac8dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:48.163866 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-dde1cf6b-4389-417c-ac0a-edce4eac8dbd None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:48.165678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dde1cf6b-4389-417c-ac0a-edce4eac8dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:48.231404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1298/2597] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:48.242125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379010d-161a-4c36-9c5f-4139045256a2 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:48.242125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379010d-161a-4c36-9c5f-4139045256a2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:48.242125 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379010d-161a-4c36-9c5f-4139045256a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:48.250040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:48.256185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-a379010d-161a-4c36-9c5f-4139045256a2 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:48.257410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a379010d-161a-4c36-9c5f-4139045256a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:48.265869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1300/2598] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:48.270085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1cf6b-4389-417c-ac0a-edce4eac8dbd None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:48.281266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1cf6b-4389-417c-ac0a-edce4eac8dbd None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:48.287200 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0403-6829-4306-89a3-a5192aa201e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:48.287924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0403-6829-4306-89a3-a5192aa201e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:48.288156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0403-6829-4306-89a3-a5192aa201e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:48.288440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0403-6829-4306-89a3-a5192aa201e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:48.289219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0403-6829-4306-89a3-a5192aa201e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:48:48.295567 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0403-6829-4306-89a3-a5192aa201e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:48.295567 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0403-6829-4306-89a3-a5192aa201e2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:48.303674 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1299/2599] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:48:48.308164 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379010d-161a-4c36-9c5f-4139045256a2 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:48.317712 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379010d-161a-4c36-9c5f-4139045256a2 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:48.322937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4781946-4d9c-41d0-88de-f058e6c37f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:48.323582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781946-4d9c-41d0-88de-f058e6c37f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:48.323972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781946-4d9c-41d0-88de-f058e6c37f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:48.324284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781946-4d9c-41d0-88de-f058e6c37f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:48.325049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4781946-4d9c-41d0-88de-f058e6c37f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:48.326951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4781946-4d9c-41d0-88de-f058e6c37f01 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:48.417084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1301/2600] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:48 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:48.420914 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0403-6829-4306-89a3-a5192aa201e2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:48.431067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0403-6829-4306-89a3-a5192aa201e2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:48.434606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:48.489481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f33ed1-7068-474b-ba6f-dda498d9ddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:48.490558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f33ed1-7068-474b-ba6f-dda498d9ddbb admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:48.491026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f33ed1-7068-474b-ba6f-dda498d9ddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:48.491294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f33ed1-7068-474b-ba6f-dda498d9ddbb admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:48.492261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f33ed1-7068-474b-ba6f-dda498d9ddbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:48.494680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f33ed1-7068-474b-ba6f-dda498d9ddbb admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:48.546242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4781946-4d9c-41d0-88de-f058e6c37f01 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:48.548095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-d4781946-4d9c-41d0-88de-f058e6c37f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:48.561348 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4781946-4d9c-41d0-88de-f058e6c37f01 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:48.566020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af447996-8140-428a-a866-e96b2bcf8e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:48.566875 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af447996-8140-428a-a866-e96b2bcf8e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:48.567155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af447996-8140-428a-a866-e96b2bcf8e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:48.567431 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af447996-8140-428a-a866-e96b2bcf8e13 admin admin] PATH_INFO: `/v3/users/9cf90dac6b7546b1952c310f7da6fc8c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:48.568773 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af447996-8140-428a-a866-e96b2bcf8e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf90dac6b7546b1952c310f7da6fc8c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:48.571032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af447996-8140-428a-a866-e96b2bcf8e13 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:48.615335 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1300/2601] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:48 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:48.619218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f33ed1-7068-474b-ba6f-dda498d9ddbb admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:48.629635 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f33ed1-7068-474b-ba6f-dda498d9ddbb admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:48.635351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89112e7-bfbb-45f6-b335-f63f48a9e263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:48.636040 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89112e7-bfbb-45f6-b335-f63f48a9e263 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:48.636287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89112e7-bfbb-45f6-b335-f63f48a9e263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:48.636648 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89112e7-bfbb-45f6-b335-f63f48a9e263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:48.637374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89112e7-bfbb-45f6-b335-f63f48a9e263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:48.638995 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89112e7-bfbb-45f6-b335-f63f48a9e263 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:48.650112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1301/2602] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:48.653763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89112e7-bfbb-45f6-b335-f63f48a9e263 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:48.663245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89112e7-bfbb-45f6-b335-f63f48a9e263 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:48.667982 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aee2e8-2f29-41c5-9d23-ed09e6c08272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:48.668582 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aee2e8-2f29-41c5-9d23-ed09e6c08272 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:48.668892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aee2e8-2f29-41c5-9d23-ed09e6c08272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:48.669173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aee2e8-2f29-41c5-9d23-ed09e6c08272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:48.669888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aee2e8-2f29-41c5-9d23-ed09e6c08272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:48.671471 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aee2e8-2f29-41c5-9d23-ed09e6c08272 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:48.682084 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1302/2603] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:48.686023 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aee2e8-2f29-41c5-9d23-ed09e6c08272 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:48.697123 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aee2e8-2f29-41c5-9d23-ed09e6c08272 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:48.702117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee7767-d5a8-4269-96cf-236ea61d6dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:48.711830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7767-d5a8-4269-96cf-236ea61d6dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:48.711830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7767-d5a8-4269-96cf-236ea61d6dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:48.711830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7767-d5a8-4269-96cf-236ea61d6dfc admin admin] PATH_INFO: `/v3/projects/30711d5632bd46c183334fad996d884e/users/01665971f24d4e15b6142df27ae1bdb7/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:48.719238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee7767-d5a8-4269-96cf-236ea61d6dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=30711d5632bd46c183334fad996d884e, user_id=01665971f24d4e15b6142df27ae1bdb7, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:48.722099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee7767-d5a8-4269-96cf-236ea61d6dfc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:48.793441 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-af447996-8140-428a-a866-e96b2bcf8e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf90dac6b7546b1952c310f7da6fc8c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:48.794141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-af447996-8140-428a-a866-e96b2bcf8e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf90dac6b7546b1952c310f7da6fc8c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:48.794746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-af447996-8140-428a-a866-e96b2bcf8e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf90dac6b7546b1952c310f7da6fc8c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:48.808342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-af447996-8140-428a-a866-e96b2bcf8e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf90dac6b7546b1952c310f7da6fc8c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:48.815111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-af447996-8140-428a-a866-e96b2bcf8e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf90dac6b7546b1952c310f7da6fc8c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:48.827680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1303/2604] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:48 2022] PUT /identity/v3/projects/30711d5632bd46c183334fad996d884e/users/01665971f24d4e15b6142df27ae1bdb7/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:48.837855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6272d-f54f-4590-a937-d86b6a4b7f52 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:48.838153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6272d-f54f-4590-a937-d86b6a4b7f52 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:48.838438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6272d-f54f-4590-a937-d86b6a4b7f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:48.864817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-52c6272d-f54f-4590-a937-d86b6a4b7f52 None None] MFA Rules not processed for user `01665971f24d4e15b6142df27ae1bdb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:48.866237 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-52c6272d-f54f-4590-a937-d86b6a4b7f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:48.872681 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1302/2605] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:48 2022] DELETE /identity/v3/users/9cf90dac6b7546b1952c310f7da6fc8c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:48.877200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca26b0e-d297-43e5-988f-c16dcd736955 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:48.877545 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca26b0e-d297-43e5-988f-c16dcd736955 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:48.877824 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca26b0e-d297-43e5-988f-c16dcd736955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:48.895379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4ca26b0e-d297-43e5-988f-c16dcd736955 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:48.898398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4ca26b0e-d297-43e5-988f-c16dcd736955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:48.931237 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1304/2606] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:48.935554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6272d-f54f-4590-a937-d86b6a4b7f52 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:48.936889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-52c6272d-f54f-4590-a937-d86b6a4b7f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:48.957265 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1303/2607] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:48.969991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca26b0e-d297-43e5-988f-c16dcd736955 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:48.971325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4ca26b0e-d297-43e5-988f-c16dcd736955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:49.001270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6272d-f54f-4590-a937-d86b6a4b7f52 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:49.006235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f3651-9679-4533-8176-8c1a6dd6e1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:49.006933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f3651-9679-4533-8176-8c1a6dd6e1df admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:49.007226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f3651-9679-4533-8176-8c1a6dd6e1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:49.007510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f3651-9679-4533-8176-8c1a6dd6e1df admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:49.008271 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f3651-9679-4533-8176-8c1a6dd6e1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:49.011276 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f3651-9679-4533-8176-8c1a6dd6e1df admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:49.013589 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:49.027761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca26b0e-d297-43e5-988f-c16dcd736955 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:49.031496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda32ec-3ad6-43c8-8af2-3ce7f14feed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:49.032139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda32ec-3ad6-43c8-8af2-3ce7f14feed8 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:49.032424 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda32ec-3ad6-43c8-8af2-3ce7f14feed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:49.032733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda32ec-3ad6-43c8-8af2-3ce7f14feed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:49.038848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:49.043161 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda32ec-3ad6-43c8-8af2-3ce7f14feed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:49.044589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda32ec-3ad6-43c8-8af2-3ce7f14feed8 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:49.054170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1304/2608] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:48:49.117158 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1305/2609] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:48 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:49.119186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda32ec-3ad6-43c8-8af2-3ce7f14feed8 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:49.129122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda32ec-3ad6-43c8-8af2-3ce7f14feed8 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:49.187468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b5462-113f-4965-8559-e59fd3d8a900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:49.188067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b5462-113f-4965-8559-e59fd3d8a900 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:49.188351 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b5462-113f-4965-8559-e59fd3d8a900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:49.188629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b5462-113f-4965-8559-e59fd3d8a900 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:49.189347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b5462-113f-4965-8559-e59fd3d8a900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:49.191319 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b5462-113f-4965-8559-e59fd3d8a900 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:49.331235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1305/2610] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:49 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:49.335210 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f3651-9679-4533-8176-8c1a6dd6e1df admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:49.346662 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f3651-9679-4533-8176-8c1a6dd6e1df admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:49.351364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd7d7d-54c6-417f-997e-53fc3fa671bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:49.354977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd7d7d-54c6-417f-997e-53fc3fa671bc admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:49.354977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd7d7d-54c6-417f-997e-53fc3fa671bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:49.354977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd7d7d-54c6-417f-997e-53fc3fa671bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:49.354977 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd7d7d-54c6-417f-997e-53fc3fa671bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:49.355566 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd7d7d-54c6-417f-997e-53fc3fa671bc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:49.366875 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1306/2611] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:49.372220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b5462-113f-4965-8559-e59fd3d8a900 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:49.382837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b5462-113f-4965-8559-e59fd3d8a900 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:49.388335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4b2ef-1d2e-4c36-99fc-8f149fa5db7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:49.389068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4b2ef-1d2e-4c36-99fc-8f149fa5db7f admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:49.389358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4b2ef-1d2e-4c36-99fc-8f149fa5db7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:49.389729 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4b2ef-1d2e-4c36-99fc-8f149fa5db7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:49.390470 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4b2ef-1d2e-4c36-99fc-8f149fa5db7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:49.392219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4b2ef-1d2e-4c36-99fc-8f149fa5db7f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:49.404121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1306/2612] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:49.408343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd7d7d-54c6-417f-997e-53fc3fa671bc admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:49.418876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd7d7d-54c6-417f-997e-53fc3fa671bc admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:49.423434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ad137-51f8-4de9-8d2c-76dda166219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:49.424405 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ad137-51f8-4de9-8d2c-76dda166219d admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:49.424627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ad137-51f8-4de9-8d2c-76dda166219d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:49.424947 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ad137-51f8-4de9-8d2c-76dda166219d admin admin] PATH_INFO: `/v3/projects/a994783dfb7943a797c8dde6c83b260e/users/3b212bfff94d4492992142378643957c/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:49.439278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ad137-51f8-4de9-8d2c-76dda166219d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a994783dfb7943a797c8dde6c83b260e, user_id=3b212bfff94d4492992142378643957c, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:49.442187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ad137-51f8-4de9-8d2c-76dda166219d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:49.507858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4b2ef-1d2e-4c36-99fc-8f149fa5db7f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:49.509724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-92e4b2ef-1d2e-4c36-99fc-8f149fa5db7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:49.523157 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4b2ef-1d2e-4c36-99fc-8f149fa5db7f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:49.529451 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:49.530709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:49.531002 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:49.531282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] PATH_INFO: `/v3/projects/9ac1c12493da4a9c82bfe5ba14a8a6ee` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:49.537116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1307/2613] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:49 2022] PUT /identity/v3/projects/a994783dfb7943a797c8dde6c83b260e/users/3b212bfff94d4492992142378643957c/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:49.537598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac1c12493da4a9c82bfe5ba14a8a6ee)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:49.537598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:49.546869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab6ebc-9ad8-49ae-b555-f75768324998 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:49.547165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab6ebc-9ad8-49ae-b555-f75768324998 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:49.547446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab6ebc-9ad8-49ae-b555-f75768324998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:49.575054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-9bab6ebc-9ad8-49ae-b555-f75768324998 None None] MFA Rules not processed for user `3b212bfff94d4492992142378643957c`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:49.576307 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-9bab6ebc-9ad8-49ae-b555-f75768324998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:49.638830 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac1c12493da4a9c82bfe5ba14a8a6ee', 'request_id': 'req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:49.640277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1308/2614] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:49.644769 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab6ebc-9ad8-49ae-b555-f75768324998 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:49.717299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab6ebc-9ad8-49ae-b555-f75768324998 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:49.717938 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac1c12493da4a9c82bfe5ba14a8a6ee', 'request_id': 'req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:49.725258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac1c12493da4a9c82bfe5ba14a8a6ee', 'request_id': 'req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:49.736840 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] The token cache is being invalidate because project 9ac1c12493da4a9c82bfe5ba14a8a6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:49.737236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:49.738005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:49.741440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1307/2615] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:49 2022] DELETE /identity/v3/projects/9ac1c12493da4a9c82bfe5ba14a8a6ee => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:49.742193 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:49.746285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:49.747716 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:49.779888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43894b78-a951-4d9e-aa81-519b037cc696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:49.780630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43894b78-a951-4d9e-aa81-519b037cc696 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:49.780944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43894b78-a951-4d9e-aa81-519b037cc696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:49.781223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43894b78-a951-4d9e-aa81-519b037cc696 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:49.781982 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43894b78-a951-4d9e-aa81-519b037cc696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:49.783964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43894b78-a951-4d9e-aa81-519b037cc696 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:49.818301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:49.823880 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfa43c-afd2-49fd-9a93-f5423feee1f8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:49.829086 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:49.829991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:49.830272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:49.830544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] PATH_INFO: `/v3/users/11d500e9fd2d4a75821008e877721e11` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:49.831858 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d500e9fd2d4a75821008e877721e11)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:49.833833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:49.917029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1309/2616] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:49 2022] POST /identity/v3/projects => generated 383 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:49.918305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43894b78-a951-4d9e-aa81-519b037cc696 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:49.919974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-43894b78-a951-4d9e-aa81-519b037cc696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:49.986242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43894b78-a951-4d9e-aa81-519b037cc696 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:49.991002 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4405c-eafd-47c1-91cf-dd170f7ac03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:49.991668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4405c-eafd-47c1-91cf-dd170f7ac03d admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:49.991952 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4405c-eafd-47c1-91cf-dd170f7ac03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:49.992232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4405c-eafd-47c1-91cf-dd170f7ac03d admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:49.992979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4405c-eafd-47c1-91cf-dd170f7ac03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:49.994915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4405c-eafd-47c1-91cf-dd170f7ac03d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:50.051101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d500e9fd2d4a75821008e877721e11'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:50.051749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d500e9fd2d4a75821008e877721e11'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:50.052376 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d500e9fd2d4a75821008e877721e11'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:50.064687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d500e9fd2d4a75821008e877721e11'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:50.072744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d500e9fd2d4a75821008e877721e11'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:50.098173 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1310/2617] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:49 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:50.099531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4405c-eafd-47c1-91cf-dd170f7ac03d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:50.101189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-82d4405c-eafd-47c1-91cf-dd170f7ac03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:50.114687 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4405c-eafd-47c1-91cf-dd170f7ac03d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:50.119095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42fbc-ae66-42ca-ab4c-705162abc884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:50.119750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42fbc-ae66-42ca-ab4c-705162abc884 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:50.120031 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42fbc-ae66-42ca-ab4c-705162abc884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:50.120304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42fbc-ae66-42ca-ab4c-705162abc884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:50.121059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c42fbc-ae66-42ca-ab4c-705162abc884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:50.122663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c42fbc-ae66-42ca-ab4c-705162abc884 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:50.132446 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1311/2618] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:50.137100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42fbc-ae66-42ca-ab4c-705162abc884 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:50.150132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42fbc-ae66-42ca-ab4c-705162abc884 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:50.155308 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a80ed3-0735-4e16-8b31-c50c55974d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:50.156346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a80ed3-0735-4e16-8b31-c50c55974d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:50.156630 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a80ed3-0735-4e16-8b31-c50c55974d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:50.156944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a80ed3-0735-4e16-8b31-c50c55974d97 admin admin] PATH_INFO: `/v3/projects/0d2ebd3387234a50ad88f74744e391a7/users/e5afbeaf61e447e0908a581824c7c3f1/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:50.169981 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1308/2619] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:49 2022] DELETE /identity/v3/users/11d500e9fd2d4a75821008e877721e11 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:50.177863 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a80ed3-0735-4e16-8b31-c50c55974d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2ebd3387234a50ad88f74744e391a7, user_id=e5afbeaf61e447e0908a581824c7c3f1, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:50.181971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a80ed3-0735-4e16-8b31-c50c55974d97 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:50.283942 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1312/2620] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:50 2022] PUT /identity/v3/projects/0d2ebd3387234a50ad88f74744e391a7/users/e5afbeaf61e447e0908a581824c7c3f1/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:50.288691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:50.354367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d155a6-557e-4517-8aa6-58943d4e96b8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:50.428805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99335d84-752c-4206-88de-fe43796efe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:50.429627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99335d84-752c-4206-88de-fe43796efe09 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:50.430012 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99335d84-752c-4206-88de-fe43796efe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:50.430905 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99335d84-752c-4206-88de-fe43796efe09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:50.431749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99335d84-752c-4206-88de-fe43796efe09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:50.433490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99335d84-752c-4206-88de-fe43796efe09 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:50.450765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1309/2621] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:50.455120 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a80ed3-0735-4e16-8b31-c50c55974d97 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:50.472357 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a80ed3-0735-4e16-8b31-c50c55974d97 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:50.480136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fed047-c4b2-4f59-ba79-6bc39381eee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:50.482813 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fed047-c4b2-4f59-ba79-6bc39381eee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:50.483358 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fed047-c4b2-4f59-ba79-6bc39381eee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:50.484059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fed047-c4b2-4f59-ba79-6bc39381eee4 admin admin] PATH_INFO: `/v3/projects/0d2ebd3387234a50ad88f74744e391a7/users/e5afbeaf61e447e0908a581824c7c3f1/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:50.491010 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fed047-c4b2-4f59-ba79-6bc39381eee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2ebd3387234a50ad88f74744e391a7, user_id=e5afbeaf61e447e0908a581824c7c3f1, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:50.495572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fed047-c4b2-4f59-ba79-6bc39381eee4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:50.518277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1313/2622] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:50 2022] PUT /identity/v3/projects/0d2ebd3387234a50ad88f74744e391a7/users/e5afbeaf61e447e0908a581824c7c3f1/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:50.526179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b83a3-ad55-4d66-be3f-192216b2e882 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:50.526546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b83a3-ad55-4d66-be3f-192216b2e882 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:50.526880 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b83a3-ad55-4d66-be3f-192216b2e882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:50.559112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-593b83a3-ad55-4d66-be3f-192216b2e882 None None] MFA Rules not processed for user `e5afbeaf61e447e0908a581824c7c3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:50.560459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-593b83a3-ad55-4d66-be3f-192216b2e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:50.612731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fed047-c4b2-4f59-ba79-6bc39381eee4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:50.617388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-84fed047-c4b2-4f59-ba79-6bc39381eee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:50.649836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1310/2623] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:50.666582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b83a3-ad55-4d66-be3f-192216b2e882 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:50.667976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-593b83a3-ad55-4d66-be3f-192216b2e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:50.697323 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:50.714667 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fed047-c4b2-4f59-ba79-6bc39381eee4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:50.722316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:50.726315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:50.726315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:50.726315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] PATH_INFO: `/v3/projects/7e1d71bc106b4644aa96b302daaf7b6f` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:50.726315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1d71bc106b4644aa96b302daaf7b6f)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:50.728073 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:50.733741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b83a3-ad55-4d66-be3f-192216b2e882 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:50.737582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480532d-58c0-4a22-a637-a90931e7c7e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:50.738239 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480532d-58c0-4a22-a637-a90931e7c7e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:50.738529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480532d-58c0-4a22-a637-a90931e7c7e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:50.738811 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480532d-58c0-4a22-a637-a90931e7c7e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:50.749391 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480532d-58c0-4a22-a637-a90931e7c7e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:50.751040 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480532d-58c0-4a22-a637-a90931e7c7e4 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:50.761817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1311/2624] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:50.879578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1d71bc106b4644aa96b302daaf7b6f', 'request_id': 'req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:50.885804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1d71bc106b4644aa96b302daaf7b6f', 'request_id': 'req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:50.891245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1d71bc106b4644aa96b302daaf7b6f', 'request_id': 'req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:50.983398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] The token cache is being invalidate because project 7e1d71bc106b4644aa96b302daaf7b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:50.983398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:50.983398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:50.983398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1314/2625] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:50 2022] DELETE /identity/v3/projects/7e1d71bc106b4644aa96b302daaf7b6f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:50.984626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480532d-58c0-4a22-a637-a90931e7c7e4 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:50.995355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480532d-58c0-4a22-a637-a90931e7c7e4 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:51.032508 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:51.038283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:51.045223 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:51.058720 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:51.059749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:51.060029 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:51.060313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] PATH_INFO: `/v3/users/e02e9c6474c148c2a31fe9fa22da0da6` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:51.061645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02e9c6474c148c2a31fe9fa22da0da6)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:51.063698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:51.099915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fce327-ba80-4c86-bfb1-d8d2c2667f5d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:51.104377 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eacd33-1b71-4429-984f-db511565b0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:51.105179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eacd33-1b71-4429-984f-db511565b0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:51.105529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eacd33-1b71-4429-984f-db511565b0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:51.105874 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eacd33-1b71-4429-984f-db511565b0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:51.107750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d3eacd33-1b71-4429-984f-db511565b0c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:51.119823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eacd33-1b71-4429-984f-db511565b0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:51.121330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eacd33-1b71-4429-984f-db511565b0c9 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:51.131224 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1315/2626] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:48:51.262871 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02e9c6474c148c2a31fe9fa22da0da6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:51.263591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02e9c6474c148c2a31fe9fa22da0da6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:51.264268 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02e9c6474c148c2a31fe9fa22da0da6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:51.276955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02e9c6474c148c2a31fe9fa22da0da6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:51.283900 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02e9c6474c148c2a31fe9fa22da0da6'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:51.346355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1312/2627] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:50 2022] DELETE /identity/v3/users/e02e9c6474c148c2a31fe9fa22da0da6 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:51.823307 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eacd33-1b71-4429-984f-db511565b0c9 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:51.825989 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d3eacd33-1b71-4429-984f-db511565b0c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:51.833648 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:51.838099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:51.841964 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eacd33-1b71-4429-984f-db511565b0c9 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:51.894694 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94986110-714e-494e-b8f5-3d339c2bf4c6 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:51.898503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb36a8-f32e-42d5-98f6-5de34bea75ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:51.899175 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb36a8-f32e-42d5-98f6-5de34bea75ad service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:51.899454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb36a8-f32e-42d5-98f6-5de34bea75ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:51.899732 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb36a8-f32e-42d5-98f6-5de34bea75ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:51.901227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51077b7f-b672-488c-8295-549de2e5ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:51.901509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-facb36a8-f32e-42d5-98f6-5de34bea75ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:51.902241 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51077b7f-b672-488c-8295-549de2e5ef39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:51.902596 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51077b7f-b672-488c-8295-549de2e5ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:51.902943 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51077b7f-b672-488c-8295-549de2e5ef39 admin admin] PATH_INFO: `/v3/users/3e3a907a8fe249f8bc0be8438b2c2e51` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:51.904411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51077b7f-b672-488c-8295-549de2e5ef39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3a907a8fe249f8bc0be8438b2c2e51)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:51.906504 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51077b7f-b672-488c-8295-549de2e5ef39 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:51.960179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb36a8-f32e-42d5-98f6-5de34bea75ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:51.961667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb36a8-f32e-42d5-98f6-5de34bea75ad service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:51.973576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1313/2628] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:48:51.974301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb36a8-f32e-42d5-98f6-5de34bea75ad service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:51.975701 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-facb36a8-f32e-42d5-98f6-5de34bea75ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:51.990894 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb36a8-f32e-42d5-98f6-5de34bea75ad service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:51.996194 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d770d75-c646-46e3-918b-99c752c50adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:51.997357 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d770d75-c646-46e3-918b-99c752c50adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:51.997820 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d770d75-c646-46e3-918b-99c752c50adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:51.998107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d770d75-c646-46e3-918b-99c752c50adc admin admin] PATH_INFO: `/v3/projects/b6cb0ca998444618858a886b6833a6f5` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:51.999306 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d770d75-c646-46e3-918b-99c752c50adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6cb0ca998444618858a886b6833a6f5)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:52.001253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d770d75-c646-46e3-918b-99c752c50adc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:52.074522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:52.219795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d770d75-c646-46e3-918b-99c752c50adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6cb0ca998444618858a886b6833a6f5', 'request_id': 'req-5d770d75-c646-46e3-918b-99c752c50adc'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.224870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-51077b7f-b672-488c-8295-549de2e5ef39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3a907a8fe249f8bc0be8438b2c2e51'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.225652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-51077b7f-b672-488c-8295-549de2e5ef39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3a907a8fe249f8bc0be8438b2c2e51'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.329543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d770d75-c646-46e3-918b-99c752c50adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6cb0ca998444618858a886b6833a6f5', 'request_id': 'req-5d770d75-c646-46e3-918b-99c752c50adc'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.336388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d770d75-c646-46e3-918b-99c752c50adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6cb0ca998444618858a886b6833a6f5', 'request_id': 'req-5d770d75-c646-46e3-918b-99c752c50adc'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.341320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:52.350016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d770d75-c646-46e3-918b-99c752c50adc admin admin] The token cache is being invalidate because project b6cb0ca998444618858a886b6833a6f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:52.350304 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d770d75-c646-46e3-918b-99c752c50adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.351031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5d770d75-c646-46e3-918b-99c752c50adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.352759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1314/2629] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:51 2022] DELETE /identity/v3/projects/b6cb0ca998444618858a886b6833a6f5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:52.357255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fc167-960f-4543-b83a-13b361d94d54 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:52.357547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fc167-960f-4543-b83a-13b361d94d54 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:52.357823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fc167-960f-4543-b83a-13b361d94d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:52.375079 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e18fc167-960f-4543-b83a-13b361d94d54 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:52.376281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e18fc167-960f-4543-b83a-13b361d94d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:52.386320 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-51077b7f-b672-488c-8295-549de2e5ef39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3a907a8fe249f8bc0be8438b2c2e51'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.398753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-51077b7f-b672-488c-8295-549de2e5ef39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3a907a8fe249f8bc0be8438b2c2e51'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.406180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-51077b7f-b672-488c-8295-549de2e5ef39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3a907a8fe249f8bc0be8438b2c2e51'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.412358 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1316/2630] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:51 2022] DELETE /identity/v3/users/3e3a907a8fe249f8bc0be8438b2c2e51 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:52.437949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1315/2631] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:52.445834 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b9bed-9de1-4571-b366-7b167fdc18d9 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:52.447271 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b9bed-9de1-4571-b366-7b167fdc18d9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:52.447271 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b9bed-9de1-4571-b366-7b167fdc18d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:52.466654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-fc2b9bed-9de1-4571-b366-7b167fdc18d9 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:52.468386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fc2b9bed-9de1-4571-b366-7b167fdc18d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:52.529196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1317/2632] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:52.533380 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fc167-960f-4543-b83a-13b361d94d54 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:52.543247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fc167-960f-4543-b83a-13b361d94d54 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:52.548109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719807b2-c643-460c-b3e7-5758f5aa097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:52.548788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719807b2-c643-460c-b3e7-5758f5aa097d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:52.551540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719807b2-c643-460c-b3e7-5758f5aa097d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:52.551540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719807b2-c643-460c-b3e7-5758f5aa097d admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:52.551540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719807b2-c643-460c-b3e7-5758f5aa097d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:48:52.551540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719807b2-c643-460c-b3e7-5758f5aa097d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:52.552120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719807b2-c643-460c-b3e7-5758f5aa097d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:52.574924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1316/2633] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:48:52.579953 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b9bed-9de1-4571-b366-7b167fdc18d9 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:52.589782 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b9bed-9de1-4571-b366-7b167fdc18d9 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:52.594501 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2642ce-ff5a-4705-9ae8-62691096790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:52.595149 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2642ce-ff5a-4705-9ae8-62691096790f admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:52.595431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2642ce-ff5a-4705-9ae8-62691096790f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:52.595710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2642ce-ff5a-4705-9ae8-62691096790f admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:52.596400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2642ce-ff5a-4705-9ae8-62691096790f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:52.598316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2642ce-ff5a-4705-9ae8-62691096790f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:52.685884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719807b2-c643-460c-b3e7-5758f5aa097d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:52.687676 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-719807b2-c643-460c-b3e7-5758f5aa097d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:52.702044 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719807b2-c643-460c-b3e7-5758f5aa097d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:52.711321 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1318/2634] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:52 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:52.714213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2642ce-ff5a-4705-9ae8-62691096790f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:52.718877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:52.719656 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:52.719947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:52.720229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f admin admin] PATH_INFO: `/v3/projects/385adda1b8ea42dcaaad194514a80d9b` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:52.722292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f admin admin] RBAC: Authorizing `identity:delete_project(project_id=385adda1b8ea42dcaaad194514a80d9b)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:52.726117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:52.782846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2642ce-ff5a-4705-9ae8-62691096790f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:52.787647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51b24-e27b-42b8-ba6e-3388cf4e96a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:52.788318 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51b24-e27b-42b8-ba6e-3388cf4e96a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:52.788603 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51b24-e27b-42b8-ba6e-3388cf4e96a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:52.788915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51b24-e27b-42b8-ba6e-3388cf4e96a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:52.790154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51b24-e27b-42b8-ba6e-3388cf4e96a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:52.792319 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51b24-e27b-42b8-ba6e-3388cf4e96a0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:52.850430 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385adda1b8ea42dcaaad194514a80d9b', 'request_id': 'req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.890212 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1319/2635] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:52 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:52.894277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51b24-e27b-42b8-ba6e-3388cf4e96a0 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:52.904734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51b24-e27b-42b8-ba6e-3388cf4e96a0 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:52.912000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385adda1b8ea42dcaaad194514a80d9b', 'request_id': 'req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.921896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385adda1b8ea42dcaaad194514a80d9b', 'request_id': 'req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.938940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f admin admin] The token cache is being invalidate because project 385adda1b8ea42dcaaad194514a80d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:52.939241 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.940960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-897b69e6-f9c4-4b3e-a14c-ad6d4fab724f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:52.949828 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1317/2636] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:52 2022] DELETE /identity/v3/projects/385adda1b8ea42dcaaad194514a80d9b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:52.949828 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874323f-a2ff-4fdc-838d-df32e2efd59f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:52.950028 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874323f-a2ff-4fdc-838d-df32e2efd59f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:52.950324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874323f-a2ff-4fdc-838d-df32e2efd59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:52.969474 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5874323f-a2ff-4fdc-838d-df32e2efd59f None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:52.972839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e183b36-ade8-4088-903f-e34a18cc25b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:52.972986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5874323f-a2ff-4fdc-838d-df32e2efd59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:52.973111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e183b36-ade8-4088-903f-e34a18cc25b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:52.973111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e183b36-ade8-4088-903f-e34a18cc25b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:52.973111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e183b36-ade8-4088-903f-e34a18cc25b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:52.973111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e183b36-ade8-4088-903f-e34a18cc25b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:52.973375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:52.973884 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e183b36-ade8-4088-903f-e34a18cc25b8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:52.989229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1318/2637] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:52.989430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1320/2638] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:52.991264 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e183b36-ade8-4088-903f-e34a18cc25b8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:52.991524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc720c2c-9333-46d8-8da3-1ec600ec689e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:52.992130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc720c2c-9333-46d8-8da3-1ec600ec689e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:52.992399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc720c2c-9333-46d8-8da3-1ec600ec689e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.001469 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3e183b36-ade8-4088-903f-e34a18cc25b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:53.011745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-dc720c2c-9333-46d8-8da3-1ec600ec689e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:53.013085 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-dc720c2c-9333-46d8-8da3-1ec600ec689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:53.014643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e183b36-ade8-4088-903f-e34a18cc25b8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:53.019755 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a27021-6dbf-435d-93c9-7f0f8d723a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:53.020412 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a27021-6dbf-435d-93c9-7f0f8d723a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:53.021303 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a27021-6dbf-435d-93c9-7f0f8d723a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:53.025281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a27021-6dbf-435d-93c9-7f0f8d723a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.025281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:53.025483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1319/2639] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:53.025570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a27021-6dbf-435d-93c9-7f0f8d723a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:53.026068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a27021-6dbf-435d-93c9-7f0f8d723a38 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:53.027482 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc720c2c-9333-46d8-8da3-1ec600ec689e None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:53.036743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1321/2640] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:53.036907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc720c2c-9333-46d8-8da3-1ec600ec689e None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:53.041272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a27021-6dbf-435d-93c9-7f0f8d723a38 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:53.042411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458975a-9598-4f66-a2f8-a1b6994a6723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:53.043189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458975a-9598-4f66-a2f8-a1b6994a6723 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:53.043471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458975a-9598-4f66-a2f8-a1b6994a6723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:53.043805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458975a-9598-4f66-a2f8-a1b6994a6723 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.044601 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458975a-9598-4f66-a2f8-a1b6994a6723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:48:53.050779 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458975a-9598-4f66-a2f8-a1b6994a6723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:53.050779 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458975a-9598-4f66-a2f8-a1b6994a6723 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:53.051254 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a27021-6dbf-435d-93c9-7f0f8d723a38 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:53.058130 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be338cf-bff9-460b-bbad-1e08355d72d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:53.059082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be338cf-bff9-460b-bbad-1e08355d72d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:53.059619 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be338cf-bff9-460b-bbad-1e08355d72d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:53.059725 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be338cf-bff9-460b-bbad-1e08355d72d6 admin admin] PATH_INFO: `/v3/projects/4b5e0c7e37a04961a33778858838c482/users/042f8ba6e4f44479a3de613ece5bea29/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.072053 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1320/2641] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:48:53.076644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be338cf-bff9-460b-bbad-1e08355d72d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5e0c7e37a04961a33778858838c482, user_id=042f8ba6e4f44479a3de613ece5bea29, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:53.079536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be338cf-bff9-460b-bbad-1e08355d72d6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:53.080783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458975a-9598-4f66-a2f8-a1b6994a6723 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:53.091799 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458975a-9598-4f66-a2f8-a1b6994a6723 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:53.097607 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675b640-bdca-4996-9a1a-27e70ca6464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:53.098325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675b640-bdca-4996-9a1a-27e70ca6464d admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:53.098720 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675b640-bdca-4996-9a1a-27e70ca6464d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:53.098977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675b640-bdca-4996-9a1a-27e70ca6464d admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.099629 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675b640-bdca-4996-9a1a-27e70ca6464d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:53.101621 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675b640-bdca-4996-9a1a-27e70ca6464d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:53.129839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1322/2642] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:53 2022] PUT /identity/v3/projects/4b5e0c7e37a04961a33778858838c482/users/042f8ba6e4f44479a3de613ece5bea29/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:53.140148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d14e8a-76ea-42b3-8d19-6e73dbe714f0 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:53.140781 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d14e8a-76ea-42b3-8d19-6e73dbe714f0 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:53.141397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d14e8a-76ea-42b3-8d19-6e73dbe714f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.169323 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b1d14e8a-76ea-42b3-8d19-6e73dbe714f0 None None] MFA Rules not processed for user `042f8ba6e4f44479a3de613ece5bea29`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:53.170551 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b1d14e8a-76ea-42b3-8d19-6e73dbe714f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:53.177796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1321/2643] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:53 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:53.181997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675b640-bdca-4996-9a1a-27e70ca6464d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:53.248411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1323/2644] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:53.249467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:53.253374 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675b640-bdca-4996-9a1a-27e70ca6464d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:53.258734 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cd17a-5f78-4fcb-b294-58fad4d1596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:53.258959 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cd17a-5f78-4fcb-b294-58fad4d1596a admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:53.259247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cd17a-5f78-4fcb-b294-58fad4d1596a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:53.259527 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cd17a-5f78-4fcb-b294-58fad4d1596a admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.260207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cd17a-5f78-4fcb-b294-58fad4d1596a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:53.262155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d14e8a-76ea-42b3-8d19-6e73dbe714f0 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:53.262272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cd17a-5f78-4fcb-b294-58fad4d1596a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:53.263856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b1d14e8a-76ea-42b3-8d19-6e73dbe714f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:53.323652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d14e8a-76ea-42b3-8d19-6e73dbe714f0 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:53.340169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:53.344338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1322/2645] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:53 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:53.347126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cd17a-5f78-4fcb-b294-58fad4d1596a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:53.357972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cd17a-5f78-4fcb-b294-58fad4d1596a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:53.363060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311a45-11c5-4ee5-a9b6-464db96d9ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:53.363937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311a45-11c5-4ee5-a9b6-464db96d9ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:53.364488 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311a45-11c5-4ee5-a9b6-464db96d9ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:53.365120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311a45-11c5-4ee5-a9b6-464db96d9ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.366051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311a45-11c5-4ee5-a9b6-464db96d9ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:53.367888 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311a45-11c5-4ee5-a9b6-464db96d9ff5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:53.377571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e3f9-353a-491f-99fd-c560b8148496 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '711d53a7deb94849b577c08dc9165ec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:53.378232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e3f9-353a-491f-99fd-c560b8148496 service glance] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:53.378518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e3f9-353a-491f-99fd-c560b8148496 service glance] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:53.378637 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1323/2646] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:53.378837 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e3f9-353a-491f-99fd-c560b8148496 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.382459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311a45-11c5-4ee5-a9b6-464db96d9ff5 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:53.392412 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311a45-11c5-4ee5-a9b6-464db96d9ff5 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:53.397802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d5c81-f31c-46de-a84a-694ba41e328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:53.398462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d5c81-f31c-46de-a84a-694ba41e328c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:53.398747 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d5c81-f31c-46de-a84a-694ba41e328c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:53.399540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d5c81-f31c-46de-a84a-694ba41e328c admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.400598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d5c81-f31c-46de-a84a-694ba41e328c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:53.402285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d5c81-f31c-46de-a84a-694ba41e328c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:53.414675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1324/2647] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:53.419082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d5c81-f31c-46de-a84a-694ba41e328c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:53.429697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d5c81-f31c-46de-a84a-694ba41e328c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:53.434509 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65221c3-420d-437d-abc3-bf4f09727263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:53.435382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65221c3-420d-437d-abc3-bf4f09727263 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:53.435665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65221c3-420d-437d-abc3-bf4f09727263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:53.435937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65221c3-420d-437d-abc3-bf4f09727263 admin admin] PATH_INFO: `/v3/projects/633dcd178bc4492aa0e30a54f6caed76/users/61fff6322bc34e568e63bbb76387c69d/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.444751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51e3f9-353a-491f-99fd-c560b8148496 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:53.446199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51e3f9-353a-491f-99fd-c560b8148496 service glance] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:53.452159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65221c3-420d-437d-abc3-bf4f09727263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633dcd178bc4492aa0e30a54f6caed76, user_id=61fff6322bc34e568e63bbb76387c69d, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:53.454981 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65221c3-420d-437d-abc3-bf4f09727263 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:53.455935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1324/2648] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:48:53.535944 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1325/2649] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:53 2022] PUT /identity/v3/projects/633dcd178bc4492aa0e30a54f6caed76/users/61fff6322bc34e568e63bbb76387c69d/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:53.537736 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17477c32-5c84-454c-9aae-7436e2a89c46 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:53.537876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17477c32-5c84-454c-9aae-7436e2a89c46 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:53.538114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17477c32-5c84-454c-9aae-7436e2a89c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.568912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-17477c32-5c84-454c-9aae-7436e2a89c46 None None] MFA Rules not processed for user `61fff6322bc34e568e63bbb76387c69d`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:53.570217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-17477c32-5c84-454c-9aae-7436e2a89c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:53.649549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1325/2650] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:53.666586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65221c3-420d-437d-abc3-bf4f09727263 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:53.666586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c65221c3-420d-437d-abc3-bf4f09727263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:53.732692 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65221c3-420d-437d-abc3-bf4f09727263 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:53.738993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88f654-49da-448a-acec-517721cc14c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:53.739886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88f654-49da-448a-acec-517721cc14c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:53.740272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88f654-49da-448a-acec-517721cc14c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:53.740584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88f654-49da-448a-acec-517721cc14c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:53.750473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88f654-49da-448a-acec-517721cc14c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:53.751967 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88f654-49da-448a-acec-517721cc14c8 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:53.767155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1326/2651] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:58.555243 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17477c32-5c84-454c-9aae-7436e2a89c46 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:58.557100 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-17477c32-5c84-454c-9aae-7436e2a89c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:58.569237 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17477c32-5c84-454c-9aae-7436e2a89c46 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:58.573407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08b215-227f-4533-8827-1674ee2ca918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:58.574052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08b215-227f-4533-8827-1674ee2ca918 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:58.574337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08b215-227f-4533-8827-1674ee2ca918 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:58.574616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08b215-227f-4533-8827-1674ee2ca918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:58.576426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ea08b215-227f-4533-8827-1674ee2ca918 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:58.635772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08b215-227f-4533-8827-1674ee2ca918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:58.637152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08b215-227f-4533-8827-1674ee2ca918 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:58.646514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1326/2652] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:03.757988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=64,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:08.642272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:10.457541 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88f654-49da-448a-acec-517721cc14c8 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:10.458990 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-fe88f654-49da-448a-acec-517721cc14c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:10.524252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88f654-49da-448a-acec-517721cc14c8 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:10.528759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:10.529609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:10.529895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:10.530169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] PATH_INFO: `/v3/users/01665971f24d4e15b6142df27ae1bdb7` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:10.531332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01665971f24d4e15b6142df27ae1bdb7)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:10.533264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:10.754220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01665971f24d4e15b6142df27ae1bdb7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:10.754873 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01665971f24d4e15b6142df27ae1bdb7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:10.755476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01665971f24d4e15b6142df27ae1bdb7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:10.767990 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01665971f24d4e15b6142df27ae1bdb7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:10.774929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01665971f24d4e15b6142df27ae1bdb7'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:10.855018 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1327/2653] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:49:10 2022] DELETE /identity/v3/users/01665971f24d4e15b6142df27ae1bdb7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:10.859688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dde8d-5077-48e9-9864-2a9beed40387 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:10.860217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dde8d-5077-48e9-9864-2a9beed40387 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:10.860295 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dde8d-5077-48e9-9864-2a9beed40387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:10.878255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-fb6dde8d-5077-48e9-9864-2a9beed40387 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:10.879585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fb6dde8d-5077-48e9-9864-2a9beed40387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:10.937749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1327/2654] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:10.947473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:10.948953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:11.006929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee9fc4-a99f-4157-9238-dbd7d95dce58 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:11.010473 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e37ad-cb35-4c5e-aadd-da3d31c212f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:11.011120 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e37ad-cb35-4c5e-aadd-da3d31c212f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:11.011407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e37ad-cb35-4c5e-aadd-da3d31c212f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:11.011688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e37ad-cb35-4c5e-aadd-da3d31c212f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:11.020452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e37ad-cb35-4c5e-aadd-da3d31c212f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:11.022206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e37ad-cb35-4c5e-aadd-da3d31c212f2 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:11.032399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1328/2655] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:11.423474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dde8d-5077-48e9-9864-2a9beed40387 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:11.424974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-fb6dde8d-5077-48e9-9864-2a9beed40387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:11.437929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dde8d-5077-48e9-9864-2a9beed40387 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:11.442622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:11.443537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:11.444876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:11.445195 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] PATH_INFO: `/v3/projects/30711d5632bd46c183334fad996d884e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:11.446749 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] RBAC: Authorizing `identity:delete_project(project_id=30711d5632bd46c183334fad996d884e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:11.448701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:11.593496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30711d5632bd46c183334fad996d884e', 'request_id': 'req-e44f3916-e3af-4edb-9311-b4e913ee958c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:11.599508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30711d5632bd46c183334fad996d884e', 'request_id': 'req-e44f3916-e3af-4edb-9311-b4e913ee958c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:11.604906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30711d5632bd46c183334fad996d884e', 'request_id': 'req-e44f3916-e3af-4edb-9311-b4e913ee958c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:11.687770 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] The token cache is being invalidate because project 30711d5632bd46c183334fad996d884e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:49:11.688060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:11.688706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:11.690251 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1328/2656] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:49:11 2022] DELETE /identity/v3/projects/30711d5632bd46c183334fad996d884e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:11.694272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e37ad-cb35-4c5e-aadd-da3d31c212f2 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:11.704360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e37ad-cb35-4c5e-aadd-da3d31c212f2 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:11.722789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:11.759536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:11.760425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:11.760746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:11.761024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] PATH_INFO: `/v3/users/3b212bfff94d4492992142378643957c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:11.762440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b212bfff94d4492992142378643957c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:11.765021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:11.947478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b212bfff94d4492992142378643957c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:11.948153 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b212bfff94d4492992142378643957c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:11.948776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b212bfff94d4492992142378643957c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:11.960355 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b212bfff94d4492992142378643957c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:11.967415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b212bfff94d4492992142378643957c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:12.047984 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1329/2657] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:49:11 2022] DELETE /identity/v3/users/3b212bfff94d4492992142378643957c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:12.450075 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:12.451531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:12.467434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f3916-e3af-4edb-9311-b4e913ee958c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:12.525907 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:12.526773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:12.527058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:12.527342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] PATH_INFO: `/v3/projects/a994783dfb7943a797c8dde6c83b260e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:12.528518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a994783dfb7943a797c8dde6c83b260e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:12.530493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:12.644452 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:12.660876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a994783dfb7943a797c8dde6c83b260e', 'request_id': 'req-ada76a6b-7c0c-4335-9574-57a8250d402b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:12.667461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a994783dfb7943a797c8dde6c83b260e', 'request_id': 'req-ada76a6b-7c0c-4335-9574-57a8250d402b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:12.672841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a994783dfb7943a797c8dde6c83b260e', 'request_id': 'req-ada76a6b-7c0c-4335-9574-57a8250d402b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:12.773663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] The token cache is being invalidate because project a994783dfb7943a797c8dde6c83b260e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:49:12.773949 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:12.775060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:12.776631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1329/2658] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:49:12 2022] DELETE /identity/v3/projects/a994783dfb7943a797c8dde6c83b260e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:12.780710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:12.782121 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:12.795399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f11bbf-e0d7-474f-8650-7375c71cc2b8 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:12.850107 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba11b9-bdee-41a6-8e32-7df2faed9368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:12.850976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba11b9-bdee-41a6-8e32-7df2faed9368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:12.851263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba11b9-bdee-41a6-8e32-7df2faed9368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:12.851543 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba11b9-bdee-41a6-8e32-7df2faed9368 admin admin] PATH_INFO: `/v3/users/e5afbeaf61e447e0908a581824c7c3f1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:12.853352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba11b9-bdee-41a6-8e32-7df2faed9368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5afbeaf61e447e0908a581824c7c3f1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:12.855269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba11b9-bdee-41a6-8e32-7df2faed9368 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:13.036218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:13.038598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d1ba11b9-bdee-41a6-8e32-7df2faed9368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5afbeaf61e447e0908a581824c7c3f1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:13.039243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d1ba11b9-bdee-41a6-8e32-7df2faed9368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5afbeaf61e447e0908a581824c7c3f1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:13.039847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d1ba11b9-bdee-41a6-8e32-7df2faed9368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5afbeaf61e447e0908a581824c7c3f1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:13.051312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d1ba11b9-bdee-41a6-8e32-7df2faed9368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5afbeaf61e447e0908a581824c7c3f1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:13.058032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d1ba11b9-bdee-41a6-8e32-7df2faed9368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5afbeaf61e447e0908a581824c7c3f1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:13.127866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1330/2659] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:49:12 2022] DELETE /identity/v3/users/e5afbeaf61e447e0908a581824c7c3f1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:13.541350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:13.542776 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:13.556082 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada76a6b-7c0c-4335-9574-57a8250d402b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:13.614449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324975a9-3983-49e8-9398-22f35f657a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:13.615339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324975a9-3983-49e8-9398-22f35f657a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:13.615623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324975a9-3983-49e8-9398-22f35f657a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:13.615895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324975a9-3983-49e8-9398-22f35f657a86 admin admin] PATH_INFO: `/v3/projects/0d2ebd3387234a50ad88f74744e391a7` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:13.617153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324975a9-3983-49e8-9398-22f35f657a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2ebd3387234a50ad88f74744e391a7)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:13.619686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324975a9-3983-49e8-9398-22f35f657a86 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:13.745379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-324975a9-3983-49e8-9398-22f35f657a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2ebd3387234a50ad88f74744e391a7', 'request_id': 'req-324975a9-3983-49e8-9398-22f35f657a86'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:13.751470 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-324975a9-3983-49e8-9398-22f35f657a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2ebd3387234a50ad88f74744e391a7', 'request_id': 'req-324975a9-3983-49e8-9398-22f35f657a86'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:13.756881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-324975a9-3983-49e8-9398-22f35f657a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2ebd3387234a50ad88f74744e391a7', 'request_id': 'req-324975a9-3983-49e8-9398-22f35f657a86'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:13.888177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-324975a9-3983-49e8-9398-22f35f657a86 admin admin] The token cache is being invalidate because project 0d2ebd3387234a50ad88f74744e391a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:49:13.888394 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-324975a9-3983-49e8-9398-22f35f657a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:13.889033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-324975a9-3983-49e8-9398-22f35f657a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:13.890581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1330/2660] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:49:13 2022] DELETE /identity/v3/projects/0d2ebd3387234a50ad88f74744e391a7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:13.896770 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db55518-11ec-46c0-a7f8-2aa103e16aa1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:13.897228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db55518-11ec-46c0-a7f8-2aa103e16aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:13.897340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db55518-11ec-46c0-a7f8-2aa103e16aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:13.915784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9db55518-11ec-46c0-a7f8-2aa103e16aa1 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:13.917034 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9db55518-11ec-46c0-a7f8-2aa103e16aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:13.974033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1331/2661] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:13.982861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbba5a-fc47-40bf-9049-b98e9ec3cac8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:13.983136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbba5a-fc47-40bf-9049-b98e9ec3cac8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:13.983411 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbba5a-fc47-40bf-9049-b98e9ec3cac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:14.001931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0cbbba5a-fc47-40bf-9049-b98e9ec3cac8 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:14.003129 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0cbbba5a-fc47-40bf-9049-b98e9ec3cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:14.011161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1331/2662] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:14.015192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db55518-11ec-46c0-a7f8-2aa103e16aa1 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:14.025091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db55518-11ec-46c0-a7f8-2aa103e16aa1 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:14.029581 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918d67d-7472-407d-b1af-a772a9483667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:14.030252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918d67d-7472-407d-b1af-a772a9483667 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:14.030535 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918d67d-7472-407d-b1af-a772a9483667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:14.030813 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918d67d-7472-407d-b1af-a772a9483667 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:14.031557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918d67d-7472-407d-b1af-a772a9483667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:49:14.031866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918d67d-7472-407d-b1af-a772a9483667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:14.033520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918d67d-7472-407d-b1af-a772a9483667 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:14.045187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1332/2663] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:49:14.049219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbba5a-fc47-40bf-9049-b98e9ec3cac8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:14.058958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbba5a-fc47-40bf-9049-b98e9ec3cac8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:14.063487 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af222591-1976-4e59-8523-a505210a29a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:14.064127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af222591-1976-4e59-8523-a505210a29a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:14.064403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af222591-1976-4e59-8523-a505210a29a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:14.064703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af222591-1976-4e59-8523-a505210a29a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:14.065398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af222591-1976-4e59-8523-a505210a29a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:14.067262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af222591-1976-4e59-8523-a505210a29a0 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:14.158678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1332/2664] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:49:14 2022] POST /identity/v3/projects => generated 407 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:49:14.162719 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918d67d-7472-407d-b1af-a772a9483667 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:14.173354 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918d67d-7472-407d-b1af-a772a9483667 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:14.228765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8abd4-8b90-4ed6-a6fb-58c7c2722988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:14.229954 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8abd4-8b90-4ed6-a6fb-58c7c2722988 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:14.230234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8abd4-8b90-4ed6-a6fb-58c7c2722988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:14.230515 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8abd4-8b90-4ed6-a6fb-58c7c2722988 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:14.231192 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8abd4-8b90-4ed6-a6fb-58c7c2722988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:14.233128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8abd4-8b90-4ed6-a6fb-58c7c2722988 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:14.345778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1333/2665] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:49:14 2022] POST /identity/v3/users => generated 304 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:14.349796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af222591-1976-4e59-8523-a505210a29a0 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:14.360713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af222591-1976-4e59-8523-a505210a29a0 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:14.365245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e88f07-58bf-40d2-8570-780bf874ead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:14.365901 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e88f07-58bf-40d2-8570-780bf874ead4 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:14.366186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e88f07-58bf-40d2-8570-780bf874ead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:14.366530 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e88f07-58bf-40d2-8570-780bf874ead4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:14.367176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e88f07-58bf-40d2-8570-780bf874ead4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:14.368788 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e88f07-58bf-40d2-8570-780bf874ead4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:14.379302 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1333/2666] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:49:14.382810 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8abd4-8b90-4ed6-a6fb-58c7c2722988 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:14.392792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8abd4-8b90-4ed6-a6fb-58c7c2722988 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:14.397782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1aa05-0547-48ee-9bf2-09b82f1ebff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:14.398432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1aa05-0547-48ee-9bf2-09b82f1ebff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:14.398721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1aa05-0547-48ee-9bf2-09b82f1ebff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:14.399004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1aa05-0547-48ee-9bf2-09b82f1ebff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:14.399741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1aa05-0547-48ee-9bf2-09b82f1ebff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:14.401914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1aa05-0547-48ee-9bf2-09b82f1ebff9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:14.411696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1334/2667] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:49:14.415326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e88f07-58bf-40d2-8570-780bf874ead4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:14.422278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:14.426134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e88f07-58bf-40d2-8570-780bf874ead4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:14.430757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1979f3-c6b7-429c-8db8-c94b8469e25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:14.439258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1979f3-c6b7-429c-8db8-c94b8469e25a admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:14.439258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1979f3-c6b7-429c-8db8-c94b8469e25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:14.439258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1979f3-c6b7-429c-8db8-c94b8469e25a admin admin] PATH_INFO: `/v3/projects/d988b9eb5cc34de5ba622a2b996a2be8/users/6449604f04134fd3bdf635b3049c515c/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:14.446235 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1979f3-c6b7-429c-8db8-c94b8469e25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d988b9eb5cc34de5ba622a2b996a2be8, user_id=6449604f04134fd3bdf635b3049c515c, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:14.448940 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1979f3-c6b7-429c-8db8-c94b8469e25a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:14.522629 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1334/2668] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:14 2022] PUT /identity/v3/projects/d988b9eb5cc34de5ba622a2b996a2be8/users/6449604f04134fd3bdf635b3049c515c/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:14.535265 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75437ec-d5c6-4af1-bde7-7c39b8c0f273 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:14.535554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75437ec-d5c6-4af1-bde7-7c39b8c0f273 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:14.535833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75437ec-d5c6-4af1-bde7-7c39b8c0f273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:14.561943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b75437ec-d5c6-4af1-bde7-7c39b8c0f273 None None] MFA Rules not processed for user `6449604f04134fd3bdf635b3049c515c`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:14.563139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b75437ec-d5c6-4af1-bde7-7c39b8c0f273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:14.575972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:14.626365 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1335/2669] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:14.630868 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1979f3-c6b7-429c-8db8-c94b8469e25a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:14.692111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1979f3-c6b7-429c-8db8-c94b8469e25a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:14.696763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f3c8d-147c-4b04-8489-6198a4140aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:14.697955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f3c8d-147c-4b04-8489-6198a4140aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:14.698240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f3c8d-147c-4b04-8489-6198a4140aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:14.698519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f3c8d-147c-4b04-8489-6198a4140aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:14.699207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f3c8d-147c-4b04-8489-6198a4140aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:14.701170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f3c8d-147c-4b04-8489-6198a4140aa8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:14.839636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1335/2670] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:49:14 2022] POST /identity/v3/projects => generated 407 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:14.843466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75437ec-d5c6-4af1-bde7-7c39b8c0f273 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:14.854461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75437ec-d5c6-4af1-bde7-7c39b8c0f273 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:14.910407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f01c80-39f4-4e75-ace7-dca70f7523b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:14.911063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f01c80-39f4-4e75-ace7-dca70f7523b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:14.911339 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f01c80-39f4-4e75-ace7-dca70f7523b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:14.911617 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f01c80-39f4-4e75-ace7-dca70f7523b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:14.912305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f01c80-39f4-4e75-ace7-dca70f7523b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:14.914263 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f01c80-39f4-4e75-ace7-dca70f7523b1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:15.048949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1336/2671] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:49:14 2022] POST /identity/v3/users => generated 310 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:15.052891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f3c8d-147c-4b04-8489-6198a4140aa8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:15.063774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f3c8d-147c-4b04-8489-6198a4140aa8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:15.068319 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab37b6c-5212-4a49-ae36-2c16babf1c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:15.069143 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab37b6c-5212-4a49-ae36-2c16babf1c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:15.069429 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab37b6c-5212-4a49-ae36-2c16babf1c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:15.069706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab37b6c-5212-4a49-ae36-2c16babf1c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:15.070428 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab37b6c-5212-4a49-ae36-2c16babf1c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:15.072009 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab37b6c-5212-4a49-ae36-2c16babf1c70 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:15.083358 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1336/2672] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:49:15.087565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f01c80-39f4-4e75-ace7-dca70f7523b1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:15.097602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f01c80-39f4-4e75-ace7-dca70f7523b1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:15.102250 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03213d2-db70-44e5-b158-7b97bd7557c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:15.103138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03213d2-db70-44e5-b158-7b97bd7557c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:15.103425 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03213d2-db70-44e5-b158-7b97bd7557c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:15.103706 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03213d2-db70-44e5-b158-7b97bd7557c2 admin admin] PATH_INFO: `/v3/projects/94bcea2eb4814091ae26fb2eee715d22/users/da73ee556c7e4739961df6010099408e/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:15.118420 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03213d2-db70-44e5-b158-7b97bd7557c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bcea2eb4814091ae26fb2eee715d22, user_id=da73ee556c7e4739961df6010099408e, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:15.121633 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03213d2-db70-44e5-b158-7b97bd7557c2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:15.236836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1337/2673] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:15 2022] PUT /identity/v3/projects/94bcea2eb4814091ae26fb2eee715d22/users/da73ee556c7e4739961df6010099408e/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:15.240888 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab37b6c-5212-4a49-ae36-2c16babf1c70 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:15.251205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab37b6c-5212-4a49-ae36-2c16babf1c70 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:15.308352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243019f4-eece-4ea9-b319-64de33a6d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:15.309064 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243019f4-eece-4ea9-b319-64de33a6d877 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:15.309349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243019f4-eece-4ea9-b319-64de33a6d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:15.309625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243019f4-eece-4ea9-b319-64de33a6d877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:15.310407 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243019f4-eece-4ea9-b319-64de33a6d877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:15.311972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243019f4-eece-4ea9-b319-64de33a6d877 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:15.321915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1337/2674] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:49:15.325935 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03213d2-db70-44e5-b158-7b97bd7557c2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:15.336169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03213d2-db70-44e5-b158-7b97bd7557c2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:15.340872 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85622a3-ae32-4bfa-81c9-e7f6f2b49b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:15.341758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85622a3-ae32-4bfa-81c9-e7f6f2b49b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:15.342041 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85622a3-ae32-4bfa-81c9-e7f6f2b49b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:15.342317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85622a3-ae32-4bfa-81c9-e7f6f2b49b9b admin admin] PATH_INFO: `/v3/projects/94bcea2eb4814091ae26fb2eee715d22/users/da73ee556c7e4739961df6010099408e/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:15.344264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85622a3-ae32-4bfa-81c9-e7f6f2b49b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bcea2eb4814091ae26fb2eee715d22, user_id=da73ee556c7e4739961df6010099408e, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:15.346959 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85622a3-ae32-4bfa-81c9-e7f6f2b49b9b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:15.357823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1338/2675] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:15 2022] PUT /identity/v3/projects/94bcea2eb4814091ae26fb2eee715d22/users/da73ee556c7e4739961df6010099408e/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:15.367598 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d8699-fb78-46d0-b78c-01997e88211f None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:15.367890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d8699-fb78-46d0-b78c-01997e88211f None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:15.368172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d8699-fb78-46d0-b78c-01997e88211f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:15.393797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-be8d8699-fb78-46d0-b78c-01997e88211f None None] MFA Rules not processed for user `da73ee556c7e4739961df6010099408e`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:15.395018 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-be8d8699-fb78-46d0-b78c-01997e88211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:15.433931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:15.461117 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1338/2676] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:15 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:49:15.472837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85622a3-ae32-4bfa-81c9-e7f6f2b49b9b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:15.475230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b85622a3-ae32-4bfa-81c9-e7f6f2b49b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:15.530299 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85622a3-ae32-4bfa-81c9-e7f6f2b49b9b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:15.533945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e484e8-ff3b-4065-8480-268b48dfca9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:15.534575 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e484e8-ff3b-4065-8480-268b48dfca9a service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:15.534861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e484e8-ff3b-4065-8480-268b48dfca9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:15.535134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e484e8-ff3b-4065-8480-268b48dfca9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:15.543956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e484e8-ff3b-4065-8480-268b48dfca9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:15.545411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e484e8-ff3b-4065-8480-268b48dfca9a service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:15.554685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1339/2677] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:15 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:16.022036 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d8699-fb78-46d0-b78c-01997e88211f None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:16.031854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d8699-fb78-46d0-b78c-01997e88211f None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:16.035833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee4fc0-c43d-47a1-a9e5-b451a6901f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:16.036467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee4fc0-c43d-47a1-a9e5-b451a6901f6c service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:16.040887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee4fc0-c43d-47a1-a9e5-b451a6901f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:16.040887 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee4fc0-c43d-47a1-a9e5-b451a6901f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:16.093509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee4fc0-c43d-47a1-a9e5-b451a6901f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:16.094951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee4fc0-c43d-47a1-a9e5-b451a6901f6c service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:16.104425 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1339/2678] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:25.550504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=90,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:26.099693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=39 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:34.091868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e484e8-ff3b-4065-8480-268b48dfca9a service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:34.150819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e484e8-ff3b-4065-8480-268b48dfca9a service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:34.156142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:34.157051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:34.157334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:34.157610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] PATH_INFO: `/v3/users/6449604f04134fd3bdf635b3049c515c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:34.158790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6449604f04134fd3bdf635b3049c515c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:34.160772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:34.325269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6449604f04134fd3bdf635b3049c515c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:34.325924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6449604f04134fd3bdf635b3049c515c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:34.326529 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6449604f04134fd3bdf635b3049c515c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:34.338460 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6449604f04134fd3bdf635b3049c515c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:34.345347 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6449604f04134fd3bdf635b3049c515c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:34.430480 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1340/2679] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:49:34 2022] DELETE /identity/v3/users/6449604f04134fd3bdf635b3049c515c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:34.435453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdae1e1-7057-4011-aad5-711187fe7c6e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:34.435911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdae1e1-7057-4011-aad5-711187fe7c6e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:34.436099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdae1e1-7057-4011-aad5-711187fe7c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:34.454334 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0fdae1e1-7057-4011-aad5-711187fe7c6e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:34.455533 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0fdae1e1-7057-4011-aad5-711187fe7c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:34.514622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1340/2680] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:34.524506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:34.525928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:34.583075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d2853-1ebf-4000-bdfd-fa0aba567642 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:34.586693 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fa49b-d52a-40df-bb01-db9a19b00162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:34.587335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fa49b-d52a-40df-bb01-db9a19b00162 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:34.587621 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fa49b-d52a-40df-bb01-db9a19b00162 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:34.587901 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fa49b-d52a-40df-bb01-db9a19b00162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:34.597000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fa49b-d52a-40df-bb01-db9a19b00162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:34.598429 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fa49b-d52a-40df-bb01-db9a19b00162 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:34.608178 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1341/2681] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:35.067448 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdae1e1-7057-4011-aad5-711187fe7c6e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:35.069044 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0fdae1e1-7057-4011-aad5-711187fe7c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:35.082208 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdae1e1-7057-4011-aad5-711187fe7c6e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:35.087707 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:35.088581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:35.088918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:35.089718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] PATH_INFO: `/v3/projects/d988b9eb5cc34de5ba622a2b996a2be8` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:35.090885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d988b9eb5cc34de5ba622a2b996a2be8)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:35.092846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:35.128343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fa49b-d52a-40df-bb01-db9a19b00162 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:35.129937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9a3fa49b-d52a-40df-bb01-db9a19b00162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:35.142630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fa49b-d52a-40df-bb01-db9a19b00162 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:35.147514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da0799-4133-4576-b32b-683ee6cf6644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:35.148498 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0799-4133-4576-b32b-683ee6cf6644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:35.148822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0799-4133-4576-b32b-683ee6cf6644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:35.149100 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0799-4133-4576-b32b-683ee6cf6644 admin admin] PATH_INFO: `/v3/users/61fff6322bc34e568e63bbb76387c69d` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:35.150343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da0799-4133-4576-b32b-683ee6cf6644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61fff6322bc34e568e63bbb76387c69d)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:35.152818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da0799-4133-4576-b32b-683ee6cf6644 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:35.168937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:35.233534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd988b9eb5cc34de5ba622a2b996a2be8', 'request_id': 'req-ec3ed217-039b-43cc-a956-7ede51228a4e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.239805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd988b9eb5cc34de5ba622a2b996a2be8', 'request_id': 'req-ec3ed217-039b-43cc-a956-7ede51228a4e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.245260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd988b9eb5cc34de5ba622a2b996a2be8', 'request_id': 'req-ec3ed217-039b-43cc-a956-7ede51228a4e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.322576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] The token cache is being invalidate because project d988b9eb5cc34de5ba622a2b996a2be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:49:35.322877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.323499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.325067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1341/2682] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:49:35 2022] DELETE /identity/v3/projects/d988b9eb5cc34de5ba622a2b996a2be8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:35.328823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:35.330099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:35.331151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e1da0799-4133-4576-b32b-683ee6cf6644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61fff6322bc34e568e63bbb76387c69d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.331793 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e1da0799-4133-4576-b32b-683ee6cf6644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61fff6322bc34e568e63bbb76387c69d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.332410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e1da0799-4133-4576-b32b-683ee6cf6644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61fff6322bc34e568e63bbb76387c69d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.345082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e1da0799-4133-4576-b32b-683ee6cf6644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61fff6322bc34e568e63bbb76387c69d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.352170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e1da0799-4133-4576-b32b-683ee6cf6644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61fff6322bc34e568e63bbb76387c69d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.393182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ed217-039b-43cc-a956-7ede51228a4e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:35.398079 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:35.398960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:35.399244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:35.399521 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] PATH_INFO: `/v3/users/da73ee556c7e4739961df6010099408e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:35.400752 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=da73ee556c7e4739961df6010099408e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:35.403150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:35.420416 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1342/2683] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:49:35 2022] DELETE /identity/v3/users/61fff6322bc34e568e63bbb76387c69d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:49:35.424964 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f32c7-19f8-4d75-ba0e-bf4418f04af4 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:35.425260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f32c7-19f8-4d75-ba0e-bf4418f04af4 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:35.425542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f32c7-19f8-4d75-ba0e-bf4418f04af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:35.441889 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-b48f32c7-19f8-4d75-ba0e-bf4418f04af4 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:35.451647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b48f32c7-19f8-4d75-ba0e-bf4418f04af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:35.501566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1343/2684] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:35.511536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f32c7-19f8-4d75-ba0e-bf4418f04af4 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:35.512431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:35.513137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-b48f32c7-19f8-4d75-ba0e-bf4418f04af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:35.569054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f32c7-19f8-4d75-ba0e-bf4418f04af4 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:35.574138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e169b-9e35-4836-ae24-606ea9f72d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:35.574138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e169b-9e35-4836-ae24-606ea9f72d27 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:35.574367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e169b-9e35-4836-ae24-606ea9f72d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:35.574454 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e169b-9e35-4836-ae24-606ea9f72d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:35.583395 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e169b-9e35-4836-ae24-606ea9f72d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:35.584857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e169b-9e35-4836-ae24-606ea9f72d27 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:35.595055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1344/2685] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:35.639944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da73ee556c7e4739961df6010099408e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.640607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da73ee556c7e4739961df6010099408e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.706177 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da73ee556c7e4739961df6010099408e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.719203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da73ee556c7e4739961df6010099408e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.725919 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da73ee556c7e4739961df6010099408e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:35.731956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1342/2686] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:49:35 2022] DELETE /identity/v3/users/da73ee556c7e4739961df6010099408e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:49:36.008688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e169b-9e35-4836-ae24-606ea9f72d27 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:36.010208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2d0e169b-9e35-4836-ae24-606ea9f72d27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:36.024767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e169b-9e35-4836-ae24-606ea9f72d27 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:36.061924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:36.085503 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde186f-df13-4899-be54-f5a74f00ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:36.086379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde186f-df13-4899-be54-f5a74f00ce2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.086669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde186f-df13-4899-be54-f5a74f00ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.086951 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde186f-df13-4899-be54-f5a74f00ce2f admin admin] PATH_INFO: `/v3/projects/633dcd178bc4492aa0e30a54f6caed76` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.088317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde186f-df13-4899-be54-f5a74f00ce2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=633dcd178bc4492aa0e30a54f6caed76)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:36.090366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde186f-df13-4899-be54-f5a74f00ce2f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:36.246450 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:36.246773 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:36.261147 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7cde186f-df13-4899-be54-f5a74f00ce2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633dcd178bc4492aa0e30a54f6caed76', 'request_id': 'req-7cde186f-df13-4899-be54-f5a74f00ce2f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:36.280409 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2171510-3019-4e40-a066-0a8e05abcb5b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:36.351787 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153374-da39-4494-b437-f8cfe7648e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:36.352572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153374-da39-4494-b437-f8cfe7648e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.352893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153374-da39-4494-b437-f8cfe7648e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.353175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153374-da39-4494-b437-f8cfe7648e55 admin admin] PATH_INFO: `/v3/projects/94bcea2eb4814091ae26fb2eee715d22` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.354379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153374-da39-4494-b437-f8cfe7648e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94bcea2eb4814091ae26fb2eee715d22)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:36.356921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153374-da39-4494-b437-f8cfe7648e55 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:36.357589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7cde186f-df13-4899-be54-f5a74f00ce2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633dcd178bc4492aa0e30a54f6caed76', 'request_id': 'req-7cde186f-df13-4899-be54-f5a74f00ce2f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:36.365429 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7cde186f-df13-4899-be54-f5a74f00ce2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633dcd178bc4492aa0e30a54f6caed76', 'request_id': 'req-7cde186f-df13-4899-be54-f5a74f00ce2f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:36.379244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7cde186f-df13-4899-be54-f5a74f00ce2f admin admin] The token cache is being invalidate because project 633dcd178bc4492aa0e30a54f6caed76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:49:36.379534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7cde186f-df13-4899-be54-f5a74f00ce2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:36.380212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7cde186f-df13-4899-be54-f5a74f00ce2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:36.382197 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1345/2687] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:49:36 2022] DELETE /identity/v3/projects/633dcd178bc4492aa0e30a54f6caed76 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:36.386699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dbe19-f653-4630-b80a-fdd92f5e970e None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.386993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dbe19-f653-4630-b80a-fdd92f5e970e None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.387281 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dbe19-f653-4630-b80a-fdd92f5e970e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.405721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-ee2dbe19-f653-4630-b80a-fdd92f5e970e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:36.406995 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ee2dbe19-f653-4630-b80a-fdd92f5e970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:36.415150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1346/2688] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:49:36.423049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884dcad-300a-43c5-a2a2-e72fe3347d56 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.423385 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884dcad-300a-43c5-a2a2-e72fe3347d56 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.423692 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884dcad-300a-43c5-a2a2-e72fe3347d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.441971 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-4884dcad-300a-43c5-a2a2-e72fe3347d56 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:36.451083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-4884dcad-300a-43c5-a2a2-e72fe3347d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:36.451468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1347/2689] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:49:36.455466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884dcad-300a-43c5-a2a2-e72fe3347d56 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:36.464595 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884dcad-300a-43c5-a2a2-e72fe3347d56 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:36.469229 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e234cd4-ce96-47ea-bb84-8ba146579c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:36.469884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e234cd4-ce96-47ea-bb84-8ba146579c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.470173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e234cd4-ce96-47ea-bb84-8ba146579c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.470455 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e234cd4-ce96-47ea-bb84-8ba146579c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.471200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e234cd4-ce96-47ea-bb84-8ba146579c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:49:36.471517 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e234cd4-ce96-47ea-bb84-8ba146579c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:36.473182 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e234cd4-ce96-47ea-bb84-8ba146579c1d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:36.486436 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1348/2690] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:49:36.490699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e234cd4-ce96-47ea-bb84-8ba146579c1d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:36.499962 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-79153374-da39-4494-b437-f8cfe7648e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94bcea2eb4814091ae26fb2eee715d22', 'request_id': 'req-79153374-da39-4494-b437-f8cfe7648e55'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:36.502709 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e234cd4-ce96-47ea-bb84-8ba146579c1d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:36.507103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-79153374-da39-4494-b437-f8cfe7648e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94bcea2eb4814091ae26fb2eee715d22', 'request_id': 'req-79153374-da39-4494-b437-f8cfe7648e55'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:36.513705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-79153374-da39-4494-b437-f8cfe7648e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94bcea2eb4814091ae26fb2eee715d22', 'request_id': 'req-79153374-da39-4494-b437-f8cfe7648e55'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:36.566377 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad5b13-3ea7-40c4-8204-d87dad64f4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:36.567054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad5b13-3ea7-40c4-8204-d87dad64f4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.567340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad5b13-3ea7-40c4-8204-d87dad64f4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.567623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad5b13-3ea7-40c4-8204-d87dad64f4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.568317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad5b13-3ea7-40c4-8204-d87dad64f4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:36.570315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad5b13-3ea7-40c4-8204-d87dad64f4f4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:36.586041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-79153374-da39-4494-b437-f8cfe7648e55 admin admin] The token cache is being invalidate because project 94bcea2eb4814091ae26fb2eee715d22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:49:36.586386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-79153374-da39-4494-b437-f8cfe7648e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:36.587016 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-79153374-da39-4494-b437-f8cfe7648e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:36.588549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1343/2691] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:49:36 2022] DELETE /identity/v3/projects/94bcea2eb4814091ae26fb2eee715d22 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:36.593744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fcce4-d518-4321-814c-41f108d9cc2d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.594078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fcce4-d518-4321-814c-41f108d9cc2d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.594393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fcce4-d518-4321-814c-41f108d9cc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.613677 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-dc1fcce4-d518-4321-814c-41f108d9cc2d None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:36.614806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dc1fcce4-d518-4321-814c-41f108d9cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:36.622865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1344/2692] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:36.630759 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005799-b19a-4869-b35c-b0ca0cae3c2e None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.631046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005799-b19a-4869-b35c-b0ca0cae3c2e None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.631328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005799-b19a-4869-b35c-b0ca0cae3c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.649744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-79005799-b19a-4869-b35c-b0ca0cae3c2e None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:36.665154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-79005799-b19a-4869-b35c-b0ca0cae3c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:36.665368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1349/2693] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:49:36 2022] POST /identity/v3/projects => generated 399 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:36.666384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad5b13-3ea7-40c4-8204-d87dad64f4f4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:36.668838 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-95ad5b13-3ea7-40c4-8204-d87dad64f4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:36.672602 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:36.701297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:36.716930 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1345/2694] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:49:36.722312 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79005799-b19a-4869-b35c-b0ca0cae3c2e None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:36.734172 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79005799-b19a-4869-b35c-b0ca0cae3c2e None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:36.739526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936dd77-d212-471b-8eab-9cb036cf265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:36.740192 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936dd77-d212-471b-8eab-9cb036cf265a admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.740527 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936dd77-d212-471b-8eab-9cb036cf265a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.740820 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936dd77-d212-471b-8eab-9cb036cf265a admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.741558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936dd77-d212-471b-8eab-9cb036cf265a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:49:36.741871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936dd77-d212-471b-8eab-9cb036cf265a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:36.742486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad5b13-3ea7-40c4-8204-d87dad64f4f4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:36.743478 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936dd77-d212-471b-8eab-9cb036cf265a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:36.749713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b62e0-99f2-45e3-8584-3cd289c0edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:36.750432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b62e0-99f2-45e3-8584-3cd289c0edc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.751989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b62e0-99f2-45e3-8584-3cd289c0edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.751989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b62e0-99f2-45e3-8584-3cd289c0edc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.751989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b62e0-99f2-45e3-8584-3cd289c0edc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:36.754836 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b62e0-99f2-45e3-8584-3cd289c0edc9 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:36.757404 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1346/2695] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:49:36.762282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936dd77-d212-471b-8eab-9cb036cf265a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:36.773462 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936dd77-d212-471b-8eab-9cb036cf265a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:36.779495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853aa5b-8166-4ee0-9ea0-5d3ed93a1af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:36.780147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853aa5b-8166-4ee0-9ea0-5d3ed93a1af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.780433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853aa5b-8166-4ee0-9ea0-5d3ed93a1af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.780779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853aa5b-8166-4ee0-9ea0-5d3ed93a1af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.781464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853aa5b-8166-4ee0-9ea0-5d3ed93a1af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:36.783371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853aa5b-8166-4ee0-9ea0-5d3ed93a1af3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:36.849227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1350/2696] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:49:36 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:49:36.853213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b62e0-99f2-45e3-8584-3cd289c0edc9 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:36.863237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b62e0-99f2-45e3-8584-3cd289c0edc9 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:36.868138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9007d52-6017-4942-9d4e-eb383cf2909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:36.868817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9007d52-6017-4942-9d4e-eb383cf2909d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.869109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9007d52-6017-4942-9d4e-eb383cf2909d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.869392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9007d52-6017-4942-9d4e-eb383cf2909d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.870188 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9007d52-6017-4942-9d4e-eb383cf2909d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:36.871800 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9007d52-6017-4942-9d4e-eb383cf2909d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:36.879552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1347/2697] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:49:36 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:36.881890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1351/2698] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:49:36.883495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853aa5b-8166-4ee0-9ea0-5d3ed93a1af3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:36.886096 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9007d52-6017-4942-9d4e-eb383cf2909d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:36.895562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9007d52-6017-4942-9d4e-eb383cf2909d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:36.945744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853aa5b-8166-4ee0-9ea0-5d3ed93a1af3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:36.950966 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df087a9a-471e-4857-bf46-5c2f79540eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:36.951779 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df087a9a-471e-4857-bf46-5c2f79540eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.952063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df087a9a-471e-4857-bf46-5c2f79540eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.952343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df087a9a-471e-4857-bf46-5c2f79540eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.953063 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df087a9a-471e-4857-bf46-5c2f79540eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:36.954278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bb195-32fa-451e-b4ff-b43b04459e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:36.954940 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bb195-32fa-451e-b4ff-b43b04459e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.955052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df087a9a-471e-4857-bf46-5c2f79540eb5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:36.955224 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bb195-32fa-451e-b4ff-b43b04459e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.955499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bb195-32fa-451e-b4ff-b43b04459e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:36.956207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bb195-32fa-451e-b4ff-b43b04459e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:36.957812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bb195-32fa-451e-b4ff-b43b04459e78 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:36.971292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1352/2699] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:49:36.976630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bb195-32fa-451e-b4ff-b43b04459e78 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:36.986150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bb195-32fa-451e-b4ff-b43b04459e78 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:36.990724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348574e-2629-4615-89f2-2d305f01212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:36.991567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348574e-2629-4615-89f2-2d305f01212c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:36.991861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348574e-2629-4615-89f2-2d305f01212c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:36.992183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348574e-2629-4615-89f2-2d305f01212c admin admin] PATH_INFO: `/v3/projects/873731ad45bf42efb9d2ce43c6ad7fd5/users/10a01e15a0a24c6eb417d997bc0e8838/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:37.006483 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348574e-2629-4615-89f2-2d305f01212c admin admin] RBAC: Authorizing `identity:create_grant(project_id=873731ad45bf42efb9d2ce43c6ad7fd5, user_id=10a01e15a0a24c6eb417d997bc0e8838, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:37.009209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348574e-2629-4615-89f2-2d305f01212c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:37.049568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1348/2700] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:49:36 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:49:37.053489 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df087a9a-471e-4857-bf46-5c2f79540eb5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:37.063197 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df087a9a-471e-4857-bf46-5c2f79540eb5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:37.067866 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554703b-ad10-42a2-a9e2-18ffa48eb200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:37.068509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554703b-ad10-42a2-a9e2-18ffa48eb200 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:37.068832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554703b-ad10-42a2-a9e2-18ffa48eb200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:37.069109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554703b-ad10-42a2-a9e2-18ffa48eb200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:37.069818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554703b-ad10-42a2-a9e2-18ffa48eb200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:37.071429 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554703b-ad10-42a2-a9e2-18ffa48eb200 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:37.078580 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1353/2701] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:36 2022] PUT /identity/v3/projects/873731ad45bf42efb9d2ce43c6ad7fd5/users/10a01e15a0a24c6eb417d997bc0e8838/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:49:37.085152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1349/2702] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:49:37.103996 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348574e-2629-4615-89f2-2d305f01212c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:37.111403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a1f15-8e48-489e-ab6e-d5e4967798ed None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:37.111688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a1f15-8e48-489e-ab6e-d5e4967798ed None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:37.111968 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a1f15-8e48-489e-ab6e-d5e4967798ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:37.139046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d04a1f15-8e48-489e-ab6e-d5e4967798ed None None] MFA Rules not processed for user `10a01e15a0a24c6eb417d997bc0e8838`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:37.140238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d04a1f15-8e48-489e-ab6e-d5e4967798ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:37.167227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348574e-2629-4615-89f2-2d305f01212c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:37.171870 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac205fa-cf38-425f-897c-4594909ef21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:37.172567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac205fa-cf38-425f-897c-4594909ef21e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:37.172893 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac205fa-cf38-425f-897c-4594909ef21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:37.173171 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac205fa-cf38-425f-897c-4594909ef21e admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:37.173892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac205fa-cf38-425f-897c-4594909ef21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:37.175569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac205fa-cf38-425f-897c-4594909ef21e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:37.185617 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1354/2703] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:49:37.189818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac205fa-cf38-425f-897c-4594909ef21e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:37.201220 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac205fa-cf38-425f-897c-4594909ef21e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:37.201366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:37.204909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1350/2704] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:49:37.205735 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0669c-988a-4a6a-a0af-c5652ff98192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:37.206625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0669c-988a-4a6a-a0af-c5652ff98192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:37.206906 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0669c-988a-4a6a-a0af-c5652ff98192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:37.207184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0669c-988a-4a6a-a0af-c5652ff98192 admin admin] PATH_INFO: `/v3/projects/c3696a6203924cb0aeee644578d46dab/users/5ea3523fb91b4fd8a4c25153b751ed7f/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:37.216886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a1f15-8e48-489e-ab6e-d5e4967798ed None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:37.218415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d04a1f15-8e48-489e-ab6e-d5e4967798ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:37.219515 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:37.223442 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0669c-988a-4a6a-a0af-c5652ff98192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3696a6203924cb0aeee644578d46dab, user_id=5ea3523fb91b4fd8a4c25153b751ed7f, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:37.226140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0669c-988a-4a6a-a0af-c5652ff98192 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:37.274677 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a1f15-8e48-489e-ab6e-d5e4967798ed None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:37.279148 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a8217-25f5-40ff-9c8c-42a3c2e625d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:37.279785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8217-25f5-40ff-9c8c-42a3c2e625d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:37.280068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8217-25f5-40ff-9c8c-42a3c2e625d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:37.280343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8217-25f5-40ff-9c8c-42a3c2e625d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:37.288549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a8217-25f5-40ff-9c8c-42a3c2e625d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:37.290046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a8217-25f5-40ff-9c8c-42a3c2e625d8 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:37.298666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1351/2705] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:49:37.325180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1355/2706] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:37 2022] PUT /identity/v3/projects/c3696a6203924cb0aeee644578d46dab/users/5ea3523fb91b4fd8a4c25153b751ed7f/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:49:37.331205 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d0148-61e7-4fef-8c92-39d0cb6f8d83 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:37.331391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d0148-61e7-4fef-8c92-39d0cb6f8d83 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:37.331666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d0148-61e7-4fef-8c92-39d0cb6f8d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:37.359912 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d89d0148-61e7-4fef-8c92-39d0cb6f8d83 None None] MFA Rules not processed for user `5ea3523fb91b4fd8a4c25153b751ed7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:37.361160 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d89d0148-61e7-4fef-8c92-39d0cb6f8d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:37.425343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1352/2707] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:37.429658 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0669c-988a-4a6a-a0af-c5652ff98192 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:37.492012 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0669c-988a-4a6a-a0af-c5652ff98192 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:37.498949 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa3b39-243e-4dea-b9ff-32f5d9522c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:37.499616 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3b39-243e-4dea-b9ff-32f5d9522c43 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:37.499892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3b39-243e-4dea-b9ff-32f5d9522c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:37.500177 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3b39-243e-4dea-b9ff-32f5d9522c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:37.500893 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa3b39-243e-4dea-b9ff-32f5d9522c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:37.502798 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa3b39-243e-4dea-b9ff-32f5d9522c43 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:37.616012 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1356/2708] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:49:37 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:49:37.620122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d0148-61e7-4fef-8c92-39d0cb6f8d83 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:37.631373 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d0148-61e7-4fef-8c92-39d0cb6f8d83 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:37.687300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c88d0-a225-439e-ac6e-7b9b5bd4bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:37.687971 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c88d0-a225-439e-ac6e-7b9b5bd4bf19 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:37.688258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c88d0-a225-439e-ac6e-7b9b5bd4bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:37.688540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c88d0-a225-439e-ac6e-7b9b5bd4bf19 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:37.689266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c88d0-a225-439e-ac6e-7b9b5bd4bf19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:37.691185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c88d0-a225-439e-ac6e-7b9b5bd4bf19 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:37.786032 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1353/2709] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:49:37 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:37.790128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa3b39-243e-4dea-b9ff-32f5d9522c43 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:37.801851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa3b39-243e-4dea-b9ff-32f5d9522c43 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:37.806624 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377d69e-dfaa-414b-babc-dfcd3b783332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:37.807335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377d69e-dfaa-414b-babc-dfcd3b783332 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:37.807625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377d69e-dfaa-414b-babc-dfcd3b783332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:37.808084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377d69e-dfaa-414b-babc-dfcd3b783332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:37.809353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377d69e-dfaa-414b-babc-dfcd3b783332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:37.810959 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377d69e-dfaa-414b-babc-dfcd3b783332 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:37.823201 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1357/2710] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:49:37.827472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c88d0-a225-439e-ac6e-7b9b5bd4bf19 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:37.838155 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c88d0-a225-439e-ac6e-7b9b5bd4bf19 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:37.843083 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabac02-6593-459f-b149-745196c76187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:37.843988 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabac02-6593-459f-b149-745196c76187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:37.844275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabac02-6593-459f-b149-745196c76187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:37.844581 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabac02-6593-459f-b149-745196c76187 admin admin] PATH_INFO: `/v3/projects/cbb3deaa89574217b83ef9b69954ea73/users/36fce9558a064d58939d6ffd31627af5/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:37.860895 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabac02-6593-459f-b149-745196c76187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb3deaa89574217b83ef9b69954ea73, user_id=36fce9558a064d58939d6ffd31627af5, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:37.863807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabac02-6593-459f-b149-745196c76187 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:37.945810 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:37.951663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1354/2711] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:37 2022] PUT /identity/v3/projects/cbb3deaa89574217b83ef9b69954ea73/users/36fce9558a064d58939d6ffd31627af5/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:37.955794 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377d69e-dfaa-414b-babc-dfcd3b783332 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:37.965785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377d69e-dfaa-414b-babc-dfcd3b783332 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:38.022190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83acf9f-0bbd-4cb1-9be8-dd376c7abaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:38.022861 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83acf9f-0bbd-4cb1-9be8-dd376c7abaec admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:38.023148 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83acf9f-0bbd-4cb1-9be8-dd376c7abaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:38.023433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83acf9f-0bbd-4cb1-9be8-dd376c7abaec admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:38.024182 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83acf9f-0bbd-4cb1-9be8-dd376c7abaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:38.025847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83acf9f-0bbd-4cb1-9be8-dd376c7abaec admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:38.035587 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1358/2712] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:49:38.039764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabac02-6593-459f-b149-745196c76187 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:38.050498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabac02-6593-459f-b149-745196c76187 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:38.055266 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad4af0-b00c-414a-ac18-40419986b83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:38.056262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad4af0-b00c-414a-ac18-40419986b83d admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:38.056554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad4af0-b00c-414a-ac18-40419986b83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:38.056862 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad4af0-b00c-414a-ac18-40419986b83d admin admin] PATH_INFO: `/v3/projects/cbb3deaa89574217b83ef9b69954ea73/users/36fce9558a064d58939d6ffd31627af5/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:38.059568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad4af0-b00c-414a-ac18-40419986b83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb3deaa89574217b83ef9b69954ea73, user_id=36fce9558a064d58939d6ffd31627af5, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:38.062211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad4af0-b00c-414a-ac18-40419986b83d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:38.072579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1355/2713] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:38 2022] PUT /identity/v3/projects/cbb3deaa89574217b83ef9b69954ea73/users/36fce9558a064d58939d6ffd31627af5/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:38.083066 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd89c8-c747-4d41-a935-f1db61740688 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:38.083433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd89c8-c747-4d41-a935-f1db61740688 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:38.083724 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd89c8-c747-4d41-a935-f1db61740688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:38.112735 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-cabd89c8-c747-4d41-a935-f1db61740688 None None] MFA Rules not processed for user `36fce9558a064d58939d6ffd31627af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:38.114020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cabd89c8-c747-4d41-a935-f1db61740688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:38.163258 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:38.184942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1359/2714] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:38.195906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad4af0-b00c-414a-ac18-40419986b83d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:38.252110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad4af0-b00c-414a-ac18-40419986b83d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:38.255999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50341e-cbfc-4ab2-bc3b-e8930548ade6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:38.257796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50341e-cbfc-4ab2-bc3b-e8930548ade6 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:38.257796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50341e-cbfc-4ab2-bc3b-e8930548ade6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:38.257796 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50341e-cbfc-4ab2-bc3b-e8930548ade6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:38.267275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50341e-cbfc-4ab2-bc3b-e8930548ade6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:38.268903 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50341e-cbfc-4ab2-bc3b-e8930548ade6 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:38.279711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1356/2715] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:39.519981 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd89c8-c747-4d41-a935-f1db61740688 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:39.581710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd89c8-c747-4d41-a935-f1db61740688 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:39.586148 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:39.587068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:39.587349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:39.587623 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] PATH_INFO: `/v3/users/5ea3523fb91b4fd8a4c25153b751ed7f` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:39.588958 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea3523fb91b4fd8a4c25153b751ed7f)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:39.591384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:39.825170 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea3523fb91b4fd8a4c25153b751ed7f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:39.826166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea3523fb91b4fd8a4c25153b751ed7f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:39.826876 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea3523fb91b4fd8a4c25153b751ed7f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:39.839139 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea3523fb91b4fd8a4c25153b751ed7f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:39.846386 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea3523fb91b4fd8a4c25153b751ed7f'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:39.900050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1360/2716] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:49:39 2022] DELETE /identity/v3/users/5ea3523fb91b4fd8a4c25153b751ed7f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:39.905183 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117abbf-3bb3-4848-8b28-b57868bdb397 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:39.905645 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117abbf-3bb3-4848-8b28-b57868bdb397 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:39.905798 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117abbf-3bb3-4848-8b28-b57868bdb397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:39.922960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f117abbf-3bb3-4848-8b28-b57868bdb397 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:39.924164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f117abbf-3bb3-4848-8b28-b57868bdb397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:39.982127 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1357/2717] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:39.991566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:39.992993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:40.049552 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950a603-d8e5-4dab-8fc3-2f7974b0dd91 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:40.053227 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c00b8-2bd2-44fe-9870-d3ce5f38cb67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:40.053883 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c00b8-2bd2-44fe-9870-d3ce5f38cb67 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:40.054169 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c00b8-2bd2-44fe-9870-d3ce5f38cb67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:40.054450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c00b8-2bd2-44fe-9870-d3ce5f38cb67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:40.063659 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c00b8-2bd2-44fe-9870-d3ce5f38cb67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:40.065134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c00b8-2bd2-44fe-9870-d3ce5f38cb67 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:40.074466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1361/2718] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:40.541706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117abbf-3bb3-4848-8b28-b57868bdb397 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:40.543131 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f117abbf-3bb3-4848-8b28-b57868bdb397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:40.557326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117abbf-3bb3-4848-8b28-b57868bdb397 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:40.564113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:40.564846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:40.565222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:40.565456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] PATH_INFO: `/v3/projects/c3696a6203924cb0aeee644578d46dab` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:40.566703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3696a6203924cb0aeee644578d46dab)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:40.568650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:40.729393 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3696a6203924cb0aeee644578d46dab', 'request_id': 'req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:40.736101 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3696a6203924cb0aeee644578d46dab', 'request_id': 'req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:40.742085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3696a6203924cb0aeee644578d46dab', 'request_id': 'req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:40.895520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] The token cache is being invalidate because project c3696a6203924cb0aeee644578d46dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:49:40.895872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:40.896557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:40.898676 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1358/2719] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:49:40 2022] DELETE /identity/v3/projects/c3696a6203924cb0aeee644578d46dab => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:40.907859 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c00b8-2bd2-44fe-9870-d3ce5f38cb67 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:40.917583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c00b8-2bd2-44fe-9870-d3ce5f38cb67 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:40.921977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:40.974042 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02161b09-04b3-47ed-b31e-ee54047f91c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:40.974889 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02161b09-04b3-47ed-b31e-ee54047f91c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:40.975184 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02161b09-04b3-47ed-b31e-ee54047f91c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:40.975465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02161b09-04b3-47ed-b31e-ee54047f91c3 admin admin] PATH_INFO: `/v3/users/36fce9558a064d58939d6ffd31627af5` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:40.976647 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02161b09-04b3-47ed-b31e-ee54047f91c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fce9558a064d58939d6ffd31627af5)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:40.978586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02161b09-04b3-47ed-b31e-ee54047f91c3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:41.204495 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-02161b09-04b3-47ed-b31e-ee54047f91c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fce9558a064d58939d6ffd31627af5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:41.205174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-02161b09-04b3-47ed-b31e-ee54047f91c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fce9558a064d58939d6ffd31627af5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:41.205777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-02161b09-04b3-47ed-b31e-ee54047f91c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fce9558a064d58939d6ffd31627af5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:41.217725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-02161b09-04b3-47ed-b31e-ee54047f91c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fce9558a064d58939d6ffd31627af5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:41.224352 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-02161b09-04b3-47ed-b31e-ee54047f91c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fce9558a064d58939d6ffd31627af5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:41.339906 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1362/2720] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:49:40 2022] DELETE /identity/v3/users/36fce9558a064d58939d6ffd31627af5 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:42.010344 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:42.011861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:42.025600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe0f0-cd4c-424a-89a1-35aeb0ba57e3 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:42.033637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:42.082336 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3138e7f-f17d-426b-8522-2bc2ef40613e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:42.083135 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138e7f-f17d-426b-8522-2bc2ef40613e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:42.083420 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138e7f-f17d-426b-8522-2bc2ef40613e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:42.083700 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138e7f-f17d-426b-8522-2bc2ef40613e admin admin] PATH_INFO: `/v3/projects/cbb3deaa89574217b83ef9b69954ea73` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:42.084932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3138e7f-f17d-426b-8522-2bc2ef40613e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb3deaa89574217b83ef9b69954ea73)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:42.086827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3138e7f-f17d-426b-8522-2bc2ef40613e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:42.225590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d3138e7f-f17d-426b-8522-2bc2ef40613e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb3deaa89574217b83ef9b69954ea73', 'request_id': 'req-d3138e7f-f17d-426b-8522-2bc2ef40613e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:42.231675 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d3138e7f-f17d-426b-8522-2bc2ef40613e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb3deaa89574217b83ef9b69954ea73', 'request_id': 'req-d3138e7f-f17d-426b-8522-2bc2ef40613e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:42.237953 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d3138e7f-f17d-426b-8522-2bc2ef40613e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb3deaa89574217b83ef9b69954ea73', 'request_id': 'req-d3138e7f-f17d-426b-8522-2bc2ef40613e'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:42.293611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d3138e7f-f17d-426b-8522-2bc2ef40613e admin admin] The token cache is being invalidate because project cbb3deaa89574217b83ef9b69954ea73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:49:42.293896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d3138e7f-f17d-426b-8522-2bc2ef40613e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:42.294506 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-d3138e7f-f17d-426b-8522-2bc2ef40613e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:42.296618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1359/2721] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:49:42 2022] DELETE /identity/v3/projects/cbb3deaa89574217b83ef9b69954ea73 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:42.302689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa08ee-eca6-4796-ab44-c9c8f7ab60c6 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:42.303155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa08ee-eca6-4796-ab44-c9c8f7ab60c6 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:42.303246 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa08ee-eca6-4796-ab44-c9c8f7ab60c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:42.321365 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-48fa08ee-eca6-4796-ab44-c9c8f7ab60c6 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:42.322562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-48fa08ee-eca6-4796-ab44-c9c8f7ab60c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:42.379239 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1363/2722] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:42.387775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1255a-91e1-4450-8844-fc4a333baa38 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:42.388065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1255a-91e1-4450-8844-fc4a333baa38 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:42.388348 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1255a-91e1-4450-8844-fc4a333baa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:42.408048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d9b1255a-91e1-4450-8844-fc4a333baa38 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:42.409267 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d9b1255a-91e1-4450-8844-fc4a333baa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:42.417060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1360/2723] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:42.421600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa08ee-eca6-4796-ab44-c9c8f7ab60c6 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:42.431383 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa08ee-eca6-4796-ab44-c9c8f7ab60c6 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:42.436586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883a590-d9bc-4ec1-b8a2-8fc5004d5b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:42.437329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a590-d9bc-4ec1-b8a2-8fc5004d5b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:42.438934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a590-d9bc-4ec1-b8a2-8fc5004d5b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:42.438934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a590-d9bc-4ec1-b8a2-8fc5004d5b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:42.438934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883a590-d9bc-4ec1-b8a2-8fc5004d5b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:49:42.438934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883a590-d9bc-4ec1-b8a2-8fc5004d5b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:42.440512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883a590-d9bc-4ec1-b8a2-8fc5004d5b70 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:42.452035 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1364/2724] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:49:42.456144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1255a-91e1-4450-8844-fc4a333baa38 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:42.465162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1255a-91e1-4450-8844-fc4a333baa38 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:42.469740 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5fa33-f22b-4f8d-a120-833df781c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:42.470377 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5fa33-f22b-4f8d-a120-833df781c94c admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:42.470654 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5fa33-f22b-4f8d-a120-833df781c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:42.470927 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5fa33-f22b-4f8d-a120-833df781c94c admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:42.471602 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5fa33-f22b-4f8d-a120-833df781c94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:42.473508 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5fa33-f22b-4f8d-a120-833df781c94c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:42.599740 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1361/2725] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:49:42 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:42.606373 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883a590-d9bc-4ec1-b8a2-8fc5004d5b70 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:42.617234 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883a590-d9bc-4ec1-b8a2-8fc5004d5b70 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:42.625751 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:42.672346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc824bff-3d6e-4dba-bd00-6eeecf7cd2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:42.673059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc824bff-3d6e-4dba-bd00-6eeecf7cd2bb admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:42.673346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc824bff-3d6e-4dba-bd00-6eeecf7cd2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:42.673627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc824bff-3d6e-4dba-bd00-6eeecf7cd2bb admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:42.674310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc824bff-3d6e-4dba-bd00-6eeecf7cd2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:42.676282 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc824bff-3d6e-4dba-bd00-6eeecf7cd2bb admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:42.774785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1365/2726] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:49:42 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:42.779529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5fa33-f22b-4f8d-a120-833df781c94c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:42.790019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5fa33-f22b-4f8d-a120-833df781c94c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:42.794826 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb607b1-20b4-4f9c-ab2d-56aae4a0d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:42.796076 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb607b1-20b4-4f9c-ab2d-56aae4a0d785 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:42.796391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb607b1-20b4-4f9c-ab2d-56aae4a0d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:42.796686 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb607b1-20b4-4f9c-ab2d-56aae4a0d785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:42.797431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb607b1-20b4-4f9c-ab2d-56aae4a0d785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:42.799050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb607b1-20b4-4f9c-ab2d-56aae4a0d785 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:42.809550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1362/2727] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:49:42.813379 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc824bff-3d6e-4dba-bd00-6eeecf7cd2bb admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:42.823358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc824bff-3d6e-4dba-bd00-6eeecf7cd2bb admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:42.827929 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c15743-9d42-44e1-835b-ae6cdc06f863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:42.828611 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15743-9d42-44e1-835b-ae6cdc06f863 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:42.828920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15743-9d42-44e1-835b-ae6cdc06f863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:42.829195 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15743-9d42-44e1-835b-ae6cdc06f863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:42.829928 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c15743-9d42-44e1-835b-ae6cdc06f863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:42.831499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c15743-9d42-44e1-835b-ae6cdc06f863 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:42.841236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1366/2728] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:49:42.845856 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb607b1-20b4-4f9c-ab2d-56aae4a0d785 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:42.855574 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb607b1-20b4-4f9c-ab2d-56aae4a0d785 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:42.860855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057acf3a-121b-4005-b2e3-1f5a8ba22edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:42.861720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057acf3a-121b-4005-b2e3-1f5a8ba22edb admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:42.862002 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057acf3a-121b-4005-b2e3-1f5a8ba22edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:42.862276 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057acf3a-121b-4005-b2e3-1f5a8ba22edb admin admin] PATH_INFO: `/v3/projects/2b0ac8e503804fa8b18b99d682ce054c/users/6e18f716fb574c8c85e9d2ca1993304c/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:42.876255 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057acf3a-121b-4005-b2e3-1f5a8ba22edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0ac8e503804fa8b18b99d682ce054c, user_id=6e18f716fb574c8c85e9d2ca1993304c, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:42.878900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057acf3a-121b-4005-b2e3-1f5a8ba22edb admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:42.992119 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1363/2729] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:42 2022] PUT /identity/v3/projects/2b0ac8e503804fa8b18b99d682ce054c/users/6e18f716fb574c8c85e9d2ca1993304c/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:43.002272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf76f2a-da7b-4e34-b179-bf262160473b None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:43.002566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf76f2a-da7b-4e34-b179-bf262160473b None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:43.002843 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf76f2a-da7b-4e34-b179-bf262160473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:43.029781 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-7bf76f2a-da7b-4e34-b179-bf262160473b None None] MFA Rules not processed for user `6e18f716fb574c8c85e9d2ca1993304c`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:43.031004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-7bf76f2a-da7b-4e34-b179-bf262160473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:43.096007 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1367/2730] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:49:43.100531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057acf3a-121b-4005-b2e3-1f5a8ba22edb admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:43.140311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:43.161682 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057acf3a-121b-4005-b2e3-1f5a8ba22edb admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:43.166397 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b36170-4be1-444f-8326-56a3b085371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:43.167055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b36170-4be1-444f-8326-56a3b085371b admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:43.167342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b36170-4be1-444f-8326-56a3b085371b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:43.167625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b36170-4be1-444f-8326-56a3b085371b admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:43.168311 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b36170-4be1-444f-8326-56a3b085371b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:43.170236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b36170-4be1-444f-8326-56a3b085371b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:43.261915 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1364/2731] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:49:43 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:43.266343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf76f2a-da7b-4e34-b179-bf262160473b None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:43.277470 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf76f2a-da7b-4e34-b179-bf262160473b None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:43.332635 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8f2ff-657f-4af6-bee9-d51d2690fd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:43.333327 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f2ff-657f-4af6-bee9-d51d2690fd34 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:43.333613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f2ff-657f-4af6-bee9-d51d2690fd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:43.333895 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f2ff-657f-4af6-bee9-d51d2690fd34 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:43.334583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8f2ff-657f-4af6-bee9-d51d2690fd34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:43.336499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8f2ff-657f-4af6-bee9-d51d2690fd34 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:43.414537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1368/2732] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:49:43 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:43.418570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b36170-4be1-444f-8326-56a3b085371b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:43.428764 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b36170-4be1-444f-8326-56a3b085371b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:43.433473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376926dc-ae9c-4c41-8eb3-5b745b5702e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:43.434219 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376926dc-ae9c-4c41-8eb3-5b745b5702e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:43.434568 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376926dc-ae9c-4c41-8eb3-5b745b5702e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:43.434851 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376926dc-ae9c-4c41-8eb3-5b745b5702e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:43.436086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376926dc-ae9c-4c41-8eb3-5b745b5702e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:43.437692 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376926dc-ae9c-4c41-8eb3-5b745b5702e7 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:43.447906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1365/2733] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:49:43.452874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8f2ff-657f-4af6-bee9-d51d2690fd34 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:43.464913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8f2ff-657f-4af6-bee9-d51d2690fd34 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:43.469572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c485e1-1dbe-4946-a25b-1e3ae31a3a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:43.470441 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c485e1-1dbe-4946-a25b-1e3ae31a3a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:43.470722 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c485e1-1dbe-4946-a25b-1e3ae31a3a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:43.470993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c485e1-1dbe-4946-a25b-1e3ae31a3a93 admin admin] PATH_INFO: `/v3/projects/59bf8fae658349afb99f9ba2fd8f6aba/users/7b4e85e193e84704b09febf4148564d1/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:43.479203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:43.485508 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c485e1-1dbe-4946-a25b-1e3ae31a3a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bf8fae658349afb99f9ba2fd8f6aba, user_id=7b4e85e193e84704b09febf4148564d1, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:43.488186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c485e1-1dbe-4946-a25b-1e3ae31a3a93 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:43.574887 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1369/2734] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:43 2022] PUT /identity/v3/projects/59bf8fae658349afb99f9ba2fd8f6aba/users/7b4e85e193e84704b09febf4148564d1/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:43.579417 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376926dc-ae9c-4c41-8eb3-5b745b5702e7 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:43.589334 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376926dc-ae9c-4c41-8eb3-5b745b5702e7 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:43.650352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cffbfa-7cb1-42c1-a6e5-d3887625a212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:43.651023 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cffbfa-7cb1-42c1-a6e5-d3887625a212 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:43.651304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cffbfa-7cb1-42c1-a6e5-d3887625a212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:43.651580 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cffbfa-7cb1-42c1-a6e5-d3887625a212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:43.652305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cffbfa-7cb1-42c1-a6e5-d3887625a212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:43.654209 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cffbfa-7cb1-42c1-a6e5-d3887625a212 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:43.664283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1366/2735] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:49:43.668433 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c485e1-1dbe-4946-a25b-1e3ae31a3a93 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:43.679325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c485e1-1dbe-4946-a25b-1e3ae31a3a93 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:43.683993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb6f0-5436-4982-9e6d-41cd06d08acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:43.684904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb6f0-5436-4982-9e6d-41cd06d08acc admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:43.685203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb6f0-5436-4982-9e6d-41cd06d08acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:43.686006 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb6f0-5436-4982-9e6d-41cd06d08acc admin admin] PATH_INFO: `/v3/projects/59bf8fae658349afb99f9ba2fd8f6aba/users/7b4e85e193e84704b09febf4148564d1/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:43.688021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bb6f0-5436-4982-9e6d-41cd06d08acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bf8fae658349afb99f9ba2fd8f6aba, user_id=7b4e85e193e84704b09febf4148564d1, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:43.690842 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bb6f0-5436-4982-9e6d-41cd06d08acc admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:43.701058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1370/2736] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:43 2022] PUT /identity/v3/projects/59bf8fae658349afb99f9ba2fd8f6aba/users/7b4e85e193e84704b09febf4148564d1/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:43.711059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700bee6-369a-4aae-8b8d-cacd103c57f5 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:43.711350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700bee6-369a-4aae-8b8d-cacd103c57f5 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:43.711657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700bee6-369a-4aae-8b8d-cacd103c57f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:43.737386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-3700bee6-369a-4aae-8b8d-cacd103c57f5 None None] MFA Rules not processed for user `7b4e85e193e84704b09febf4148564d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:43.738633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3700bee6-369a-4aae-8b8d-cacd103c57f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:43.804436 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1367/2737] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:43.815562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb6f0-5436-4982-9e6d-41cd06d08acc admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:43.817265 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-838bb6f0-5436-4982-9e6d-41cd06d08acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:43.872149 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb6f0-5436-4982-9e6d-41cd06d08acc admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:43.876265 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d239236-46c4-497e-a78d-bdddb1cce6ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:43.876934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d239236-46c4-497e-a78d-bdddb1cce6ee service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:43.877219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d239236-46c4-497e-a78d-bdddb1cce6ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:43.877496 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d239236-46c4-497e-a78d-bdddb1cce6ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:43.930764 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d239236-46c4-497e-a78d-bdddb1cce6ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:43.932194 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d239236-46c4-497e-a78d-bdddb1cce6ee service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:43.941536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1371/2738] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:49.709793 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700bee6-369a-4aae-8b8d-cacd103c57f5 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:49.711242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-3700bee6-369a-4aae-8b8d-cacd103c57f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:49.746174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:49.775382 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700bee6-369a-4aae-8b8d-cacd103c57f5 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:49.780537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defca7a2-2ac7-4bea-8eb0-c9617d129c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:49.782067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca7a2-2ac7-4bea-8eb0-c9617d129c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:49.782355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca7a2-2ac7-4bea-8eb0-c9617d129c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:49.782624 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca7a2-2ac7-4bea-8eb0-c9617d129c72 admin admin] PATH_INFO: `/v3/users/10a01e15a0a24c6eb417d997bc0e8838` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:49.783986 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defca7a2-2ac7-4bea-8eb0-c9617d129c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10a01e15a0a24c6eb417d997bc0e8838)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:49.785932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defca7a2-2ac7-4bea-8eb0-c9617d129c72 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:50.053608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-defca7a2-2ac7-4bea-8eb0-c9617d129c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10a01e15a0a24c6eb417d997bc0e8838'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:50.054300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-defca7a2-2ac7-4bea-8eb0-c9617d129c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10a01e15a0a24c6eb417d997bc0e8838'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:50.093655 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d239236-46c4-497e-a78d-bdddb1cce6ee service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:50.104216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d239236-46c4-497e-a78d-bdddb1cce6ee service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:50.108625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:50.109510 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:50.109834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:50.110069 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] PATH_INFO: `/v3/users/6e18f716fb574c8c85e9d2ca1993304c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:50.111278 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e18f716fb574c8c85e9d2ca1993304c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:50.113208 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:50.169648 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-defca7a2-2ac7-4bea-8eb0-c9617d129c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10a01e15a0a24c6eb417d997bc0e8838'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:50.182070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-defca7a2-2ac7-4bea-8eb0-c9617d129c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10a01e15a0a24c6eb417d997bc0e8838'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:50.189262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-defca7a2-2ac7-4bea-8eb0-c9617d129c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10a01e15a0a24c6eb417d997bc0e8838'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:50.195171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1368/2739] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:49:49 2022] DELETE /identity/v3/users/10a01e15a0a24c6eb417d997bc0e8838 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:50.199289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0a8fc-6a90-488f-a04b-5c8b70891f96 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:50.199577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0a8fc-6a90-488f-a04b-5c8b70891f96 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:50.199859 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0a8fc-6a90-488f-a04b-5c8b70891f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:50.217281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-78b0a8fc-6a90-488f-a04b-5c8b70891f96 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:50.218486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-78b0a8fc-6a90-488f-a04b-5c8b70891f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:50.277600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1369/2740] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:49:50.287306 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0a8fc-6a90-488f-a04b-5c8b70891f96 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:50.294687 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-78b0a8fc-6a90-488f-a04b-5c8b70891f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:50.349317 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0a8fc-6a90-488f-a04b-5c8b70891f96 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:50.353047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6ff67-46a6-4912-a2ef-1d25f49ac01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:50.353711 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6ff67-46a6-4912-a2ef-1d25f49ac01a service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:50.353967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6ff67-46a6-4912-a2ef-1d25f49ac01a service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:50.354240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6ff67-46a6-4912-a2ef-1d25f49ac01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:50.361099 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:50.363418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6ff67-46a6-4912-a2ef-1d25f49ac01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:50.364860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6ff67-46a6-4912-a2ef-1d25f49ac01a service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:50.374368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1370/2741] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:49:50.377703 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e18f716fb574c8c85e9d2ca1993304c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:50.378357 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e18f716fb574c8c85e9d2ca1993304c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:50.378966 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e18f716fb574c8c85e9d2ca1993304c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:50.392320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e18f716fb574c8c85e9d2ca1993304c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:50.399991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e18f716fb574c8c85e9d2ca1993304c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:50.513907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:50.518791 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1372/2742] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:49:50 2022] DELETE /identity/v3/users/6e18f716fb574c8c85e9d2ca1993304c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:49:50.523642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f3a28-41a2-4da5-8e6c-3cf527daac50 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:50.523934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f3a28-41a2-4da5-8e6c-3cf527daac50 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:50.524215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f3a28-41a2-4da5-8e6c-3cf527daac50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:50.542091 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-e38f3a28-41a2-4da5-8e6c-3cf527daac50 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:50.543272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e38f3a28-41a2-4da5-8e6c-3cf527daac50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:50.637491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1371/2743] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:50.652534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:50.654758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:50.725054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d65fd-1711-40f9-a3a8-4b6ec5aee9dd admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:50.728783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e645e-5626-4733-824e-18cd67f5c162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:50.729440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e645e-5626-4733-824e-18cd67f5c162 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:50.729725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e645e-5626-4733-824e-18cd67f5c162 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:50.730005 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e645e-5626-4733-824e-18cd67f5c162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:50.740881 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e645e-5626-4733-824e-18cd67f5c162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:50.746563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e645e-5626-4733-824e-18cd67f5c162 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:50.751665 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1373/2744] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:50.910547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f3a28-41a2-4da5-8e6c-3cf527daac50 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:50.911901 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e38f3a28-41a2-4da5-8e6c-3cf527daac50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:50.924385 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f3a28-41a2-4da5-8e6c-3cf527daac50 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:50.930296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f8c0e-a061-4d80-b914-dc92ae1f90f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:50.931229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f8c0e-a061-4d80-b914-dc92ae1f90f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:50.931481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f8c0e-a061-4d80-b914-dc92ae1f90f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:50.931855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f8c0e-a061-4d80-b914-dc92ae1f90f2 admin admin] PATH_INFO: `/v3/projects/873731ad45bf42efb9d2ce43c6ad7fd5` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:50.933677 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f8c0e-a061-4d80-b914-dc92ae1f90f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873731ad45bf42efb9d2ce43c6ad7fd5)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:50.935823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f8c0e-a061-4d80-b914-dc92ae1f90f2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:51.073488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-711f8c0e-a061-4d80-b914-dc92ae1f90f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873731ad45bf42efb9d2ce43c6ad7fd5', 'request_id': 'req-711f8c0e-a061-4d80-b914-dc92ae1f90f2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.080514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-711f8c0e-a061-4d80-b914-dc92ae1f90f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873731ad45bf42efb9d2ce43c6ad7fd5', 'request_id': 'req-711f8c0e-a061-4d80-b914-dc92ae1f90f2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.086294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-711f8c0e-a061-4d80-b914-dc92ae1f90f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873731ad45bf42efb9d2ce43c6ad7fd5', 'request_id': 'req-711f8c0e-a061-4d80-b914-dc92ae1f90f2'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.197956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-711f8c0e-a061-4d80-b914-dc92ae1f90f2 admin admin] The token cache is being invalidate because project 873731ad45bf42efb9d2ce43c6ad7fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:49:51.198499 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-711f8c0e-a061-4d80-b914-dc92ae1f90f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.199225 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-711f8c0e-a061-4d80-b914-dc92ae1f90f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.201338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1372/2745] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:49:50 2022] DELETE /identity/v3/projects/873731ad45bf42efb9d2ce43c6ad7fd5 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:51.206291 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f968727-a710-4ae0-84ff-28eac78c31e7 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:51.206795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f968727-a710-4ae0-84ff-28eac78c31e7 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:51.206885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f968727-a710-4ae0-84ff-28eac78c31e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:51.224790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3f968727-a710-4ae0-84ff-28eac78c31e7 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:51.225973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3f968727-a710-4ae0-84ff-28eac78c31e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:51.285794 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1374/2746] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:51.293734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd5e6-410d-4962-8174-f2fd9dae2728 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:51.294022 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd5e6-410d-4962-8174-f2fd9dae2728 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:51.294301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd5e6-410d-4962-8174-f2fd9dae2728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:51.312857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-939fd5e6-410d-4962-8174-f2fd9dae2728 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:51.314038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-939fd5e6-410d-4962-8174-f2fd9dae2728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:51.322579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1373/2747] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:51.326609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f968727-a710-4ae0-84ff-28eac78c31e7 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:51.336283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f968727-a710-4ae0-84ff-28eac78c31e7 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:51.340869 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f455e-3901-4ae1-bf20-24ddf652f21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:51.341522 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f455e-3901-4ae1-bf20-24ddf652f21b admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:51.341811 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f455e-3901-4ae1-bf20-24ddf652f21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:51.342094 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f455e-3901-4ae1-bf20-24ddf652f21b admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:51.342816 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f455e-3901-4ae1-bf20-24ddf652f21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:49:51.343126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f455e-3901-4ae1-bf20-24ddf652f21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:51.344749 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f455e-3901-4ae1-bf20-24ddf652f21b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:51.356105 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1375/2748] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:49:51.368906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fd5e6-410d-4962-8174-f2fd9dae2728 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:51.378633 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fd5e6-410d-4962-8174-f2fd9dae2728 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:51.383329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143543c7-e2fc-4931-9d98-6cf06d39990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:51.383945 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143543c7-e2fc-4931-9d98-6cf06d39990e admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:51.384226 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143543c7-e2fc-4931-9d98-6cf06d39990e admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:51.384498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143543c7-e2fc-4931-9d98-6cf06d39990e admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:51.385263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143543c7-e2fc-4931-9d98-6cf06d39990e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:51.387142 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143543c7-e2fc-4931-9d98-6cf06d39990e admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:51.394667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f455e-3901-4ae1-bf20-24ddf652f21b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:51.396452 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-cb6f455e-3901-4ae1-bf20-24ddf652f21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:51.411697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f455e-3901-4ae1-bf20-24ddf652f21b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:51.416557 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:51.417957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:51.418410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:51.418696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] PATH_INFO: `/v3/projects/2b0ac8e503804fa8b18b99d682ce054c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:51.419866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0ac8e503804fa8b18b99d682ce054c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:51.421791 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:51.507111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1374/2749] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:49:51 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:51.511191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143543c7-e2fc-4931-9d98-6cf06d39990e admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:51.554217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0ac8e503804fa8b18b99d682ce054c', 'request_id': 'req-1f660a33-e2bf-4149-adc8-a695c6019c5c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.563453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:51.574465 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143543c7-e2fc-4931-9d98-6cf06d39990e admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:51.630786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e85626-cc34-4f83-ba98-3078e10e825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:51.631459 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e85626-cc34-4f83-ba98-3078e10e825f admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:51.631742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e85626-cc34-4f83-ba98-3078e10e825f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:51.632019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e85626-cc34-4f83-ba98-3078e10e825f admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:51.632760 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e85626-cc34-4f83-ba98-3078e10e825f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:51.634713 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e85626-cc34-4f83-ba98-3078e10e825f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:51.637760 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0ac8e503804fa8b18b99d682ce054c', 'request_id': 'req-1f660a33-e2bf-4149-adc8-a695c6019c5c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.648111 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0ac8e503804fa8b18b99d682ce054c', 'request_id': 'req-1f660a33-e2bf-4149-adc8-a695c6019c5c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.656704 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] The token cache is being invalidate because project 2b0ac8e503804fa8b18b99d682ce054c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:49:51.656990 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.657783 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.660013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1376/2750] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:49:51 2022] DELETE /identity/v3/projects/2b0ac8e503804fa8b18b99d682ce054c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:49:51.663765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:51.665331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:51.679675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f660a33-e2bf-4149-adc8-a695c6019c5c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:51.684367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:51.685319 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:51.685602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:51.685874 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] PATH_INFO: `/v3/users/7b4e85e193e84704b09febf4148564d1` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:51.687053 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4e85e193e84704b09febf4148564d1)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:51.690630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:51.695070 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:51.776152 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1375/2751] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:49:51 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:49:51.780095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e85626-cc34-4f83-ba98-3078e10e825f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:51.781743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f2e85626-cc34-4f83-ba98-3078e10e825f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:51.793823 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e85626-cc34-4f83-ba98-3078e10e825f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:51.798506 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f6d0b-c29b-4d18-b961-e2037f88d233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:51.799154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6d0b-c29b-4d18-b961-e2037f88d233 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:51.799437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6d0b-c29b-4d18-b961-e2037f88d233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:51.799720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6d0b-c29b-4d18-b961-e2037f88d233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:51.800443 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f6d0b-c29b-4d18-b961-e2037f88d233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:51.802058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f6d0b-c29b-4d18-b961-e2037f88d233 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:51.811996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1376/2752] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:49:51.821413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f6d0b-c29b-4d18-b961-e2037f88d233 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:51.831144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f6d0b-c29b-4d18-b961-e2037f88d233 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:51.835922 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf2bf7-f3e5-40b2-845b-b0728b59b8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:51.836540 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2bf7-f3e5-40b2-845b-b0728b59b8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:51.836860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2bf7-f3e5-40b2-845b-b0728b59b8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:51.837144 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2bf7-f3e5-40b2-845b-b0728b59b8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:51.837848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf2bf7-f3e5-40b2-845b-b0728b59b8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:51.839391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf2bf7-f3e5-40b2-845b-b0728b59b8e5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:51.850303 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1377/2753] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:49:51.854220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf2bf7-f3e5-40b2-845b-b0728b59b8e5 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:51.863756 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf2bf7-f3e5-40b2-845b-b0728b59b8e5 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:51.868470 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d0a5a-f150-4c00-aecc-2969edc59dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:51.869354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d0a5a-f150-4c00-aecc-2969edc59dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:51.869639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d0a5a-f150-4c00-aecc-2969edc59dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:51.869916 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d0a5a-f150-4c00-aecc-2969edc59dcb admin admin] PATH_INFO: `/v3/projects/f9bb0d479a7e4a9eb74cd6ea82462505/users/68cb1f2b1bc349b99aab575d48d9eada/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:51.884198 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d0a5a-f150-4c00-aecc-2969edc59dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9bb0d479a7e4a9eb74cd6ea82462505, user_id=68cb1f2b1bc349b99aab575d48d9eada, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:51.886867 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d0a5a-f150-4c00-aecc-2969edc59dcb admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:51.959816 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4e85e193e84704b09febf4148564d1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.960457 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4e85e193e84704b09febf4148564d1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.961073 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4e85e193e84704b09febf4148564d1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.973405 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4e85e193e84704b09febf4148564d1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:51.980056 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4e85e193e84704b09febf4148564d1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:52.009857 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1378/2754] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:51 2022] PUT /identity/v3/projects/f9bb0d479a7e4a9eb74cd6ea82462505/users/68cb1f2b1bc349b99aab575d48d9eada/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:49:52.015329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea660201-e254-4a03-9043-6a4a86aa0f0d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:52.015329 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea660201-e254-4a03-9043-6a4a86aa0f0d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:52.015554 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea660201-e254-4a03-9043-6a4a86aa0f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:52.032956 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ea660201-e254-4a03-9043-6a4a86aa0f0d None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:52.034774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ea660201-e254-4a03-9043-6a4a86aa0f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:52.092381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1379/2755] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:49:52.096301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1377/2756] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:49:51 2022] DELETE /identity/v3/users/7b4e85e193e84704b09febf4148564d1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:49:52.102756 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea660201-e254-4a03-9043-6a4a86aa0f0d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:52.107109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ea660201-e254-4a03-9043-6a4a86aa0f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:52.150637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:52.162967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea660201-e254-4a03-9043-6a4a86aa0f0d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:52.213429 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64efc76-1999-40f0-b067-44d15fa7a666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:52.214060 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64efc76-1999-40f0-b067-44d15fa7a666 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:52.214371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64efc76-1999-40f0-b067-44d15fa7a666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:52.214651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64efc76-1999-40f0-b067-44d15fa7a666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:52.274410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64efc76-1999-40f0-b067-44d15fa7a666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:52.275910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64efc76-1999-40f0-b067-44d15fa7a666 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:52.285570 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1380/2757] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:49:52.621844 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:52.623349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:52.637769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae1268-0dc7-4f8b-ae2a-cdb5eddd7d59 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:52.642340 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:52.643238 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:52.643534 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:52.643797 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] PATH_INFO: `/v3/projects/59bf8fae658349afb99f9ba2fd8f6aba` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:52.645001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59bf8fae658349afb99f9ba2fd8f6aba)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:52.646907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:52.804752 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59bf8fae658349afb99f9ba2fd8f6aba', 'request_id': 'req-f467afd4-726c-4041-a3e8-7552948d8bc5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:52.894353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59bf8fae658349afb99f9ba2fd8f6aba', 'request_id': 'req-f467afd4-726c-4041-a3e8-7552948d8bc5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:52.901311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59bf8fae658349afb99f9ba2fd8f6aba', 'request_id': 'req-f467afd4-726c-4041-a3e8-7552948d8bc5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:52.913023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] The token cache is being invalidate because project 59bf8fae658349afb99f9ba2fd8f6aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:49:52.913317 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:52.915241 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:49:52.915489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1378/2758] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:49:52 2022] DELETE /identity/v3/projects/59bf8fae658349afb99f9ba2fd8f6aba => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:49:57.690924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f613362-a5ec-4911-8161-b750e8510fde None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:57.691399 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f613362-a5ec-4911-8161-b750e8510fde None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:57.691549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f613362-a5ec-4911-8161-b750e8510fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:57.722594 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0f613362-a5ec-4911-8161-b750e8510fde None None] MFA Rules not processed for user `68cb1f2b1bc349b99aab575d48d9eada`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:57.724061 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0f613362-a5ec-4911-8161-b750e8510fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:57.795008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1381/2759] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:49:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:57.799578 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:57.801080 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:57.871908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467afd4-726c-4041-a3e8-7552948d8bc5 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:57.876504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7f093-6d44-4c4b-b0d7-5caae73b441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:57.877236 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f093-6d44-4c4b-b0d7-5caae73b441b admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:57.877520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f093-6d44-4c4b-b0d7-5caae73b441b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:57.877792 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f093-6d44-4c4b-b0d7-5caae73b441b admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:57.878493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7f093-6d44-4c4b-b0d7-5caae73b441b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:57.880396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7f093-6d44-4c4b-b0d7-5caae73b441b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:57.894513 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:58.027206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1379/2760] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:49:57 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:58.031833 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f613362-a5ec-4911-8161-b750e8510fde None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:58.044650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f613362-a5ec-4911-8161-b750e8510fde None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:58.078002 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:58.101271 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106121dd-e48e-44ae-ad5e-3b8e5c913eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:58.101935 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106121dd-e48e-44ae-ad5e-3b8e5c913eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:58.102218 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106121dd-e48e-44ae-ad5e-3b8e5c913eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:58.102491 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106121dd-e48e-44ae-ad5e-3b8e5c913eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:58.103167 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106121dd-e48e-44ae-ad5e-3b8e5c913eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:58.105114 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106121dd-e48e-44ae-ad5e-3b8e5c913eb8 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:58.189606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1382/2761] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:49:58 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:49:58.191634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7f093-6d44-4c4b-b0d7-5caae73b441b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:58.202654 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7f093-6d44-4c4b-b0d7-5caae73b441b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:58.208266 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8544838-35d4-4ee8-9f23-bed296936c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:58.211977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8544838-35d4-4ee8-9f23-bed296936c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:58.211977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8544838-35d4-4ee8-9f23-bed296936c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:58.211977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8544838-35d4-4ee8-9f23-bed296936c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:58.211977 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8544838-35d4-4ee8-9f23-bed296936c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:58.212407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8544838-35d4-4ee8-9f23-bed296936c77 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:58.223521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1380/2762] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:49:58.227691 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106121dd-e48e-44ae-ad5e-3b8e5c913eb8 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:58.237815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106121dd-e48e-44ae-ad5e-3b8e5c913eb8 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:58.242514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a2997-d6dc-4e0d-9de0-281b85348649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:58.243380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a2997-d6dc-4e0d-9de0-281b85348649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:58.243666 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a2997-d6dc-4e0d-9de0-281b85348649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:58.243973 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a2997-d6dc-4e0d-9de0-281b85348649 admin admin] PATH_INFO: `/v3/projects/fb85b350124249c8aab127b0e25d73fa/users/de11beebd2b3487baad6127662d9e52b/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:58.259112 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a2997-d6dc-4e0d-9de0-281b85348649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb85b350124249c8aab127b0e25d73fa, user_id=de11beebd2b3487baad6127662d9e52b, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:58.261802 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a2997-d6dc-4e0d-9de0-281b85348649 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:58.335855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1383/2763] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:58 2022] PUT /identity/v3/projects/fb85b350124249c8aab127b0e25d73fa/users/de11beebd2b3487baad6127662d9e52b/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:49:58.339856 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8544838-35d4-4ee8-9f23-bed296936c77 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:58.351400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8544838-35d4-4ee8-9f23-bed296936c77 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:58.418990 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90470a-2333-474a-958a-cfe3e695919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:58.420200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90470a-2333-474a-958a-cfe3e695919c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:58.420727 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90470a-2333-474a-958a-cfe3e695919c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:58.421200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90470a-2333-474a-958a-cfe3e695919c admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:58.422118 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90470a-2333-474a-958a-cfe3e695919c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:58.423750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90470a-2333-474a-958a-cfe3e695919c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:58.434548 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1381/2764] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:49:58.438754 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a2997-d6dc-4e0d-9de0-281b85348649 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:58.450174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a2997-d6dc-4e0d-9de0-281b85348649 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:58.455086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a11fb-930f-4bf8-a1b6-53b219a307f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:58.456067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a11fb-930f-4bf8-a1b6-53b219a307f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:58.457051 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a11fb-930f-4bf8-a1b6-53b219a307f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:58.457403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a11fb-930f-4bf8-a1b6-53b219a307f1 admin admin] PATH_INFO: `/v3/projects/fb85b350124249c8aab127b0e25d73fa/users/de11beebd2b3487baad6127662d9e52b/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:58.459495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a11fb-930f-4bf8-a1b6-53b219a307f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb85b350124249c8aab127b0e25d73fa, user_id=de11beebd2b3487baad6127662d9e52b, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:58.462274 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a11fb-930f-4bf8-a1b6-53b219a307f1 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:58.473907 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1384/2765] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:49:58 2022] PUT /identity/v3/projects/fb85b350124249c8aab127b0e25d73fa/users/de11beebd2b3487baad6127662d9e52b/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:50:04.421983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487978e-f583-43a9-8823-382dffeccb2d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:04.422461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487978e-f583-43a9-8823-382dffeccb2d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:04.422659 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487978e-f583-43a9-8823-382dffeccb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:04.453237 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f487978e-f583-43a9-8823-382dffeccb2d None None] MFA Rules not processed for user `de11beebd2b3487baad6127662d9e52b`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:04.454604 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f487978e-f583-43a9-8823-382dffeccb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:04.552933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1382/2766] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:50:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:04.568362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a11fb-930f-4bf8-a1b6-53b219a307f1 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:04.570262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b10a11fb-930f-4bf8-a1b6-53b219a307f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:04.669670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a11fb-930f-4bf8-a1b6-53b219a307f1 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:04.679827 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783324f-ad0e-4042-b105-16ded858e825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:04.680696 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783324f-ad0e-4042-b105-16ded858e825 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:04.680876 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783324f-ad0e-4042-b105-16ded858e825 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:04.681156 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783324f-ad0e-4042-b105-16ded858e825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:04.751014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783324f-ad0e-4042-b105-16ded858e825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:04.752614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783324f-ad0e-4042-b105-16ded858e825 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:04.763453 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1385/2767] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:14.547403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:INSERT=1,keystone:SELECT=70 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:14.758797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:17.823618 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487978e-f583-43a9-8823-382dffeccb2d None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:17.825388 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f487978e-f583-43a9-8823-382dffeccb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:17.900075 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487978e-f583-43a9-8823-382dffeccb2d None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:17.905030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:17.905898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:17.906179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:17.906453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] PATH_INFO: `/v3/users/042f8ba6e4f44479a3de613ece5bea29` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:17.907628 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=042f8ba6e4f44479a3de613ece5bea29)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:17.909573 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:18.145301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042f8ba6e4f44479a3de613ece5bea29'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:18.145979 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042f8ba6e4f44479a3de613ece5bea29'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:18.146666 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042f8ba6e4f44479a3de613ece5bea29'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:18.159746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042f8ba6e4f44479a3de613ece5bea29'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:18.167899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042f8ba6e4f44479a3de613ece5bea29'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:18.285689 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1383/2768] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:50:17 2022] DELETE /identity/v3/users/042f8ba6e4f44479a3de613ece5bea29 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:18.290286 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0ff88-41b1-4e0f-ade7-f334bff48042 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:18.290804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0ff88-41b1-4e0f-ade7-f334bff48042 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:18.290913 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0ff88-41b1-4e0f-ade7-f334bff48042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:18.308800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-aeb0ff88-41b1-4e0f-ade7-f334bff48042 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:18.310069 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-aeb0ff88-41b1-4e0f-ade7-f334bff48042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:18.381426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1386/2769] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:18.391784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:18.393280 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:18.453795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188ca6b-2bf5-4964-8422-d4034a1fc267 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:18.457916 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf56ad-ae4c-4c45-a3c5-38901ce85b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:18.458587 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf56ad-ae4c-4c45-a3c5-38901ce85b1d service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:18.459043 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf56ad-ae4c-4c45-a3c5-38901ce85b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:18.459331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf56ad-ae4c-4c45-a3c5-38901ce85b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:18.469967 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf56ad-ae4c-4c45-a3c5-38901ce85b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:18.471519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf56ad-ae4c-4c45-a3c5-38901ce85b1d service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:18.481293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1384/2770] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:19.143594 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0ff88-41b1-4e0f-ade7-f334bff48042 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:19.147161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-aeb0ff88-41b1-4e0f-ade7-f334bff48042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:19.158052 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0ff88-41b1-4e0f-ade7-f334bff48042 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:19.162860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b91c8-fe27-4845-861b-67a8e0bdc8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:19.163679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b91c8-fe27-4845-861b-67a8e0bdc8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:19.163965 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b91c8-fe27-4845-861b-67a8e0bdc8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:19.164248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b91c8-fe27-4845-861b-67a8e0bdc8fd admin admin] PATH_INFO: `/v3/projects/4b5e0c7e37a04961a33778858838c482` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:19.165481 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b91c8-fe27-4845-861b-67a8e0bdc8fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5e0c7e37a04961a33778858838c482)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:19.167928 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b91c8-fe27-4845-861b-67a8e0bdc8fd admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:19.292284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-818b91c8-fe27-4845-861b-67a8e0bdc8fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5e0c7e37a04961a33778858838c482', 'request_id': 'req-818b91c8-fe27-4845-861b-67a8e0bdc8fd'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:19.300368 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-818b91c8-fe27-4845-861b-67a8e0bdc8fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5e0c7e37a04961a33778858838c482', 'request_id': 'req-818b91c8-fe27-4845-861b-67a8e0bdc8fd'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:19.306242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-818b91c8-fe27-4845-861b-67a8e0bdc8fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5e0c7e37a04961a33778858838c482', 'request_id': 'req-818b91c8-fe27-4845-861b-67a8e0bdc8fd'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:19.638708 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-818b91c8-fe27-4845-861b-67a8e0bdc8fd admin admin] The token cache is being invalidate because project 4b5e0c7e37a04961a33778858838c482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:50:19.639058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-818b91c8-fe27-4845-861b-67a8e0bdc8fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:19.639688 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-818b91c8-fe27-4845-861b-67a8e0bdc8fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:19.641279 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1387/2771] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:50:19 2022] DELETE /identity/v3/projects/4b5e0c7e37a04961a33778858838c482 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:19.646205 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae7f63-be36-478d-ab03-845be790fc91 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:19.646669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae7f63-be36-478d-ab03-845be790fc91 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:19.646846 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae7f63-be36-478d-ab03-845be790fc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:19.667209 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-32ae7f63-be36-478d-ab03-845be790fc91 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:19.669023 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-32ae7f63-be36-478d-ab03-845be790fc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:19.688101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:19.733143 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1385/2772] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:19.746549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35364b-1331-4b6e-bacf-a8302a18e34d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:19.746549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35364b-1331-4b6e-bacf-a8302a18e34d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:19.746549 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35364b-1331-4b6e-bacf-a8302a18e34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:19.761433 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4d35364b-1331-4b6e-bacf-a8302a18e34d None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:19.762653 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4d35364b-1331-4b6e-bacf-a8302a18e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:19.775493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1388/2773] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:19.780384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae7f63-be36-478d-ab03-845be790fc91 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:19.789321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae7f63-be36-478d-ab03-845be790fc91 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:19.794934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0ac59-133a-4c17-8a9d-b9fe37152258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:19.795603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0ac59-133a-4c17-8a9d-b9fe37152258 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:19.795889 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0ac59-133a-4c17-8a9d-b9fe37152258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:19.796168 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0ac59-133a-4c17-8a9d-b9fe37152258 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:19.796925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0ac59-133a-4c17-8a9d-b9fe37152258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:50:19.797260 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0ac59-133a-4c17-8a9d-b9fe37152258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:19.798960 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0ac59-133a-4c17-8a9d-b9fe37152258 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:19.811215 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1386/2774] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:50:19.815972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35364b-1331-4b6e-bacf-a8302a18e34d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:19.825992 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35364b-1331-4b6e-bacf-a8302a18e34d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:19.830701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fc9a4-8c3f-481e-a6bb-98c233e131cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:19.831354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fc9a4-8c3f-481e-a6bb-98c233e131cc admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:19.831636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fc9a4-8c3f-481e-a6bb-98c233e131cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:19.831910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fc9a4-8c3f-481e-a6bb-98c233e131cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:19.832591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fc9a4-8c3f-481e-a6bb-98c233e131cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:19.834505 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fc9a4-8c3f-481e-a6bb-98c233e131cc admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:20.000842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1389/2775] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:50:19 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:50:20.005323 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0ac59-133a-4c17-8a9d-b9fe37152258 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:20.015513 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0ac59-133a-4c17-8a9d-b9fe37152258 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:20.074144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c26bdb-a9c2-4876-94c5-5621904fbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:20.079777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c26bdb-a9c2-4876-94c5-5621904fbcfe admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:20.079777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c26bdb-a9c2-4876-94c5-5621904fbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:20.079777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c26bdb-a9c2-4876-94c5-5621904fbcfe admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:20.079777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c26bdb-a9c2-4876-94c5-5621904fbcfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:20.079777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c26bdb-a9c2-4876-94c5-5621904fbcfe admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:20.210489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1387/2776] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:50:20 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:50:20.214626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fc9a4-8c3f-481e-a6bb-98c233e131cc admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:20.226288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fc9a4-8c3f-481e-a6bb-98c233e131cc admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:20.230877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d35dd2-b866-4d83-9cb7-6f5d1ea65075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:20.231576 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d35dd2-b866-4d83-9cb7-6f5d1ea65075 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:20.231861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d35dd2-b866-4d83-9cb7-6f5d1ea65075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:20.232146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d35dd2-b866-4d83-9cb7-6f5d1ea65075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:20.232890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d35dd2-b866-4d83-9cb7-6f5d1ea65075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:20.234475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d35dd2-b866-4d83-9cb7-6f5d1ea65075 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:20.245038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1390/2777] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:50:20.251896 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c26bdb-a9c2-4876-94c5-5621904fbcfe admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:20.261796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c26bdb-a9c2-4876-94c5-5621904fbcfe admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:20.267037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bffda3-d4ae-49bd-8319-3d78b2e28b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:20.267713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bffda3-d4ae-49bd-8319-3d78b2e28b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:20.268000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bffda3-d4ae-49bd-8319-3d78b2e28b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:20.268276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bffda3-d4ae-49bd-8319-3d78b2e28b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:20.269032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bffda3-d4ae-49bd-8319-3d78b2e28b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:20.270721 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bffda3-d4ae-49bd-8319-3d78b2e28b2d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:20.281687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1388/2778] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:50:20.285672 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d35dd2-b866-4d83-9cb7-6f5d1ea65075 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:20.296395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d35dd2-b866-4d83-9cb7-6f5d1ea65075 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:20.300981 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665737d-6317-4022-babc-bbb113ef4d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:20.301860 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665737d-6317-4022-babc-bbb113ef4d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:20.302137 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665737d-6317-4022-babc-bbb113ef4d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:20.302410 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665737d-6317-4022-babc-bbb113ef4d5a admin admin] PATH_INFO: `/v3/projects/6348187ea70448abaa7487aa2610e84e/users/4c8d14b82e20451e9df8180ed5daae9c/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:20.316881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665737d-6317-4022-babc-bbb113ef4d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6348187ea70448abaa7487aa2610e84e, user_id=4c8d14b82e20451e9df8180ed5daae9c, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:20.319886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665737d-6317-4022-babc-bbb113ef4d5a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:20.382611 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1391/2779] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:50:20 2022] PUT /identity/v3/projects/6348187ea70448abaa7487aa2610e84e/users/4c8d14b82e20451e9df8180ed5daae9c/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:50:20.393723 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be610846-06a2-4bf1-a220-f815343775fa None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:20.394014 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be610846-06a2-4bf1-a220-f815343775fa None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:20.394296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be610846-06a2-4bf1-a220-f815343775fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:20.421981 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-be610846-06a2-4bf1-a220-f815343775fa None None] MFA Rules not processed for user `4c8d14b82e20451e9df8180ed5daae9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:20.423193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-be610846-06a2-4bf1-a220-f815343775fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:20.487621 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1389/2780] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:50:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:20.498080 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665737d-6317-4022-babc-bbb113ef4d5a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:20.499789 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0665737d-6317-4022-babc-bbb113ef4d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:20.522944 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:20.578892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665737d-6317-4022-babc-bbb113ef4d5a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:20.582546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d87a1c-be8e-43e7-a449-b868b7ab2074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:20.583355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d87a1c-be8e-43e7-a449-b868b7ab2074 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:20.583636 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d87a1c-be8e-43e7-a449-b868b7ab2074 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:20.583913 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d87a1c-be8e-43e7-a449-b868b7ab2074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:20.592455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d87a1c-be8e-43e7-a449-b868b7ab2074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:20.594001 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d87a1c-be8e-43e7-a449-b868b7ab2074 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:20.603304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1392/2781] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:30.484718 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:30.633281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=26 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:34.933431 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be610846-06a2-4bf1-a220-f815343775fa None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:34.994955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be610846-06a2-4bf1-a220-f815343775fa None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:34.999493 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:35.000349 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:35.000639 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:35.000952 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] PATH_INFO: `/v3/users/4c8d14b82e20451e9df8180ed5daae9c` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:35.002132 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8d14b82e20451e9df8180ed5daae9c)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:35.004060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:35.287415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8d14b82e20451e9df8180ed5daae9c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:35.288203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8d14b82e20451e9df8180ed5daae9c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:35.288994 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8d14b82e20451e9df8180ed5daae9c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:35.300546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8d14b82e20451e9df8180ed5daae9c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:35.307382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8d14b82e20451e9df8180ed5daae9c'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:35.399102 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1390/2782] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:50:34 2022] DELETE /identity/v3/users/4c8d14b82e20451e9df8180ed5daae9c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:35.403911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3060b5-a5b2-48cb-9f20-722871517b36 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:35.404372 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3060b5-a5b2-48cb-9f20-722871517b36 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:35.404479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3060b5-a5b2-48cb-9f20-722871517b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:35.421466 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-ff3060b5-a5b2-48cb-9f20-722871517b36 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:35.422663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ff3060b5-a5b2-48cb-9f20-722871517b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:35.479085 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1393/2783] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:35.489217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:35.490597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:35.549643 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5a98d-c2ed-4c76-badf-901216b29811 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:35.553173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5837b6-3ab5-4652-ada1-4067fbcb11c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:35.553819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5837b6-3ab5-4652-ada1-4067fbcb11c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:35.554104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5837b6-3ab5-4652-ada1-4067fbcb11c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:35.554387 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5837b6-3ab5-4652-ada1-4067fbcb11c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:35.563884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5837b6-3ab5-4652-ada1-4067fbcb11c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:35.565381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5837b6-3ab5-4652-ada1-4067fbcb11c6 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:35.574866 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1391/2784] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:36.017886 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3060b5-a5b2-48cb-9f20-722871517b36 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:36.019390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ff3060b5-a5b2-48cb-9f20-722871517b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:36.033989 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3060b5-a5b2-48cb-9f20-722871517b36 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:36.039379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:36.040234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:36.040520 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:36.040830 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] PATH_INFO: `/v3/projects/6348187ea70448abaa7487aa2610e84e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:36.042031 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6348187ea70448abaa7487aa2610e84e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:36.044604 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:36.155250 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6348187ea70448abaa7487aa2610e84e', 'request_id': 'req-587908ec-41ee-4a18-95cb-a387dc059f2f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:36.161529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6348187ea70448abaa7487aa2610e84e', 'request_id': 'req-587908ec-41ee-4a18-95cb-a387dc059f2f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:36.167074 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6348187ea70448abaa7487aa2610e84e', 'request_id': 'req-587908ec-41ee-4a18-95cb-a387dc059f2f'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:36.268157 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] The token cache is being invalidate because project 6348187ea70448abaa7487aa2610e84e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:50:36.268367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:36.269668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:36.275384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1394/2785] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:50:36 2022] DELETE /identity/v3/projects/6348187ea70448abaa7487aa2610e84e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:36.999965 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2664c-1d36-498c-8a5f-638dcabd3b27 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:37.000429 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2664c-1d36-498c-8a5f-638dcabd3b27 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:37.000532 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2664c-1d36-498c-8a5f-638dcabd3b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:37.017007 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1ef2664c-1d36-498c-8a5f-638dcabd3b27 None None] MFA Rules not processed for user `68cb1f2b1bc349b99aab575d48d9eada`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:37.018233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1ef2664c-1d36-498c-8a5f-638dcabd3b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:37.034386 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:37.071894 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1392/2786] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:50:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:46.265126 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:47.267606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=15 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:01.446510 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:01.448014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:01.503326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587908ec-41ee-4a18-95cb-a387dc059f2f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:01.506899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03df45e-e155-4882-a771-79d57a5dd0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:01.507538 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03df45e-e155-4882-a771-79d57a5dd0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:01.507822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03df45e-e155-4882-a771-79d57a5dd0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:01.508102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03df45e-e155-4882-a771-79d57a5dd0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:01.509847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f03df45e-e155-4882-a771-79d57a5dd0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:01.569832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03df45e-e155-4882-a771-79d57a5dd0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:01.571293 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03df45e-e155-4882-a771-79d57a5dd0e2 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:01.581290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1395/2787] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:03.508319 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2664c-1d36-498c-8a5f-638dcabd3b27 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:03.509818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1ef2664c-1d36-498c-8a5f-638dcabd3b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:03.584847 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2664c-1d36-498c-8a5f-638dcabd3b27 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:03.590431 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b23c7-4892-497c-8d93-44a3ec44b818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:03.591101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b23c7-4892-497c-8d93-44a3ec44b818 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:03.591390 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b23c7-4892-497c-8d93-44a3ec44b818 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:03.591670 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b23c7-4892-497c-8d93-44a3ec44b818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:03.593516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f28b23c7-4892-497c-8d93-44a3ec44b818 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:03.607101 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b23c7-4892-497c-8d93-44a3ec44b818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:03.608809 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b23c7-4892-497c-8d93-44a3ec44b818 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:03.621515 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1393/2788] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:11.576395 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=50 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:13.616061 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=34 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:19.053234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03df45e-e155-4882-a771-79d57a5dd0e2 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:19.054697 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f03df45e-e155-4882-a771-79d57a5dd0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:19.070037 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03df45e-e155-4882-a771-79d57a5dd0e2 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:19.075695 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d1483-b4d7-4bc4-ad3f-67c19d811bda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:19.076340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d1483-b4d7-4bc4-ad3f-67c19d811bda service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:19.076621 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d1483-b4d7-4bc4-ad3f-67c19d811bda service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:19.076925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d1483-b4d7-4bc4-ad3f-67c19d811bda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:19.078663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a58d1483-b4d7-4bc4-ad3f-67c19d811bda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:19.136573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d1483-b4d7-4bc4-ad3f-67c19d811bda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:19.138197 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d1483-b4d7-4bc4-ad3f-67c19d811bda service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:19.147614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1396/2789] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:24.144920 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b23c7-4892-497c-8d93-44a3ec44b818 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:24.154660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b23c7-4892-497c-8d93-44a3ec44b818 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:24.158247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afe1b1-f736-4654-98f4-15db1c1474d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:24.158889 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afe1b1-f736-4654-98f4-15db1c1474d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.159176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afe1b1-f736-4654-98f4-15db1c1474d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.159479 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afe1b1-f736-4654-98f4-15db1c1474d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.161331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c6afe1b1-f736-4654-98f4-15db1c1474d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:24.174826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afe1b1-f736-4654-98f4-15db1c1474d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:24.176778 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afe1b1-f736-4654-98f4-15db1c1474d7 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:24.187758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1394/2790] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:25.359950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d1483-b4d7-4bc4-ad3f-67c19d811bda service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.361474 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a58d1483-b4d7-4bc4-ad3f-67c19d811bda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:25.373337 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d1483-b4d7-4bc4-ad3f-67c19d811bda service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.377240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a3ab-1ec6-4baf-ace6-9eef4d258a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.378578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a3ab-1ec6-4baf-ace6-9eef4d258a23 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.378934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a3ab-1ec6-4baf-ace6-9eef4d258a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.379281 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a3ab-1ec6-4baf-ace6-9eef4d258a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.381498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1bb5a3ab-1ec6-4baf-ace6-9eef4d258a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:25.396188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a3ab-1ec6-4baf-ace6-9eef4d258a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.397661 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a3ab-1ec6-4baf-ace6-9eef4d258a23 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.409334 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1397/2791] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:31.106415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39a5f7-03ff-430e-8e8b-66687185ce7f None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.112279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39a5f7-03ff-430e-8e8b-66687185ce7f None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.112279 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39a5f7-03ff-430e-8e8b-66687185ce7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.124969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-de39a5f7-03ff-430e-8e8b-66687185ce7f None None] MFA Rules not processed for user `9761c9cfadac4ca788cd869224b058d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:31.126235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-de39a5f7-03ff-430e-8e8b-66687185ce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:31.133369 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1395/2792] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:51:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:31.817774 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a3ab-1ec6-4baf-ace6-9eef4d258a23 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:31.819262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1bb5a3ab-1ec6-4baf-ace6-9eef4d258a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:31.889599 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a3ab-1ec6-4baf-ace6-9eef4d258a23 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:31.896070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2dcf6-cbe0-4097-b783-0b591f98ef88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:31.896800 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2dcf6-cbe0-4097-b783-0b591f98ef88 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:31.902124 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2dcf6-cbe0-4097-b783-0b591f98ef88 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:31.902124 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2dcf6-cbe0-4097-b783-0b591f98ef88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:31.902124 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-eba2dcf6-cbe0-4097-b783-0b591f98ef88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:31.911744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2dcf6-cbe0-4097-b783-0b591f98ef88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:31.913374 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2dcf6-cbe0-4097-b783-0b591f98ef88 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:31.923282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1398/2793] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:51:34.553586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39a5f7-03ff-430e-8e8b-66687185ce7f None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:34.563489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39a5f7-03ff-430e-8e8b-66687185ce7f None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:34.567405 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365cd9e-c694-418f-9c88-9d33a64e68ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:34.568050 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365cd9e-c694-418f-9c88-9d33a64e68ab service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:34.568367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365cd9e-c694-418f-9c88-9d33a64e68ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:34.568691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365cd9e-c694-418f-9c88-9d33a64e68ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:34.570552 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e365cd9e-c694-418f-9c88-9d33a64e68ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:34.580591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365cd9e-c694-418f-9c88-9d33a64e68ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:34.582060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365cd9e-c694-418f-9c88-9d33a64e68ab service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:34.590790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1396/2794] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:35.410012 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2dcf6-cbe0-4097-b783-0b591f98ef88 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:35.425628 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2dcf6-cbe0-4097-b783-0b591f98ef88 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:35.434238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cf8a3-e78c-496c-87e4-a7ef6fc08f41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:35.434238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cf8a3-e78c-496c-87e4-a7ef6fc08f41 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:35.434238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cf8a3-e78c-496c-87e4-a7ef6fc08f41 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:35.434238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cf8a3-e78c-496c-87e4-a7ef6fc08f41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:35.435607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0b3cf8a3-e78c-496c-87e4-a7ef6fc08f41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:35.449852 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cf8a3-e78c-496c-87e4-a7ef6fc08f41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:35.451447 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cf8a3-e78c-496c-87e4-a7ef6fc08f41 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:35.463514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1399/2795] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:42.516504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365cd9e-c694-418f-9c88-9d33a64e68ab service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:42.530173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365cd9e-c694-418f-9c88-9d33a64e68ab service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:42.535857 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d70d3a-6afd-4697-8f97-e9b75450b89d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:42.536524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d70d3a-6afd-4697-8f97-e9b75450b89d service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:42.536848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d70d3a-6afd-4697-8f97-e9b75450b89d service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:42.537772 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d70d3a-6afd-4697-8f97-e9b75450b89d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:42.539589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-92d70d3a-6afd-4697-8f97-e9b75450b89d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:42.551640 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d70d3a-6afd-4697-8f97-e9b75450b89d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:42.553305 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d70d3a-6afd-4697-8f97-e9b75450b89d service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:42.564823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1397/2796] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:45.457975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=72 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:52.560048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=21 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:33.429301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cf8a3-e78c-496c-87e4-a7ef6fc08f41 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:33.442719 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cf8a3-e78c-496c-87e4-a7ef6fc08f41 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:33.447861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fd2d9-6c99-4c50-b243-46128212c01b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:33.448495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fd2d9-6c99-4c50-b243-46128212c01b service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:33.448817 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fd2d9-6c99-4c50-b243-46128212c01b service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:33.449096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fd2d9-6c99-4c50-b243-46128212c01b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:33.450798 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e35fd2d9-6c99-4c50-b243-46128212c01b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:33.462602 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fd2d9-6c99-4c50-b243-46128212c01b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:33.464154 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fd2d9-6c99-4c50-b243-46128212c01b service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:33.474134 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1400/2797] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:43.469659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:23.763472 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3b0de-ec4f-4ef4-97bf-ea345562d3f2 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:23.763972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3b0de-ec4f-4ef4-97bf-ea345562d3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:23.764838 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3b0de-ec4f-4ef4-97bf-ea345562d3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:23.789827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-74d3b0de-ec4f-4ef4-97bf-ea345562d3f2 None None] MFA Rules not processed for user `68cb1f2b1bc349b99aab575d48d9eada`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:23.791759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-74d3b0de-ec4f-4ef4-97bf-ea345562d3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:23.798973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1398/2798] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:53:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:26.065911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f33f43-58f6-47e7-8b4a-5d472fa359f3 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:26.066461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f33f43-58f6-47e7-8b4a-5d472fa359f3 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:26.066461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f33f43-58f6-47e7-8b4a-5d472fa359f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:26.086059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-02f33f43-58f6-47e7-8b4a-5d472fa359f3 None None] MFA Rules not processed for user `9761c9cfadac4ca788cd869224b058d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:26.087271 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-02f33f43-58f6-47e7-8b4a-5d472fa359f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:26.094950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1401/2799] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:53:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:26.639815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3b0de-ec4f-4ef4-97bf-ea345562d3f2 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:26.649601 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3b0de-ec4f-4ef4-97bf-ea345562d3f2 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:26.654042 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181eac-082c-422f-b3ea-bac86c86ae17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:26.654687 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181eac-082c-422f-b3ea-bac86c86ae17 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:26.654974 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181eac-082c-422f-b3ea-bac86c86ae17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:26.655252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181eac-082c-422f-b3ea-bac86c86ae17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:26.657057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-09181eac-082c-422f-b3ea-bac86c86ae17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:26.667068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181eac-082c-422f-b3ea-bac86c86ae17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:26.668432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181eac-082c-422f-b3ea-bac86c86ae17 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:26.676602 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1399/2800] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:53:36.079355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:36.672976 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=9 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:21.491392 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f33f43-58f6-47e7-8b4a-5d472fa359f3 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:21.501056 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f33f43-58f6-47e7-8b4a-5d472fa359f3 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:21.504571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26130b25-00a8-4b5c-ad51-23e97b0be7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:21.505234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26130b25-00a8-4b5c-ad51-23e97b0be7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:21.505521 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26130b25-00a8-4b5c-ad51-23e97b0be7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:21.505801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26130b25-00a8-4b5c-ad51-23e97b0be7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:21.507558 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-26130b25-00a8-4b5c-ad51-23e97b0be7a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:21.570362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26130b25-00a8-4b5c-ad51-23e97b0be7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:21.571826 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26130b25-00a8-4b5c-ad51-23e97b0be7a7 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:21.581464 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1402/2801] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:55:25.104576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181eac-082c-422f-b3ea-bac86c86ae17 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:25.117371 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181eac-082c-422f-b3ea-bac86c86ae17 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:25.122719 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e51258-9e80-4f76-823e-36fe9ae2e7f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:25.123574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e51258-9e80-4f76-823e-36fe9ae2e7f2 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:25.123934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e51258-9e80-4f76-823e-36fe9ae2e7f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:25.124284 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e51258-9e80-4f76-823e-36fe9ae2e7f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:25.126179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-02e51258-9e80-4f76-823e-36fe9ae2e7f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:25.138604 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e51258-9e80-4f76-823e-36fe9ae2e7f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:25.140212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e51258-9e80-4f76-823e-36fe9ae2e7f2 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:25.150788 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1400/2802] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:55:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:55:25.279571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26130b25-00a8-4b5c-ad51-23e97b0be7a7 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:25.281233 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-26130b25-00a8-4b5c-ad51-23e97b0be7a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:25.294960 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26130b25-00a8-4b5c-ad51-23e97b0be7a7 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:25.299559 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703ec34-5096-49ca-9725-0bcf54dfeb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:25.300498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703ec34-5096-49ca-9725-0bcf54dfeb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:25.300816 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703ec34-5096-49ca-9725-0bcf54dfeb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:25.301090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703ec34-5096-49ca-9725-0bcf54dfeb2d admin admin] PATH_INFO: `/v3/users/9761c9cfadac4ca788cd869224b058d9` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:25.307332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703ec34-5096-49ca-9725-0bcf54dfeb2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9761c9cfadac4ca788cd869224b058d9)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:25.307332 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703ec34-5096-49ca-9725-0bcf54dfeb2d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:25.532753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2703ec34-5096-49ca-9725-0bcf54dfeb2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9761c9cfadac4ca788cd869224b058d9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:25.533340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2703ec34-5096-49ca-9725-0bcf54dfeb2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9761c9cfadac4ca788cd869224b058d9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:25.693798 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2703ec34-5096-49ca-9725-0bcf54dfeb2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9761c9cfadac4ca788cd869224b058d9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:25.707500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2703ec34-5096-49ca-9725-0bcf54dfeb2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9761c9cfadac4ca788cd869224b058d9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:25.714519 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2703ec34-5096-49ca-9725-0bcf54dfeb2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9761c9cfadac4ca788cd869224b058d9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:25.720747 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1403/2803] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:55:25 2022] DELETE /identity/v3/users/9761c9cfadac4ca788cd869224b058d9 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:26.003973 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e51258-9e80-4f76-823e-36fe9ae2e7f2 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:26.012207 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e51258-9e80-4f76-823e-36fe9ae2e7f2 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:26.071205 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c9185-8f90-49ad-a4fa-9d6f7794f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:26.072031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c9185-8f90-49ad-a4fa-9d6f7794f327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:26.072320 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c9185-8f90-49ad-a4fa-9d6f7794f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:26.072599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c9185-8f90-49ad-a4fa-9d6f7794f327 admin admin] PATH_INFO: `/v3/projects/82ed5f25a098427ba0812fcc79a2f8ba` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:26.073817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c9185-8f90-49ad-a4fa-9d6f7794f327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ed5f25a098427ba0812fcc79a2f8ba)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:26.075733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c9185-8f90-49ad-a4fa-9d6f7794f327 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:26.216321 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b08c9185-8f90-49ad-a4fa-9d6f7794f327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ed5f25a098427ba0812fcc79a2f8ba', 'request_id': 'req-b08c9185-8f90-49ad-a4fa-9d6f7794f327'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:26.312827 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b08c9185-8f90-49ad-a4fa-9d6f7794f327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ed5f25a098427ba0812fcc79a2f8ba', 'request_id': 'req-b08c9185-8f90-49ad-a4fa-9d6f7794f327'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:26.319631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b08c9185-8f90-49ad-a4fa-9d6f7794f327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ed5f25a098427ba0812fcc79a2f8ba', 'request_id': 'req-b08c9185-8f90-49ad-a4fa-9d6f7794f327'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:26.330434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b08c9185-8f90-49ad-a4fa-9d6f7794f327 admin admin] The token cache is being invalidate because project 82ed5f25a098427ba0812fcc79a2f8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:55:26.330667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b08c9185-8f90-49ad-a4fa-9d6f7794f327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:26.331341 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-b08c9185-8f90-49ad-a4fa-9d6f7794f327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:26.332915 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1401/2804] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:55:25 2022] DELETE /identity/v3/projects/82ed5f25a098427ba0812fcc79a2f8ba => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:26.338327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf61ef-b1ab-41e3-9834-c39422335482 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:26.338794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf61ef-b1ab-41e3-9834-c39422335482 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:26.338892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf61ef-b1ab-41e3-9834-c39422335482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:26.357478 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-07cf61ef-b1ab-41e3-9834-c39422335482 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:26.358660 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-07cf61ef-b1ab-41e3-9834-c39422335482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:26.416030 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1404/2805] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:26.423835 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077f50d-0767-4ed9-ada6-83b768515c18 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:26.424130 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077f50d-0767-4ed9-ada6-83b768515c18 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:26.424415 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077f50d-0767-4ed9-ada6-83b768515c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:26.442969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3077f50d-0767-4ed9-ada6-83b768515c18 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:26.444185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3077f50d-0767-4ed9-ada6-83b768515c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:26.452717 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1402/2806] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:26.456617 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf61ef-b1ab-41e3-9834-c39422335482 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:26.467257 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf61ef-b1ab-41e3-9834-c39422335482 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:26.471955 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6ad0-d73a-4fe9-b41b-c1ea28349b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:26.472599 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6ad0-d73a-4fe9-b41b-c1ea28349b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:26.473045 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6ad0-d73a-4fe9-b41b-c1ea28349b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:26.473190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6ad0-d73a-4fe9-b41b-c1ea28349b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:26.473913 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6ad0-d73a-4fe9-b41b-c1ea28349b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:55:26.474221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6ad0-d73a-4fe9-b41b-c1ea28349b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:26.475838 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6ad0-d73a-4fe9-b41b-c1ea28349b8a admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:26.477911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:26.489004 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1405/2807] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:55:26.494360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077f50d-0767-4ed9-ada6-83b768515c18 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:26.503948 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077f50d-0767-4ed9-ada6-83b768515c18 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:26.508767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ecfc-f5ef-42d3-a08e-e2c0912d0200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:26.509418 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ecfc-f5ef-42d3-a08e-e2c0912d0200 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:26.509700 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ecfc-f5ef-42d3-a08e-e2c0912d0200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:26.509972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ecfc-f5ef-42d3-a08e-e2c0912d0200 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:26.510649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126ecfc-f5ef-42d3-a08e-e2c0912d0200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:26.512537 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126ecfc-f5ef-42d3-a08e-e2c0912d0200 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:26.606190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1403/2808] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:55:26 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:55:26.610160 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6ad0-d73a-4fe9-b41b-c1ea28349b8a admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:26.620376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6ad0-d73a-4fe9-b41b-c1ea28349b8a admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:26.675775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6de54c-10ef-4354-9394-3fe78f489d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:26.676442 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6de54c-10ef-4354-9394-3fe78f489d89 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:26.676757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6de54c-10ef-4354-9394-3fe78f489d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:26.677041 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6de54c-10ef-4354-9394-3fe78f489d89 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:26.677731 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6de54c-10ef-4354-9394-3fe78f489d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:26.679931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6de54c-10ef-4354-9394-3fe78f489d89 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:26.769668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1406/2809] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:55:26 2022] POST /identity/v3/users => generated 302 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:55:26.778924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ecfc-f5ef-42d3-a08e-e2c0912d0200 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:26.785024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ecfc-f5ef-42d3-a08e-e2c0912d0200 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:26.789942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783751f-c0a8-4bf6-88e5-f3d716e765d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:26.790600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783751f-c0a8-4bf6-88e5-f3d716e765d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:26.790884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783751f-c0a8-4bf6-88e5-f3d716e765d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:26.791159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783751f-c0a8-4bf6-88e5-f3d716e765d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:26.791878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783751f-c0a8-4bf6-88e5-f3d716e765d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:26.793511 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783751f-c0a8-4bf6-88e5-f3d716e765d4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:26.804099 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1404/2810] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:55:26.808008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6de54c-10ef-4354-9394-3fe78f489d89 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:26.818343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6de54c-10ef-4354-9394-3fe78f489d89 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:26.823614 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3508a22-2b05-4288-8dd7-25939bb0f37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:26.826698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3508a22-2b05-4288-8dd7-25939bb0f37b admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:26.826698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3508a22-2b05-4288-8dd7-25939bb0f37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:26.826698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3508a22-2b05-4288-8dd7-25939bb0f37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:26.826698 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3508a22-2b05-4288-8dd7-25939bb0f37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:26.827250 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3508a22-2b05-4288-8dd7-25939bb0f37b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:26.838110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1407/2811] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:55:26.842053 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783751f-c0a8-4bf6-88e5-f3d716e765d4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:26.854027 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783751f-c0a8-4bf6-88e5-f3d716e765d4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:26.858999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ece94-8d82-4188-8900-465cabc2b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:26.859821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ece94-8d82-4188-8900-465cabc2b65c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:26.860239 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ece94-8d82-4188-8900-465cabc2b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:26.860446 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ece94-8d82-4188-8900-465cabc2b65c admin admin] PATH_INFO: `/v3/projects/f799b75d54524b45931620fcfef742c1/users/5cc948de69724847a0d9065b6570d5ee/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:26.874914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ece94-8d82-4188-8900-465cabc2b65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f799b75d54524b45931620fcfef742c1, user_id=5cc948de69724847a0d9065b6570d5ee, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:26.877586 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ece94-8d82-4188-8900-465cabc2b65c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:26.999448 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1405/2812] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:55:26 2022] PUT /identity/v3/projects/f799b75d54524b45931620fcfef742c1/users/5cc948de69724847a0d9065b6570d5ee/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:27.004567 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99692e84-4611-475b-9fa9-8c7e54bc2067 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:27.004890 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99692e84-4611-475b-9fa9-8c7e54bc2067 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:27.005171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99692e84-4611-475b-9fa9-8c7e54bc2067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:27.022889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-99692e84-4611-475b-9fa9-8c7e54bc2067 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:27.024757 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-99692e84-4611-475b-9fa9-8c7e54bc2067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:27.083090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1408/2813] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:27.093523 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ece94-8d82-4188-8900-465cabc2b65c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:27.095276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e46ece94-8d82-4188-8900-465cabc2b65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:27.109667 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:27.152880 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ece94-8d82-4188-8900-465cabc2b65c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:27.156518 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f6c30-7367-4d87-80cb-99b3b9cacc96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:27.157212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f6c30-7367-4d87-80cb-99b3b9cacc96 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:27.157512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f6c30-7367-4d87-80cb-99b3b9cacc96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:27.158002 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f6c30-7367-4d87-80cb-99b3b9cacc96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:27.167636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f6c30-7367-4d87-80cb-99b3b9cacc96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:27.169109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f6c30-7367-4d87-80cb-99b3b9cacc96 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:27.178572 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1406/2814] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:55:28.485355 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d91c90-a7be-47bc-824b-d1f910c37a4d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:28.489541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d91c90-a7be-47bc-824b-d1f910c37a4d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:28.489541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d91c90-a7be-47bc-824b-d1f910c37a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:28.513569 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-d5d91c90-a7be-47bc-824b-d1f910c37a4d None None] MFA Rules not processed for user `5cc948de69724847a0d9065b6570d5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:28.514786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d5d91c90-a7be-47bc-824b-d1f910c37a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:28.579668 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1409/2815] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:28.584248 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f6c30-7367-4d87-80cb-99b3b9cacc96 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:28.595038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f6c30-7367-4d87-80cb-99b3b9cacc96 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:28.599645 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c7604-b258-42ea-afa8-c98331fffbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:28.600295 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c7604-b258-42ea-afa8-c98331fffbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:28.600582 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c7604-b258-42ea-afa8-c98331fffbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:28.600897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c7604-b258-42ea-afa8-c98331fffbd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:28.601584 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c7604-b258-42ea-afa8-c98331fffbd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:28.603670 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c7604-b258-42ea-afa8-c98331fffbd2 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:28.708470 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1407/2816] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:55:28 2022] POST /identity/v3/projects => generated 405 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:55:28.712899 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d91c90-a7be-47bc-824b-d1f910c37a4d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:28.718366 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:28.724242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d91c90-a7be-47bc-824b-d1f910c37a4d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:28.779175 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a2a37-bc15-4992-a3c7-d90a8cc26ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:28.779832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2a37-bc15-4992-a3c7-d90a8cc26ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:28.780113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2a37-bc15-4992-a3c7-d90a8cc26ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:28.780388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2a37-bc15-4992-a3c7-d90a8cc26ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:28.781201 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a2a37-bc15-4992-a3c7-d90a8cc26ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:28.785303 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a2a37-bc15-4992-a3c7-d90a8cc26ef4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:28.885330 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1410/2817] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:55:28 2022] POST /identity/v3/users => generated 309 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:55:28.889490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c7604-b258-42ea-afa8-c98331fffbd2 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:28.899878 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c7604-b258-42ea-afa8-c98331fffbd2 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:28.904397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52febb64-df09-4544-b065-2ec9e60aab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:28.905093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52febb64-df09-4544-b065-2ec9e60aab19 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:28.905382 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52febb64-df09-4544-b065-2ec9e60aab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:28.905658 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52febb64-df09-4544-b065-2ec9e60aab19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:28.906374 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52febb64-df09-4544-b065-2ec9e60aab19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:28.907968 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52febb64-df09-4544-b065-2ec9e60aab19 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:28.918547 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1408/2818] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:55:28.922573 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a2a37-bc15-4992-a3c7-d90a8cc26ef4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:28.933003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a2a37-bc15-4992-a3c7-d90a8cc26ef4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:28.937758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfa3f2-a7f3-4b45-afec-a69bb103ab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:28.938656 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfa3f2-a7f3-4b45-afec-a69bb103ab18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:28.938939 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfa3f2-a7f3-4b45-afec-a69bb103ab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:28.939216 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfa3f2-a7f3-4b45-afec-a69bb103ab18 admin admin] PATH_INFO: `/v3/projects/a301309aa8e74b7cb1144aecbe805a1a/users/fa0924db8bb846ce96e582caf892d48d/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:28.954023 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfa3f2-a7f3-4b45-afec-a69bb103ab18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a301309aa8e74b7cb1144aecbe805a1a, user_id=fa0924db8bb846ce96e582caf892d48d, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:28.956705 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfa3f2-a7f3-4b45-afec-a69bb103ab18 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:29.044680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1411/2819] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:55:28 2022] PUT /identity/v3/projects/a301309aa8e74b7cb1144aecbe805a1a/users/fa0924db8bb846ce96e582caf892d48d/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:55:29.048625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52febb64-df09-4544-b065-2ec9e60aab19 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:29.059367 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52febb64-df09-4544-b065-2ec9e60aab19 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:29.115521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b71693-5c23-4d32-8154-0a6350d4b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:29.116180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b71693-5c23-4d32-8154-0a6350d4b63d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:29.116463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b71693-5c23-4d32-8154-0a6350d4b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:29.116767 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b71693-5c23-4d32-8154-0a6350d4b63d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:29.117480 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b71693-5c23-4d32-8154-0a6350d4b63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:29.119692 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b71693-5c23-4d32-8154-0a6350d4b63d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:29.129136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1409/2820] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:55:29.133238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfa3f2-a7f3-4b45-afec-a69bb103ab18 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:29.144287 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfa3f2-a7f3-4b45-afec-a69bb103ab18 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:29.151920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3231a69-ac6a-45a4-a482-52cde0a8a878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:29.151920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3231a69-ac6a-45a4-a482-52cde0a8a878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:29.151920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3231a69-ac6a-45a4-a482-52cde0a8a878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:29.151920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3231a69-ac6a-45a4-a482-52cde0a8a878 admin admin] PATH_INFO: `/v3/projects/a301309aa8e74b7cb1144aecbe805a1a/users/fa0924db8bb846ce96e582caf892d48d/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:29.152304 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3231a69-ac6a-45a4-a482-52cde0a8a878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a301309aa8e74b7cb1144aecbe805a1a, user_id=fa0924db8bb846ce96e582caf892d48d, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:29.154925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3231a69-ac6a-45a4-a482-52cde0a8a878 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:29.165828 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1412/2821] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:55:29 2022] PUT /identity/v3/projects/a301309aa8e74b7cb1144aecbe805a1a/users/fa0924db8bb846ce96e582caf892d48d/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:30.366129 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaae58-a87c-4082-9cf1-9634f1907bcb None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:30.366639 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaae58-a87c-4082-9cf1-9634f1907bcb None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:30.366741 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaae58-a87c-4082-9cf1-9634f1907bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:30.394063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-9cfaae58-a87c-4082-9cf1-9634f1907bcb None None] MFA Rules not processed for user `fa0924db8bb846ce96e582caf892d48d`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:30.395353 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9cfaae58-a87c-4082-9cf1-9634f1907bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:30.469817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1410/2822] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:30 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:31.618054 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3231a69-ac6a-45a4-a482-52cde0a8a878 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:31.626331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-e3231a69-ac6a-45a4-a482-52cde0a8a878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:31.689637 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3231a69-ac6a-45a4-a482-52cde0a8a878 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:31.694659 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1ff2c-7d10-4551-a68c-6d2834a1b60c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:31.695303 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1ff2c-7d10-4551-a68c-6d2834a1b60c service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:31.695585 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1ff2c-7d10-4551-a68c-6d2834a1b60c service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:31.695861 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1ff2c-7d10-4551-a68c-6d2834a1b60c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:31.697651 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-76a1ff2c-7d10-4551-a68c-6d2834a1b60c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:31.708778 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1ff2c-7d10-4551-a68c-6d2834a1b60c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:31.710386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1ff2c-7d10-4551-a68c-6d2834a1b60c service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:31.720545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1413/2823] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:55:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:55:31.831935 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaae58-a87c-4082-9cf1-9634f1907bcb None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:31.838370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:31.896063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaae58-a87c-4082-9cf1-9634f1907bcb None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:31.901244 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:31.902109 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:31.902397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:31.902678 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] PATH_INFO: `/v3/users/5cc948de69724847a0d9065b6570d5ee` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:31.903868 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc948de69724847a0d9065b6570d5ee)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:31.905859 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:32.097257 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc948de69724847a0d9065b6570d5ee'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:32.097925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc948de69724847a0d9065b6570d5ee'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:32.098530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc948de69724847a0d9065b6570d5ee'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:32.110898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc948de69724847a0d9065b6570d5ee'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:32.117989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc948de69724847a0d9065b6570d5ee'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:32.209943 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1411/2824] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:55:31 2022] DELETE /identity/v3/users/5cc948de69724847a0d9065b6570d5ee => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:32.488723 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1ff2c-7d10-4551-a68c-6d2834a1b60c service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:32.501354 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1ff2c-7d10-4551-a68c-6d2834a1b60c service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:32.543309 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:32.557976 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:32.558834 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:32.559110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:32.559386 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] PATH_INFO: `/v3/projects/f799b75d54524b45931620fcfef742c1` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:32.560547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f799b75d54524b45931620fcfef742c1)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:32.562457 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:32.684538 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f799b75d54524b45931620fcfef742c1', 'request_id': 'req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:32.690602 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f799b75d54524b45931620fcfef742c1', 'request_id': 'req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:32.696109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f799b75d54524b45931620fcfef742c1', 'request_id': 'req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:32.801500 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] The token cache is being invalidate because project f799b75d54524b45931620fcfef742c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:55:32.801724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:32.802338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:32.803872 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1414/2825] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:55:32 2022] DELETE /identity/v3/projects/f799b75d54524b45931620fcfef742c1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:32.808521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:32.809913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:32.822609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc7989-5639-4435-812a-9a22b1fb4d40 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:32.877467 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e2675-6f83-4871-957c-b3be721e19bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:32.878328 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e2675-6f83-4871-957c-b3be721e19bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:32.878612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e2675-6f83-4871-957c-b3be721e19bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:32.878892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e2675-6f83-4871-957c-b3be721e19bd admin admin] PATH_INFO: `/v3/users/fa0924db8bb846ce96e582caf892d48d` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:32.880060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e2675-6f83-4871-957c-b3be721e19bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0924db8bb846ce96e582caf892d48d)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:32.881987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e2675-6f83-4871-957c-b3be721e19bd admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:33.003020 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:33.140939 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-810e2675-6f83-4871-957c-b3be721e19bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0924db8bb846ce96e582caf892d48d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:33.141591 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-810e2675-6f83-4871-957c-b3be721e19bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0924db8bb846ce96e582caf892d48d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:33.142218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-810e2675-6f83-4871-957c-b3be721e19bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0924db8bb846ce96e582caf892d48d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:33.154337 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-810e2675-6f83-4871-957c-b3be721e19bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0924db8bb846ce96e582caf892d48d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:33.161030 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-810e2675-6f83-4871-957c-b3be721e19bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0924db8bb846ce96e582caf892d48d'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:33.243925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1412/2826] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:55:32 2022] DELETE /identity/v3/users/fa0924db8bb846ce96e582caf892d48d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:33.469535 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:33.470974 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:33.485346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2892d-64b0-4212-bbd4-6da5b2cbe1bd admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:33.542343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e9820-8d9a-459f-96f1-780d24ae9566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:33.547298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e9820-8d9a-459f-96f1-780d24ae9566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:33.547298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e9820-8d9a-459f-96f1-780d24ae9566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:33.547298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e9820-8d9a-459f-96f1-780d24ae9566 admin admin] PATH_INFO: `/v3/projects/a301309aa8e74b7cb1144aecbe805a1a` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:33.547298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e9820-8d9a-459f-96f1-780d24ae9566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a301309aa8e74b7cb1144aecbe805a1a)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:33.547298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e9820-8d9a-459f-96f1-780d24ae9566 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:33.696839 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c83e9820-8d9a-459f-96f1-780d24ae9566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a301309aa8e74b7cb1144aecbe805a1a', 'request_id': 'req-c83e9820-8d9a-459f-96f1-780d24ae9566'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:33.702924 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c83e9820-8d9a-459f-96f1-780d24ae9566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a301309aa8e74b7cb1144aecbe805a1a', 'request_id': 'req-c83e9820-8d9a-459f-96f1-780d24ae9566'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:33.708643 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c83e9820-8d9a-459f-96f1-780d24ae9566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a301309aa8e74b7cb1144aecbe805a1a', 'request_id': 'req-c83e9820-8d9a-459f-96f1-780d24ae9566'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:33.814976 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c83e9820-8d9a-459f-96f1-780d24ae9566 admin admin] The token cache is being invalidate because project a301309aa8e74b7cb1144aecbe805a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:55:33.815263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c83e9820-8d9a-459f-96f1-780d24ae9566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:33.815913 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-c83e9820-8d9a-459f-96f1-780d24ae9566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:33.817512 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1415/2827] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:55:33 2022] DELETE /identity/v3/projects/a301309aa8e74b7cb1144aecbe805a1a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:55:33.822699 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68098c8-93e6-4f7d-9c55-6bf5f94528d1 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:33.822999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68098c8-93e6-4f7d-9c55-6bf5f94528d1 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:33.823269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68098c8-93e6-4f7d-9c55-6bf5f94528d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:33.841848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-e68098c8-93e6-4f7d-9c55-6bf5f94528d1 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:33.843076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e68098c8-93e6-4f7d-9c55-6bf5f94528d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:33.900271 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1413/2828] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:33.907933 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805eb5d-dee3-4f20-9f74-de7269d08b36 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:33.908221 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805eb5d-dee3-4f20-9f74-de7269d08b36 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:33.908498 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805eb5d-dee3-4f20-9f74-de7269d08b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:33.916506 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:33.927016 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2805eb5d-dee3-4f20-9f74-de7269d08b36 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:33.940775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2805eb5d-dee3-4f20-9f74-de7269d08b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:33.940775 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1416/2829] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:33.943432 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68098c8-93e6-4f7d-9c55-6bf5f94528d1 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:33.953173 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68098c8-93e6-4f7d-9c55-6bf5f94528d1 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:33.958051 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4967871-b045-4503-9ac5-b18a1e4c782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:33.958705 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4967871-b045-4503-9ac5-b18a1e4c782e admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:33.958991 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4967871-b045-4503-9ac5-b18a1e4c782e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:33.959272 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4967871-b045-4503-9ac5-b18a1e4c782e admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:33.960024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4967871-b045-4503-9ac5-b18a1e4c782e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:55:33.960332 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4967871-b045-4503-9ac5-b18a1e4c782e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:33.961989 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4967871-b045-4503-9ac5-b18a1e4c782e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:33.974126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1414/2830] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:55:33.979211 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805eb5d-dee3-4f20-9f74-de7269d08b36 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:33.988431 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805eb5d-dee3-4f20-9f74-de7269d08b36 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:33.993841 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416be630-d37c-4474-83e9-82e96498ec1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:33.994488 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416be630-d37c-4474-83e9-82e96498ec1f admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:33.994772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416be630-d37c-4474-83e9-82e96498ec1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:33.995050 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416be630-d37c-4474-83e9-82e96498ec1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:33.995728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416be630-d37c-4474-83e9-82e96498ec1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:33.997655 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416be630-d37c-4474-83e9-82e96498ec1f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:34.104003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1417/2831] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:55:33 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:55:34.107919 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4967871-b045-4503-9ac5-b18a1e4c782e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:34.117990 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4967871-b045-4503-9ac5-b18a1e4c782e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:34.172758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5e10a-c90d-4e9d-a2b3-eec4465647f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:34.173421 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5e10a-c90d-4e9d-a2b3-eec4465647f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:34.173710 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5e10a-c90d-4e9d-a2b3-eec4465647f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:34.173993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5e10a-c90d-4e9d-a2b3-eec4465647f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:34.174669 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5e10a-c90d-4e9d-a2b3-eec4465647f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:34.176583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5e10a-c90d-4e9d-a2b3-eec4465647f4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:34.290218 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1415/2832] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:55:34 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:55:34.294239 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416be630-d37c-4474-83e9-82e96498ec1f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:34.304327 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416be630-d37c-4474-83e9-82e96498ec1f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:34.308847 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a1a8f-e15f-468d-8e3f-36eabcc1de64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:34.309497 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a1a8f-e15f-468d-8e3f-36eabcc1de64 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:34.309780 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a1a8f-e15f-468d-8e3f-36eabcc1de64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:34.310058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a1a8f-e15f-468d-8e3f-36eabcc1de64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:34.310777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a1a8f-e15f-468d-8e3f-36eabcc1de64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:34.312346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a1a8f-e15f-468d-8e3f-36eabcc1de64 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:34.322734 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1418/2833] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:55:34.326478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5e10a-c90d-4e9d-a2b3-eec4465647f4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:34.336274 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5e10a-c90d-4e9d-a2b3-eec4465647f4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:34.341563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb4c0d-7b1a-4f30-b226-e91a5c601a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:34.342212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb4c0d-7b1a-4f30-b226-e91a5c601a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:34.342501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb4c0d-7b1a-4f30-b226-e91a5c601a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:34.342782 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb4c0d-7b1a-4f30-b226-e91a5c601a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:34.343554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb4c0d-7b1a-4f30-b226-e91a5c601a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:34.345166 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb4c0d-7b1a-4f30-b226-e91a5c601a9c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:34.356822 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1416/2834] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:55:34.360640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a1a8f-e15f-468d-8e3f-36eabcc1de64 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:34.370467 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a1a8f-e15f-468d-8e3f-36eabcc1de64 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:34.375020 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84406fe-241b-44ec-8477-a5c598577849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:34.375870 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84406fe-241b-44ec-8477-a5c598577849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:34.376147 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84406fe-241b-44ec-8477-a5c598577849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:34.376418 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84406fe-241b-44ec-8477-a5c598577849 admin admin] PATH_INFO: `/v3/projects/31c108336fbb4b678132925271638444/users/95714f118aba4c21b50c1ea374fab4b6/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:34.390957 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84406fe-241b-44ec-8477-a5c598577849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c108336fbb4b678132925271638444, user_id=95714f118aba4c21b50c1ea374fab4b6, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:34.393608 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84406fe-241b-44ec-8477-a5c598577849 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:34.462207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1419/2835] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:55:34 2022] PUT /identity/v3/projects/31c108336fbb4b678132925271638444/users/95714f118aba4c21b50c1ea374fab4b6/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:34.521039 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09bd02-32e0-4711-91e1-976368b40ba8 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:34.521333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09bd02-32e0-4711-91e1-976368b40ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:34.521639 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09bd02-32e0-4711-91e1-976368b40ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:34.539914 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:34.550089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-8b09bd02-32e0-4711-91e1-976368b40ba8 None None] MFA Rules not processed for user `95714f118aba4c21b50c1ea374fab4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:34.551331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-8b09bd02-32e0-4711-91e1-976368b40ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:34.613145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1417/2836] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:34.617548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84406fe-241b-44ec-8477-a5c598577849 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:34.679093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84406fe-241b-44ec-8477-a5c598577849 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:34.684475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddfd4f-d6ba-48c1-995a-29b84e0e22a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:34.685176 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddfd4f-d6ba-48c1-995a-29b84e0e22a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:34.688449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddfd4f-d6ba-48c1-995a-29b84e0e22a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:34.688449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddfd4f-d6ba-48c1-995a-29b84e0e22a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:34.688449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddfd4f-d6ba-48c1-995a-29b84e0e22a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:34.688449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddfd4f-d6ba-48c1-995a-29b84e0e22a4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:34.771168 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1420/2837] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:55:34 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:55:34.775158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09bd02-32e0-4711-91e1-976368b40ba8 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:34.785812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09bd02-32e0-4711-91e1-976368b40ba8 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:34.841156 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77a9e3-3a43-420a-8bd2-774572a959e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:34.841743 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a9e3-3a43-420a-8bd2-774572a959e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:34.842024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a9e3-3a43-420a-8bd2-774572a959e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:34.842297 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a9e3-3a43-420a-8bd2-774572a959e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:34.842980 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77a9e3-3a43-420a-8bd2-774572a959e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:34.844969 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77a9e3-3a43-420a-8bd2-774572a959e1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:34.936748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1418/2838] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:55:34 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:55:34.940465 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddfd4f-d6ba-48c1-995a-29b84e0e22a4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:34.951367 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddfd4f-d6ba-48c1-995a-29b84e0e22a4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:34.955941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a1092-5898-4050-9270-6174884a8263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:34.956595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a1092-5898-4050-9270-6174884a8263 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:34.956910 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a1092-5898-4050-9270-6174884a8263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:34.957187 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a1092-5898-4050-9270-6174884a8263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:34.957918 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a1092-5898-4050-9270-6174884a8263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:34.959490 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a1092-5898-4050-9270-6174884a8263 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:34.969814 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1421/2839] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:55:34.974009 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77a9e3-3a43-420a-8bd2-774572a959e1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:34.985122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77a9e3-3a43-420a-8bd2-774572a959e1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:34.989849 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce713b39-9202-4298-925b-947415459996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:34.990776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce713b39-9202-4298-925b-947415459996 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:34.991063 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce713b39-9202-4298-925b-947415459996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:34.991346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce713b39-9202-4298-925b-947415459996 admin admin] PATH_INFO: `/v3/projects/524ba44f24514182be1506e661f1b071/users/7619c29a79494caf8d7f3e7cffd9ef2b/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:35.006342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce713b39-9202-4298-925b-947415459996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=524ba44f24514182be1506e661f1b071, user_id=7619c29a79494caf8d7f3e7cffd9ef2b, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:35.009033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce713b39-9202-4298-925b-947415459996 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:35.091398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1419/2840] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:55:34 2022] PUT /identity/v3/projects/524ba44f24514182be1506e661f1b071/users/7619c29a79494caf8d7f3e7cffd9ef2b/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:35.095269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a1092-5898-4050-9270-6174884a8263 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:35.105479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a1092-5898-4050-9270-6174884a8263 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:35.160867 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432be86-aa27-4371-971a-ff827d4a202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:35.161536 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432be86-aa27-4371-971a-ff827d4a202d admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:35.162090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432be86-aa27-4371-971a-ff827d4a202d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:35.162369 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432be86-aa27-4371-971a-ff827d4a202d admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:35.163094 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432be86-aa27-4371-971a-ff827d4a202d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:35.164689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432be86-aa27-4371-971a-ff827d4a202d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:35.174314 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1422/2841] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:55:35.178622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce713b39-9202-4298-925b-947415459996 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:35.189331 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce713b39-9202-4298-925b-947415459996 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:35.194165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4f4c6-b43a-4dcd-a31f-8c2b7fd7fe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:35.195058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4f4c6-b43a-4dcd-a31f-8c2b7fd7fe6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:35.195368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4f4c6-b43a-4dcd-a31f-8c2b7fd7fe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:35.195641 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4f4c6-b43a-4dcd-a31f-8c2b7fd7fe6c admin admin] PATH_INFO: `/v3/projects/524ba44f24514182be1506e661f1b071/users/7619c29a79494caf8d7f3e7cffd9ef2b/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:35.198232 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4f4c6-b43a-4dcd-a31f-8c2b7fd7fe6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=524ba44f24514182be1506e661f1b071, user_id=7619c29a79494caf8d7f3e7cffd9ef2b, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:35.200886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4f4c6-b43a-4dcd-a31f-8c2b7fd7fe6c admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:35.210924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1420/2842] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:55:35 2022] PUT /identity/v3/projects/524ba44f24514182be1506e661f1b071/users/7619c29a79494caf8d7f3e7cffd9ef2b/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:55:35.221587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b94e02-66c1-4b48-8e18-b0b952be06e8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:35.221880 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b94e02-66c1-4b48-8e18-b0b952be06e8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:35.222164 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b94e02-66c1-4b48-8e18-b0b952be06e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:35.240424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:35.247370 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-17b94e02-66c1-4b48-8e18-b0b952be06e8 None None] MFA Rules not processed for user `7619c29a79494caf8d7f3e7cffd9ef2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:35.248610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-17b94e02-66c1-4b48-8e18-b0b952be06e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:35.315716 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1423/2843] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:35.326769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4f4c6-b43a-4dcd-a31f-8c2b7fd7fe6c admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:35.328465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c4c4f4c6-b43a-4dcd-a31f-8c2b7fd7fe6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:35.385060 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4f4c6-b43a-4dcd-a31f-8c2b7fd7fe6c admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:35.388568 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e272543-123d-4f1c-a1bd-2e6e334cfaa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:35.389233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e272543-123d-4f1c-a1bd-2e6e334cfaa8 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:35.389519 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e272543-123d-4f1c-a1bd-2e6e334cfaa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:35.389796 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e272543-123d-4f1c-a1bd-2e6e334cfaa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:35.395596 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:35.399189 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e272543-123d-4f1c-a1bd-2e6e334cfaa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:35.400644 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e272543-123d-4f1c-a1bd-2e6e334cfaa8 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:35.410037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1421/2844] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:55:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:55:35.505216 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b94e02-66c1-4b48-8e18-b0b952be06e8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:35.515600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b94e02-66c1-4b48-8e18-b0b952be06e8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:35.519111 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f17629-8755-484c-8afc-39016277392a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:35.519746 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f17629-8755-484c-8afc-39016277392a service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:35.520055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f17629-8755-484c-8afc-39016277392a service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:35.520333 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f17629-8755-484c-8afc-39016277392a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:35.697292 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f17629-8755-484c-8afc-39016277392a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:35.698656 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f17629-8755-484c-8afc-39016277392a service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:35.707563 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1424/2845] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:55:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:55:38.322335 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e272543-123d-4f1c-a1bd-2e6e334cfaa8 service cinder] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:38.331311 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e272543-123d-4f1c-a1bd-2e6e334cfaa8 service cinder] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:38.335091 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86dc69f-ba63-4de6-a025-3ed9bd593250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:38.339891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dc69f-ba63-4de6-a025-3ed9bd593250 service cinder] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:38.339891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dc69f-ba63-4de6-a025-3ed9bd593250 service cinder] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:38.339891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dc69f-ba63-4de6-a025-3ed9bd593250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:38.339891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c86dc69f-ba63-4de6-a025-3ed9bd593250 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:38.397200 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86dc69f-ba63-4de6-a025-3ed9bd593250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:38.398661 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86dc69f-ba63-4de6-a025-3ed9bd593250 service cinder] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:38.408293 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1422/2846] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:55:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:55:38.870644 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f17629-8755-484c-8afc-39016277392a service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:38.931975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f17629-8755-484c-8afc-39016277392a service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:38.936449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:38.937364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:38.937647 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:38.937920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] PATH_INFO: `/v3/users/95714f118aba4c21b50c1ea374fab4b6` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:38.939086 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=95714f118aba4c21b50c1ea374fab4b6)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:38.940996 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:39.136379 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:39.144623 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95714f118aba4c21b50c1ea374fab4b6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:39.145305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95714f118aba4c21b50c1ea374fab4b6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:39.244893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95714f118aba4c21b50c1ea374fab4b6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:39.257150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95714f118aba4c21b50c1ea374fab4b6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:39.263741 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95714f118aba4c21b50c1ea374fab4b6'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:39.269546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1425/2847] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:55:38 2022] DELETE /identity/v3/users/95714f118aba4c21b50c1ea374fab4b6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:39.274036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fd173-ab02-46f0-94f5-f6d4953e11ea None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:39.274334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fd173-ab02-46f0-94f5-f6d4953e11ea None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:39.275187 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fd173-ab02-46f0-94f5-f6d4953e11ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:39.292898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-310fd173-ab02-46f0-94f5-f6d4953e11ea None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:39.294095 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-310fd173-ab02-46f0-94f5-f6d4953e11ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:39.350615 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1423/2848] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:39.360703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:39.362079 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:39.419258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfdb7c-e58d-4ec3-923c-7b7230cb9ead admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:39.422805 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a4b31-2da7-4d83-b8e1-953c5e0ba752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:39.423592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a4b31-2da7-4d83-b8e1-953c5e0ba752 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:39.423885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a4b31-2da7-4d83-b8e1-953c5e0ba752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:39.424166 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a4b31-2da7-4d83-b8e1-953c5e0ba752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:39.433093 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a4b31-2da7-4d83-b8e1-953c5e0ba752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:39.434514 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a4b31-2da7-4d83-b8e1-953c5e0ba752 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:39.443981 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1426/2849] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:55:39.862999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fd173-ab02-46f0-94f5-f6d4953e11ea None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:39.864482 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-310fd173-ab02-46f0-94f5-f6d4953e11ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:39.879275 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fd173-ab02-46f0-94f5-f6d4953e11ea None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:39.883897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:39.886013 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:39.886253 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:39.886622 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] PATH_INFO: `/v3/projects/31c108336fbb4b678132925271638444` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:39.887826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c108336fbb4b678132925271638444)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:39.889682 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:39.998698 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c108336fbb4b678132925271638444', 'request_id': 'req-e48ddeca-5df6-42e7-972e-26e5658710d5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:40.153825 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c108336fbb4b678132925271638444', 'request_id': 'req-e48ddeca-5df6-42e7-972e-26e5658710d5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:40.155038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c108336fbb4b678132925271638444', 'request_id': 'req-e48ddeca-5df6-42e7-972e-26e5658710d5'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:40.165662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] The token cache is being invalidate because project 31c108336fbb4b678132925271638444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:55:40.165947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:40.167155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:40.168730 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1424/2850] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:55:39 2022] DELETE /identity/v3/projects/31c108336fbb4b678132925271638444 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:40.172724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a4b31-2da7-4d83-b8e1-953c5e0ba752 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:40.182274 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a4b31-2da7-4d83-b8e1-953c5e0ba752 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:40.237437 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91f8f4-fea1-469d-8f33-7a6876fcb815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:40.238305 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f8f4-fea1-469d-8f33-7a6876fcb815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:40.238592 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f8f4-fea1-469d-8f33-7a6876fcb815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:40.238865 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f8f4-fea1-469d-8f33-7a6876fcb815 admin admin] PATH_INFO: `/v3/users/7619c29a79494caf8d7f3e7cffd9ef2b` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:40.240040 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91f8f4-fea1-469d-8f33-7a6876fcb815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7619c29a79494caf8d7f3e7cffd9ef2b)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:40.241981 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91f8f4-fea1-469d-8f33-7a6876fcb815 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:40.470932 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ca91f8f4-fea1-469d-8f33-7a6876fcb815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7619c29a79494caf8d7f3e7cffd9ef2b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:40.471606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ca91f8f4-fea1-469d-8f33-7a6876fcb815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7619c29a79494caf8d7f3e7cffd9ef2b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:40.558578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ca91f8f4-fea1-469d-8f33-7a6876fcb815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7619c29a79494caf8d7f3e7cffd9ef2b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:40.563672 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:40.571438 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ca91f8f4-fea1-469d-8f33-7a6876fcb815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7619c29a79494caf8d7f3e7cffd9ef2b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:40.578685 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-ca91f8f4-fea1-469d-8f33-7a6876fcb815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7619c29a79494caf8d7f3e7cffd9ef2b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:40.585000 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1427/2851] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:55:40 2022] DELETE /identity/v3/users/7619c29a79494caf8d7f3e7cffd9ef2b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:40.977156 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:40.979110 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:40.992152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ddeca-5df6-42e7-972e-26e5658710d5 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:41.010802 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:41.049598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:41.050466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:41.050758 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:41.051036 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1 admin admin] PATH_INFO: `/v3/projects/524ba44f24514182be1506e661f1b071` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:41.052322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=524ba44f24514182be1506e661f1b071)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:41.055288 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:41.179174 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524ba44f24514182be1506e661f1b071', 'request_id': 'req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:41.249691 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524ba44f24514182be1506e661f1b071', 'request_id': 'req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:41.256065 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524ba44f24514182be1506e661f1b071', 'request_id': 'req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:41.266570 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1 admin admin] The token cache is being invalidate because project 524ba44f24514182be1506e661f1b071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:55:41.266882 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:41.267512 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-d70e4998-aba6-4eb2-b649-fa2c2d5f4ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:41.269103 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1425/2852] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:55:40 2022] DELETE /identity/v3/projects/524ba44f24514182be1506e661f1b071 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:41.273911 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac9679-4489-4193-96cc-5891898698a1 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:41.274384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac9679-4489-4193-96cc-5891898698a1 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:41.274494 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac9679-4489-4193-96cc-5891898698a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:41.293055 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0cac9679-4489-4193-96cc-5891898698a1 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:41.294257 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0cac9679-4489-4193-96cc-5891898698a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:41.350625 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1428/2853] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:41.358762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb6678-082d-4594-bd04-420ece3ab24a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:41.359054 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb6678-082d-4594-bd04-420ece3ab24a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:41.359334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb6678-082d-4594-bd04-420ece3ab24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:41.376941 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-49fb6678-082d-4594-bd04-420ece3ab24a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:41.378119 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-49fb6678-082d-4594-bd04-420ece3ab24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:41.385885 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1426/2854] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:41.389728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac9679-4489-4193-96cc-5891898698a1 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:41.399248 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac9679-4489-4193-96cc-5891898698a1 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:41.404315 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7dc19-2154-4b9c-9868-9e356b694e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:41.404997 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7dc19-2154-4b9c-9868-9e356b694e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:41.405283 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7dc19-2154-4b9c-9868-9e356b694e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:41.405564 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7dc19-2154-4b9c-9868-9e356b694e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:41.406288 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7dc19-2154-4b9c-9868-9e356b694e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:55:41.406599 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7dc19-2154-4b9c-9868-9e356b694e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:41.408182 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7dc19-2154-4b9c-9868-9e356b694e03 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:41.420400 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1429/2855] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:55:41.424566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb6678-082d-4594-bd04-420ece3ab24a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:41.433574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb6678-082d-4594-bd04-420ece3ab24a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:41.438112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00678522-45cc-4e57-8b62-812ffdbce0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:41.438742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00678522-45cc-4e57-8b62-812ffdbce0ee admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:41.439024 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00678522-45cc-4e57-8b62-812ffdbce0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:41.439301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00678522-45cc-4e57-8b62-812ffdbce0ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:41.439971 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00678522-45cc-4e57-8b62-812ffdbce0ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:41.441899 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00678522-45cc-4e57-8b62-812ffdbce0ee admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:41.543955 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1427/2856] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:55:41 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:55:41.548258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7dc19-2154-4b9c-9868-9e356b694e03 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:41.557985 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7dc19-2154-4b9c-9868-9e356b694e03 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:41.613638 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d21bf-4cb7-473c-9d2f-ab3828f80f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:41.614306 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d21bf-4cb7-473c-9d2f-ab3828f80f2c admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:41.614590 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d21bf-4cb7-473c-9d2f-ab3828f80f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:41.614869 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d21bf-4cb7-473c-9d2f-ab3828f80f2c admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:41.615616 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d21bf-4cb7-473c-9d2f-ab3828f80f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:41.617550 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d21bf-4cb7-473c-9d2f-ab3828f80f2c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:41.724191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1430/2857] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:55:41 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:55:41.728150 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00678522-45cc-4e57-8b62-812ffdbce0ee admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:41.738404 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00678522-45cc-4e57-8b62-812ffdbce0ee admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:41.743015 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c355958-5221-4dad-a88e-26bf4753ec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:41.745403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c355958-5221-4dad-a88e-26bf4753ec4d admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:41.745403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c355958-5221-4dad-a88e-26bf4753ec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:41.745403 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c355958-5221-4dad-a88e-26bf4753ec4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:41.745654 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c355958-5221-4dad-a88e-26bf4753ec4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:41.747230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c355958-5221-4dad-a88e-26bf4753ec4d admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:41.758675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1428/2858] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:55:41.763078 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d21bf-4cb7-473c-9d2f-ab3828f80f2c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:41.773188 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d21bf-4cb7-473c-9d2f-ab3828f80f2c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:41.778600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664359d-b8b9-4820-b490-b2da265cffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:41.779284 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664359d-b8b9-4820-b490-b2da265cffc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:41.779571 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664359d-b8b9-4820-b490-b2da265cffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:41.779889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664359d-b8b9-4820-b490-b2da265cffc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:41.780612 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664359d-b8b9-4820-b490-b2da265cffc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:41.782229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664359d-b8b9-4820-b490-b2da265cffc5 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:41.792356 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1431/2859] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:55:41.796276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c355958-5221-4dad-a88e-26bf4753ec4d admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:41.806001 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c355958-5221-4dad-a88e-26bf4753ec4d admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:41.810524 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fe12d-22db-4432-9a6b-a75038a767e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:41.811381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fe12d-22db-4432-9a6b-a75038a767e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:41.811663 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fe12d-22db-4432-9a6b-a75038a767e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:41.811942 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fe12d-22db-4432-9a6b-a75038a767e3 admin admin] PATH_INFO: `/v3/projects/362c95a3d4f34af4839e5a633ff33930/users/587cb46494354c43b284cd733d41ffa8/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:41.826598 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fe12d-22db-4432-9a6b-a75038a767e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=362c95a3d4f34af4839e5a633ff33930, user_id=587cb46494354c43b284cd733d41ffa8, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:41.829301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fe12d-22db-4432-9a6b-a75038a767e3 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:41.895674 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1429/2860] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:55:41 2022] PUT /identity/v3/projects/362c95a3d4f34af4839e5a633ff33930/users/587cb46494354c43b284cd733d41ffa8/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:41.906896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a41d0-b4f8-4eec-bb8c-af954595792a None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:41.907185 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a41d0-b4f8-4eec-bb8c-af954595792a None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:41.907451 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a41d0-b4f8-4eec-bb8c-af954595792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:41.935587 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-b13a41d0-b4f8-4eec-bb8c-af954595792a None None] MFA Rules not processed for user `587cb46494354c43b284cd733d41ffa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:41.936818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-b13a41d0-b4f8-4eec-bb8c-af954595792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:41.965652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:41.999679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1432/2861] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:42.004142 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fe12d-22db-4432-9a6b-a75038a767e3 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:42.048761 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:42.066269 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fe12d-22db-4432-9a6b-a75038a767e3 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:42.070912 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82932d-2d68-4708-b8cf-53d6ae2f1e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:42.071627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82932d-2d68-4708-b8cf-53d6ae2f1e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:42.071913 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82932d-2d68-4708-b8cf-53d6ae2f1e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:42.072193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82932d-2d68-4708-b8cf-53d6ae2f1e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:42.072911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82932d-2d68-4708-b8cf-53d6ae2f1e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:42.074819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82932d-2d68-4708-b8cf-53d6ae2f1e5e admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:42.177434 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1430/2862] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:55:42 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:55:42.181378 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a41d0-b4f8-4eec-bb8c-af954595792a None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:42.191970 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a41d0-b4f8-4eec-bb8c-af954595792a None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:42.246959 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d9053-57c5-4ca3-80b6-74dd3162e2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:42.247622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d9053-57c5-4ca3-80b6-74dd3162e2ea admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:42.248196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d9053-57c5-4ca3-80b6-74dd3162e2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:42.248471 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d9053-57c5-4ca3-80b6-74dd3162e2ea admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:42.249196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d9053-57c5-4ca3-80b6-74dd3162e2ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:42.251096 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d9053-57c5-4ca3-80b6-74dd3162e2ea admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:42.333545 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1433/2863] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:55:42 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:55:42.337479 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82932d-2d68-4708-b8cf-53d6ae2f1e5e admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:42.348504 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82932d-2d68-4708-b8cf-53d6ae2f1e5e admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:42.353322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46f339-98fd-4012-afbf-4ce17063e174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:42.354646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46f339-98fd-4012-afbf-4ce17063e174 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:42.354936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46f339-98fd-4012-afbf-4ce17063e174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:42.355212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46f339-98fd-4012-afbf-4ce17063e174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:42.355932 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46f339-98fd-4012-afbf-4ce17063e174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:42.357566 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46f339-98fd-4012-afbf-4ce17063e174 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:42.367947 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1431/2864] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:55:42.371848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d9053-57c5-4ca3-80b6-74dd3162e2ea admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:42.381679 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d9053-57c5-4ca3-80b6-74dd3162e2ea admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:42.386236 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e836e8-13e9-463a-b556-20bb6aaf323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:42.387109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e836e8-13e9-463a-b556-20bb6aaf323b admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:42.387390 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e836e8-13e9-463a-b556-20bb6aaf323b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:42.387664 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e836e8-13e9-463a-b556-20bb6aaf323b admin admin] PATH_INFO: `/v3/projects/50e5cc413052490fbee0d3439cc77b2e/users/a8696f1ae1334c639ab70a7e51aace73/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:42.402270 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e836e8-13e9-463a-b556-20bb6aaf323b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e5cc413052490fbee0d3439cc77b2e, user_id=a8696f1ae1334c639ab70a7e51aace73, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:42.404938 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e836e8-13e9-463a-b556-20bb6aaf323b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:42.496365 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1434/2865] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:55:42 2022] PUT /identity/v3/projects/50e5cc413052490fbee0d3439cc77b2e/users/a8696f1ae1334c639ab70a7e51aace73/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:42.500206 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46f339-98fd-4012-afbf-4ce17063e174 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:42.510890 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46f339-98fd-4012-afbf-4ce17063e174 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:42.568428 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a9f85-f36b-45f1-bb30-ca567000e491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:42.569128 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9f85-f36b-45f1-bb30-ca567000e491 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:42.569411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9f85-f36b-45f1-bb30-ca567000e491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:42.569688 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9f85-f36b-45f1-bb30-ca567000e491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:42.570398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a9f85-f36b-45f1-bb30-ca567000e491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:42.571983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a9f85-f36b-45f1-bb30-ca567000e491 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:42.581933 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1432/2866] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:55:42.586161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e836e8-13e9-463a-b556-20bb6aaf323b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:42.596627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e836e8-13e9-463a-b556-20bb6aaf323b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:42.601161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d3b55-d88d-4f7c-8ed1-546752ce4ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:42.602026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d3b55-d88d-4f7c-8ed1-546752ce4ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:42.602331 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d3b55-d88d-4f7c-8ed1-546752ce4ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:42.602601 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d3b55-d88d-4f7c-8ed1-546752ce4ba2 admin admin] PATH_INFO: `/v3/projects/50e5cc413052490fbee0d3439cc77b2e/users/a8696f1ae1334c639ab70a7e51aace73/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:42.604557 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d3b55-d88d-4f7c-8ed1-546752ce4ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e5cc413052490fbee0d3439cc77b2e, user_id=a8696f1ae1334c639ab70a7e51aace73, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:42.607180 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d3b55-d88d-4f7c-8ed1-546752ce4ba2 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:42.617084 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1435/2867] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:55:42 2022] PUT /identity/v3/projects/50e5cc413052490fbee0d3439cc77b2e/users/a8696f1ae1334c639ab70a7e51aace73/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:42.626957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb83d5-5244-49d1-8159-d1475e50e3bf None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:42.627250 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb83d5-5244-49d1-8159-d1475e50e3bf None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:42.627528 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb83d5-5244-49d1-8159-d1475e50e3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:42.653818 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-6fdb83d5-5244-49d1-8159-d1475e50e3bf None None] MFA Rules not processed for user `a8696f1ae1334c639ab70a7e51aace73`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:42.655008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-6fdb83d5-5244-49d1-8159-d1475e50e3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:42.720363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1433/2868] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:42.730963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d3b55-d88d-4f7c-8ed1-546752ce4ba2 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:42.732735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-566d3b55-d88d-4f7c-8ed1-546752ce4ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:42.789346 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d3b55-d88d-4f7c-8ed1-546752ce4ba2 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:42.793008 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6693b8-4f04-42c7-bd7c-af5001e93149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:42.793642 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6693b8-4f04-42c7-bd7c-af5001e93149 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:42.793925 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6693b8-4f04-42c7-bd7c-af5001e93149 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:42.794203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6693b8-4f04-42c7-bd7c-af5001e93149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:42.830742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:42.848067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6693b8-4f04-42c7-bd7c-af5001e93149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:42.849489 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6693b8-4f04-42c7-bd7c-af5001e93149 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:42.858169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1436/2869] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:55:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:55:51.101159 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a78a3-1ffc-4969-a5ca-6dba2cf96624 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:51.101739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a78a3-1ffc-4969-a5ca-6dba2cf96624 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:51.101739 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a78a3-1ffc-4969-a5ca-6dba2cf96624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:51.119516 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-5a5a78a3-1ffc-4969-a5ca-6dba2cf96624 None None] MFA Rules not processed for user `68cb1f2b1bc349b99aab575d48d9eada`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:51.120808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5a5a78a3-1ffc-4969-a5ca-6dba2cf96624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:51.154165 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:51.177032 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1434/2870] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:52.195340 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6693b8-4f04-42c7-bd7c-af5001e93149 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:52.196832 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-af6693b8-4f04-42c7-bd7c-af5001e93149 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:52.208440 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6693b8-4f04-42c7-bd7c-af5001e93149 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:52.212339 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1144e-3fed-4f79-9cb8-9661a2382718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:52.217521 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1144e-3fed-4f79-9cb8-9661a2382718 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:52.217521 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1144e-3fed-4f79-9cb8-9661a2382718 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:52.217521 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1144e-3fed-4f79-9cb8-9661a2382718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:52.226094 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1144e-3fed-4f79-9cb8-9661a2382718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:52.227539 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1144e-3fed-4f79-9cb8-9661a2382718 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:52.236900 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1437/2871] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:55:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:55:58.115601 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a78a3-1ffc-4969-a5ca-6dba2cf96624 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:58.176226 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a78a3-1ffc-4969-a5ca-6dba2cf96624 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:58.180621 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:58.181779 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:58.182059 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:58.182334 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] PATH_INFO: `/v3/users/587cb46494354c43b284cd733d41ffa8` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:58.183514 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=587cb46494354c43b284cd733d41ffa8)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:58.185466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:58.414134 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587cb46494354c43b284cd733d41ffa8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:58.414745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587cb46494354c43b284cd733d41ffa8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:58.415440 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587cb46494354c43b284cd733d41ffa8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:58.427248 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587cb46494354c43b284cd733d41ffa8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:58.434089 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587cb46494354c43b284cd733d41ffa8'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:58.493453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1435/2872] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:55:58 2022] DELETE /identity/v3/users/587cb46494354c43b284cd733d41ffa8 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:58.498002 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2c192-4b26-4d9e-aed9-7e28d5b7a51d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:58.498478 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2c192-4b26-4d9e-aed9-7e28d5b7a51d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:58.498579 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2c192-4b26-4d9e-aed9-7e28d5b7a51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:58.516548 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4dd2c192-4b26-4d9e-aed9-7e28d5b7a51d None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:58.517743 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4dd2c192-4b26-4d9e-aed9-7e28d5b7a51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:58.575703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1438/2873] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:58.585241 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:58.586641 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:58.644907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbe703-414a-486f-8b86-32c299c53dc7 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:58.649177 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98901a02-67f7-440e-89fb-4f5e5a882b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:58.649455 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98901a02-67f7-440e-89fb-4f5e5a882b5a service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:58.649742 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98901a02-67f7-440e-89fb-4f5e5a882b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:58.650046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98901a02-67f7-440e-89fb-4f5e5a882b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:58.659753 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98901a02-67f7-440e-89fb-4f5e5a882b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:58.661239 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98901a02-67f7-440e-89fb-4f5e5a882b5a service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:58.674795 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1436/2874] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:55:59.135967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2c192-4b26-4d9e-aed9-7e28d5b7a51d None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:59.137582 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4dd2c192-4b26-4d9e-aed9-7e28d5b7a51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:59.149678 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2c192-4b26-4d9e-aed9-7e28d5b7a51d None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:59.154432 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:59.155294 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:59.155578 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:59.155854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] PATH_INFO: `/v3/projects/362c95a3d4f34af4839e5a633ff33930` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:59.157068 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] RBAC: Authorizing `identity:delete_project(project_id=362c95a3d4f34af4839e5a633ff33930)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:59.158969 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:59.265693 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362c95a3d4f34af4839e5a633ff33930', 'request_id': 'req-2fada5e8-a645-4135-b878-c226407ad27c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:59.271728 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362c95a3d4f34af4839e5a633ff33930', 'request_id': 'req-2fada5e8-a645-4135-b878-c226407ad27c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:59.277744 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362c95a3d4f34af4839e5a633ff33930', 'request_id': 'req-2fada5e8-a645-4135-b878-c226407ad27c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:59.375934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] The token cache is being invalidate because project 362c95a3d4f34af4839e5a633ff33930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:55:59.376201 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:59.376920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:59.378444 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1439/2875] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:55:59 2022] DELETE /identity/v3/projects/362c95a3d4f34af4839e5a633ff33930 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:59.382463 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98901a02-67f7-440e-89fb-4f5e5a882b5a service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:59.389245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:59.393511 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98901a02-67f7-440e-89fb-4f5e5a882b5a service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:59.460172 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba6e1f-75fe-415b-8b9a-2eb855a3e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:59.461179 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba6e1f-75fe-415b-8b9a-2eb855a3e664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:59.461574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba6e1f-75fe-415b-8b9a-2eb855a3e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:59.461925 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba6e1f-75fe-415b-8b9a-2eb855a3e664 admin admin] PATH_INFO: `/v3/users/a8696f1ae1334c639ab70a7e51aace73` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:59.463289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba6e1f-75fe-415b-8b9a-2eb855a3e664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8696f1ae1334c639ab70a7e51aace73)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:59.465362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba6e1f-75fe-415b-8b9a-2eb855a3e664 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:59.631784 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7bba6e1f-75fe-415b-8b9a-2eb855a3e664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8696f1ae1334c639ab70a7e51aace73'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:59.632494 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7bba6e1f-75fe-415b-8b9a-2eb855a3e664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8696f1ae1334c639ab70a7e51aace73'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:59.633140 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7bba6e1f-75fe-415b-8b9a-2eb855a3e664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8696f1ae1334c639ab70a7e51aace73'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:59.647162 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7bba6e1f-75fe-415b-8b9a-2eb855a3e664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8696f1ae1334c639ab70a7e51aace73'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:59.655264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7bba6e1f-75fe-415b-8b9a-2eb855a3e664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8696f1ae1334c639ab70a7e51aace73'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:59.762790 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1437/2876] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:55:59 2022] DELETE /identity/v3/users/a8696f1ae1334c639ab70a7e51aace73 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:56:00.283889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:00.289874 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:00.299398 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fada5e8-a645-4135-b878-c226407ad27c admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:00.348979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:00.363920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991cba2-ac91-47c7-8a92-7986d97b9312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:00.363920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991cba2-ac91-47c7-8a92-7986d97b9312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:00.363920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991cba2-ac91-47c7-8a92-7986d97b9312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:00.363920 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991cba2-ac91-47c7-8a92-7986d97b9312 admin admin] PATH_INFO: `/v3/projects/50e5cc413052490fbee0d3439cc77b2e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:00.364522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991cba2-ac91-47c7-8a92-7986d97b9312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e5cc413052490fbee0d3439cc77b2e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:00.365627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991cba2-ac91-47c7-8a92-7986d97b9312 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:00.481014 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e991cba2-ac91-47c7-8a92-7986d97b9312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e5cc413052490fbee0d3439cc77b2e', 'request_id': 'req-e991cba2-ac91-47c7-8a92-7986d97b9312'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:00.487742 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e991cba2-ac91-47c7-8a92-7986d97b9312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e5cc413052490fbee0d3439cc77b2e', 'request_id': 'req-e991cba2-ac91-47c7-8a92-7986d97b9312'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:00.494689 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e991cba2-ac91-47c7-8a92-7986d97b9312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e5cc413052490fbee0d3439cc77b2e', 'request_id': 'req-e991cba2-ac91-47c7-8a92-7986d97b9312'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:00.567531 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e991cba2-ac91-47c7-8a92-7986d97b9312 admin admin] The token cache is being invalidate because project 50e5cc413052490fbee0d3439cc77b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:56:00.567859 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e991cba2-ac91-47c7-8a92-7986d97b9312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:00.568584 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e991cba2-ac91-47c7-8a92-7986d97b9312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:00.570216 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1440/2877] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:56:00 2022] DELETE /identity/v3/projects/50e5cc413052490fbee0d3439cc77b2e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:56:00.576312 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b491841-e76f-4432-bee0-fb6672b0dd5a None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:00.576956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b491841-e76f-4432-bee0-fb6672b0dd5a None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:00.576956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b491841-e76f-4432-bee0-fb6672b0dd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:00.594672 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-1b491841-e76f-4432-bee0-fb6672b0dd5a None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:00.595926 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1b491841-e76f-4432-bee0-fb6672b0dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:00.667118 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1438/2878] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:00.676790 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797c4c2-358c-4dee-8128-2867a425523c None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:00.677108 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797c4c2-358c-4dee-8128-2867a425523c None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:00.677413 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797c4c2-358c-4dee-8128-2867a425523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:00.697415 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-5797c4c2-358c-4dee-8128-2867a425523c None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:00.698627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5797c4c2-358c-4dee-8128-2867a425523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:00.706902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1441/2879] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:00.711113 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b491841-e76f-4432-bee0-fb6672b0dd5a None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:00.720865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b491841-e76f-4432-bee0-fb6672b0dd5a None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:00.725490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3d23b-12af-4215-a6db-862b6ade91d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:00.726155 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3d23b-12af-4215-a6db-862b6ade91d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:00.726451 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3d23b-12af-4215-a6db-862b6ade91d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:00.726727 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3d23b-12af-4215-a6db-862b6ade91d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:00.727479 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3d23b-12af-4215-a6db-862b6ade91d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:56:00.727759 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3d23b-12af-4215-a6db-862b6ade91d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:00.729897 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3d23b-12af-4215-a6db-862b6ade91d4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:00.742923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1439/2880] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:56:00.747203 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797c4c2-358c-4dee-8128-2867a425523c None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:00.756343 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797c4c2-358c-4dee-8128-2867a425523c None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:00.761280 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0171545-7ebf-46bf-9745-4d32f2d85408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:00.766227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171545-7ebf-46bf-9745-4d32f2d85408 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:00.766227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171545-7ebf-46bf-9745-4d32f2d85408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:00.766227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171545-7ebf-46bf-9745-4d32f2d85408 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:00.766227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0171545-7ebf-46bf-9745-4d32f2d85408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:00.766227 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0171545-7ebf-46bf-9745-4d32f2d85408 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:00.860750 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1442/2881] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:56:00 2022] POST /identity/v3/projects => generated 361 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:56:00.863627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3d23b-12af-4215-a6db-862b6ade91d4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:00.877026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3d23b-12af-4215-a6db-862b6ade91d4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:00.894456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:00.955744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fe3c3-41f5-4afc-b6ff-47c847606a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:00.956443 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fe3c3-41f5-4afc-b6ff-47c847606a0b admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:00.956834 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fe3c3-41f5-4afc-b6ff-47c847606a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:00.957112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fe3c3-41f5-4afc-b6ff-47c847606a0b admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:00.957804 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fe3c3-41f5-4afc-b6ff-47c847606a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:00.959748 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fe3c3-41f5-4afc-b6ff-47c847606a0b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:01.049502 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1440/2882] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:56:00 2022] POST /identity/v3/users => generated 281 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:56:01.053622 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0171545-7ebf-46bf-9745-4d32f2d85408 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:01.068199 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0171545-7ebf-46bf-9745-4d32f2d85408 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:01.073246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d6383-4698-46af-ae37-32ae71f177c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:01.073927 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d6383-4698-46af-ae37-32ae71f177c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:01.074213 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d6383-4698-46af-ae37-32ae71f177c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:01.074607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d6383-4698-46af-ae37-32ae71f177c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:01.075282 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d6383-4698-46af-ae37-32ae71f177c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:01.076929 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d6383-4698-46af-ae37-32ae71f177c6 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:01.089456 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1443/2883] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:56:01.093462 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fe3c3-41f5-4afc-b6ff-47c847606a0b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:01.105967 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fe3c3-41f5-4afc-b6ff-47c847606a0b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:01.109342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190da90-5a10-4d4d-9acc-4071d10523ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:01.110031 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190da90-5a10-4d4d-9acc-4071d10523ce admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:01.110315 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190da90-5a10-4d4d-9acc-4071d10523ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:01.110589 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190da90-5a10-4d4d-9acc-4071d10523ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:01.111310 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190da90-5a10-4d4d-9acc-4071d10523ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:01.113022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190da90-5a10-4d4d-9acc-4071d10523ce admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:01.124084 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1441/2884] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:56:01.129544 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d6383-4698-46af-ae37-32ae71f177c6 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:01.141518 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d6383-4698-46af-ae37-32ae71f177c6 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:01.148455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7804f8-11a5-4f6d-bb7c-629ac963f1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:01.149516 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7804f8-11a5-4f6d-bb7c-629ac963f1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:01.149804 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7804f8-11a5-4f6d-bb7c-629ac963f1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:01.150627 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7804f8-11a5-4f6d-bb7c-629ac963f1d9 admin admin] PATH_INFO: `/v3/projects/f238ce8ff36f4f6e8d7076a098a989ec/users/547cfd9871ba4b64b0fb4289eff70324/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:01.166403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7804f8-11a5-4f6d-bb7c-629ac963f1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f238ce8ff36f4f6e8d7076a098a989ec, user_id=547cfd9871ba4b64b0fb4289eff70324, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:01.176893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7804f8-11a5-4f6d-bb7c-629ac963f1d9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:01.253102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1444/2885] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:56:01 2022] PUT /identity/v3/projects/f238ce8ff36f4f6e8d7076a098a989ec/users/547cfd9871ba4b64b0fb4289eff70324/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:56:01.265243 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e93d13-e801-449a-8001-ae9129d03217 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:01.265542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e93d13-e801-449a-8001-ae9129d03217 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:01.266217 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e93d13-e801-449a-8001-ae9129d03217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:01.297255 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-53e93d13-e801-449a-8001-ae9129d03217 None None] MFA Rules not processed for user `547cfd9871ba4b64b0fb4289eff70324`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:01.298662 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-53e93d13-e801-449a-8001-ae9129d03217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:01.369679 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1442/2886] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:01.403701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7804f8-11a5-4f6d-bb7c-629ac963f1d9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:01.405479 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-ef7804f8-11a5-4f6d-bb7c-629ac963f1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:01.469272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7804f8-11a5-4f6d-bb7c-629ac963f1d9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:01.472943 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612b89e-599c-427c-a456-bb8bd9586747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:01.473591 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612b89e-599c-427c-a456-bb8bd9586747 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:01.473873 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612b89e-599c-427c-a456-bb8bd9586747 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:01.474150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612b89e-599c-427c-a456-bb8bd9586747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:01.482815 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612b89e-599c-427c-a456-bb8bd9586747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:01.484300 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612b89e-599c-427c-a456-bb8bd9586747 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:01.493455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1445/2887] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:01.508329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e93d13-e801-449a-8001-ae9129d03217 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:01.575750 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e93d13-e801-449a-8001-ae9129d03217 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:01.580486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:01.581417 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:01.581702 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:01.581978 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] PATH_INFO: `/v3/users/547cfd9871ba4b64b0fb4289eff70324` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:01.583273 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547cfd9871ba4b64b0fb4289eff70324)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:01.585226 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:01.608356 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:01.855864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547cfd9871ba4b64b0fb4289eff70324'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:01.856649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547cfd9871ba4b64b0fb4289eff70324'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:01.857277 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547cfd9871ba4b64b0fb4289eff70324'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:01.869786 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547cfd9871ba4b64b0fb4289eff70324'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:01.876484 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547cfd9871ba4b64b0fb4289eff70324'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:01.951171 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1443/2888] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:56:01 2022] DELETE /identity/v3/users/547cfd9871ba4b64b0fb4289eff70324 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:56:01.955613 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624881c-06da-43c4-8d88-89d40c3988ef None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:01.955909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624881c-06da-43c4-8d88-89d40c3988ef None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:01.956191 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624881c-06da-43c4-8d88-89d40c3988ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:01.973567 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-8624881c-06da-43c4-8d88-89d40c3988ef None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:01.974786 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8624881c-06da-43c4-8d88-89d40c3988ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:01.989718 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:02.037950 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1446/2889] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:02.048336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:02.056082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:02.111877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9139e6-079e-46d4-8519-e6a283806ba1 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:02.115685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4b393-072f-463d-9e58-ea674f59e871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:02.116342 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4b393-072f-463d-9e58-ea674f59e871 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:02.116630 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4b393-072f-463d-9e58-ea674f59e871 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:02.116957 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4b393-072f-463d-9e58-ea674f59e871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:02.129930 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4b393-072f-463d-9e58-ea674f59e871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:02.131475 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4b393-072f-463d-9e58-ea674f59e871 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:02.141585 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1444/2890] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:02.600132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624881c-06da-43c4-8d88-89d40c3988ef None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:02.601641 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-8624881c-06da-43c4-8d88-89d40c3988ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:02.614528 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624881c-06da-43c4-8d88-89d40c3988ef None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:02.619690 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d40865-b426-41af-bb81-3a47ed1f688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:02.620466 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d40865-b426-41af-bb81-3a47ed1f688c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:02.620785 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d40865-b426-41af-bb81-3a47ed1f688c admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:02.621062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d40865-b426-41af-bb81-3a47ed1f688c admin admin] PATH_INFO: `/v3/projects/f238ce8ff36f4f6e8d7076a098a989ec` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:02.622253 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d40865-b426-41af-bb81-3a47ed1f688c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f238ce8ff36f4f6e8d7076a098a989ec)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:02.624577 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d40865-b426-41af-bb81-3a47ed1f688c admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:02.742003 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e8d40865-b426-41af-bb81-3a47ed1f688c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f238ce8ff36f4f6e8d7076a098a989ec', 'request_id': 'req-e8d40865-b426-41af-bb81-3a47ed1f688c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:02.748240 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e8d40865-b426-41af-bb81-3a47ed1f688c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f238ce8ff36f4f6e8d7076a098a989ec', 'request_id': 'req-e8d40865-b426-41af-bb81-3a47ed1f688c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:02.754234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e8d40865-b426-41af-bb81-3a47ed1f688c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f238ce8ff36f4f6e8d7076a098a989ec', 'request_id': 'req-e8d40865-b426-41af-bb81-3a47ed1f688c'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:02.814871 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e8d40865-b426-41af-bb81-3a47ed1f688c admin admin] The token cache is being invalidate because project f238ce8ff36f4f6e8d7076a098a989ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:56:02.820381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e8d40865-b426-41af-bb81-3a47ed1f688c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:02.820381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e8d40865-b426-41af-bb81-3a47ed1f688c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:02.820381 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1447/2891] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:56:02 2022] DELETE /identity/v3/projects/f238ce8ff36f4f6e8d7076a098a989ec => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:56:02.822769 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f64fd2-5155-49ac-9bfe-d3dfdf4938bf None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:02.823212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f64fd2-5155-49ac-9bfe-d3dfdf4938bf None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:02.823322 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f64fd2-5155-49ac-9bfe-d3dfdf4938bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:02.841137 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-f0f64fd2-5155-49ac-9bfe-d3dfdf4938bf None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:02.842338 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f0f64fd2-5155-49ac-9bfe-d3dfdf4938bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:02.899141 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1445/2892] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:02.907278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431c9ea-9f85-4dcf-9def-9db6bdd0ac43 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:02.907595 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431c9ea-9f85-4dcf-9def-9db6bdd0ac43 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:02.907873 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431c9ea-9f85-4dcf-9def-9db6bdd0ac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:02.925840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4431c9ea-9f85-4dcf-9def-9db6bdd0ac43 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:02.927026 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4431c9ea-9f85-4dcf-9def-9db6bdd0ac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:02.934801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1448/2893] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:02.938771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f64fd2-5155-49ac-9bfe-d3dfdf4938bf None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:02.948805 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f64fd2-5155-49ac-9bfe-d3dfdf4938bf None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:02.953419 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a6c3-013d-4ffd-8f51-e336a897eea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:02.954067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a6c3-013d-4ffd-8f51-e336a897eea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:02.954356 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a6c3-013d-4ffd-8f51-e336a897eea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:02.954634 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a6c3-013d-4ffd-8f51-e336a897eea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:02.955386 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29a6c3-013d-4ffd-8f51-e336a897eea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:56:02.955696 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29a6c3-013d-4ffd-8f51-e336a897eea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:02.957333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29a6c3-013d-4ffd-8f51-e336a897eea4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:02.969176 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1446/2894] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:56:02.973059 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431c9ea-9f85-4dcf-9def-9db6bdd0ac43 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:02.982058 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431c9ea-9f85-4dcf-9def-9db6bdd0ac43 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:02.986606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a97c96-6bf9-4e3e-be83-02f432cedb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:02.987238 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a97c96-6bf9-4e3e-be83-02f432cedb63 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:02.987524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a97c96-6bf9-4e3e-be83-02f432cedb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:02.987801 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a97c96-6bf9-4e3e-be83-02f432cedb63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:02.988473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a97c96-6bf9-4e3e-be83-02f432cedb63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:02.990376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a97c96-6bf9-4e3e-be83-02f432cedb63 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:03.115103 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1449/2895] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:56:02 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:56:03.119690 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a6c3-013d-4ffd-8f51-e336a897eea4 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:03.130363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a6c3-013d-4ffd-8f51-e336a897eea4 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:03.156245 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:03.186569 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466d70f-f5b5-4bc5-93a2-765983a4d31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:03.187242 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466d70f-f5b5-4bc5-93a2-765983a4d31a admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:03.187530 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466d70f-f5b5-4bc5-93a2-765983a4d31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:03.187815 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466d70f-f5b5-4bc5-93a2-765983a4d31a admin admin] PATH_INFO: `/v3/users` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:03.188542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466d70f-f5b5-4bc5-93a2-765983a4d31a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:03.190544 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466d70f-f5b5-4bc5-93a2-765983a4d31a admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:03.286219 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1447/2896] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:56:03 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:56:03.289208 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a97c96-6bf9-4e3e-be83-02f432cedb63 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:03.300787 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a97c96-6bf9-4e3e-be83-02f432cedb63 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:03.305434 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fff17-3003-4b98-8e44-0638fc97c941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:03.306102 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fff17-3003-4b98-8e44-0638fc97c941 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:03.306896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fff17-3003-4b98-8e44-0638fc97c941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:03.307171 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fff17-3003-4b98-8e44-0638fc97c941 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:03.307896 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fff17-3003-4b98-8e44-0638fc97c941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:03.309509 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fff17-3003-4b98-8e44-0638fc97c941 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:03.320039 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1450/2897] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:56:03.324829 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466d70f-f5b5-4bc5-93a2-765983a4d31a admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:03.335309 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466d70f-f5b5-4bc5-93a2-765983a4d31a admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:03.342000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef0a05-cbdd-44e9-ac7c-c68d2d03aad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:03.342000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef0a05-cbdd-44e9-ac7c-c68d2d03aad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:03.342000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef0a05-cbdd-44e9-ac7c-c68d2d03aad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:03.342000 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef0a05-cbdd-44e9-ac7c-c68d2d03aad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:03.342400 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef0a05-cbdd-44e9-ac7c-c68d2d03aad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:03.343695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef0a05-cbdd-44e9-ac7c-c68d2d03aad4 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:03.353852 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1448/2898] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:56:03.357926 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fff17-3003-4b98-8e44-0638fc97c941 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:03.368246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fff17-3003-4b98-8e44-0638fc97c941 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:03.373808 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a278e4-708e-4b12-be56-f2c207c5f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:03.374496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a278e4-708e-4b12-be56-f2c207c5f03b admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:03.374777 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a278e4-708e-4b12-be56-f2c207c5f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:03.375048 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a278e4-708e-4b12-be56-f2c207c5f03b admin admin] PATH_INFO: `/v3/projects/d1445018bb1645508e48ef89249128d2/users/3eadc1946e3b48049e74afef65b60dc9/roles/3b950540b0074582839238d2d27d159e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:03.390730 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a278e4-708e-4b12-be56-f2c207c5f03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1445018bb1645508e48ef89249128d2, user_id=3eadc1946e3b48049e74afef65b60dc9, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:03.393941 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a278e4-708e-4b12-be56-f2c207c5f03b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:03.473234 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1451/2899] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:56:03 2022] PUT /identity/v3/projects/d1445018bb1645508e48ef89249128d2/users/3eadc1946e3b48049e74afef65b60dc9/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:56:03.484555 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8bad-8c57-4049-9fae-e3daa411541d None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:03.484867 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8bad-8c57-4049-9fae-e3daa411541d None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:03.485144 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8bad-8c57-4049-9fae-e3daa411541d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:03.512993 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-3b3a8bad-8c57-4049-9fae-e3daa411541d None None] MFA Rules not processed for user `3eadc1946e3b48049e74afef65b60dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:03.514193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-3b3a8bad-8c57-4049-9fae-e3daa411541d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:03.576576 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1449/2900] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:03.587351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a278e4-708e-4b12-be56-f2c207c5f03b admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:03.589070 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-54a278e4-708e-4b12-be56-f2c207c5f03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:03.630298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:03.644822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a278e4-708e-4b12-be56-f2c207c5f03b admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:03.648600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a9ab2-7b8e-470d-91a8-93655e0b80c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1c0a73d629a47e4bdbd67da236240af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:03.649263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a9ab2-7b8e-470d-91a8-93655e0b80c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:03.649543 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a9ab2-7b8e-470d-91a8-93655e0b80c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:03.649824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a9ab2-7b8e-470d-91a8-93655e0b80c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:03.658396 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a9ab2-7b8e-470d-91a8-93655e0b80c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:03.659818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a9ab2-7b8e-470d-91a8-93655e0b80c5 service cinder] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:03.669351 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1452/2901] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:05.309819 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff0605-12d9-4d82-860e-6766eb279a0c None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:05.310336 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff0605-12d9-4d82-860e-6766eb279a0c None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:05.310449 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff0605-12d9-4d82-860e-6766eb279a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:05.327678 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-c9ff0605-12d9-4d82-860e-6766eb279a0c None None] MFA Rules not processed for user `3eadc1946e3b48049e74afef65b60dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:05.328918 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c9ff0605-12d9-4d82-860e-6766eb279a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:05.335851 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1450/2902] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:13.784725 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=9 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:15.322563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=56,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:15.444842 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a9ab2-7b8e-470d-91a8-93655e0b80c5 service cinder] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:15.447706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-d86a9ab2-7b8e-470d-91a8-93655e0b80c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:15.506572 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a9ab2-7b8e-470d-91a8-93655e0b80c5 service cinder] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:15.510618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68859f-3f35-4f6a-b827-4608d534b724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:15.511260 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68859f-3f35-4f6a-b827-4608d534b724 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:15.511542 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68859f-3f35-4f6a-b827-4608d534b724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:15.511819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68859f-3f35-4f6a-b827-4608d534b724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:15.513657 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1b68859f-3f35-4f6a-b827-4608d534b724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:15.577763 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68859f-3f35-4f6a-b827-4608d534b724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:15.579190 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68859f-3f35-4f6a-b827-4608d534b724 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:15.589449 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1453/2903] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:17.749600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff0605-12d9-4d82-860e-6766eb279a0c None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:17.751193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-c9ff0605-12d9-4d82-860e-6766eb279a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:17.826930 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff0605-12d9-4d82-860e-6766eb279a0c None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:17.832511 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4cb37-0080-4c13-ac74-e913d8657313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:17.833193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4cb37-0080-4c13-ac74-e913d8657313 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:17.833478 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4cb37-0080-4c13-ac74-e913d8657313 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:17.833755 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4cb37-0080-4c13-ac74-e913d8657313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:17.835562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f0c4cb37-0080-4c13-ac74-e913d8657313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:17.848407 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4cb37-0080-4c13-ac74-e913d8657313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:17.850016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4cb37-0080-4c13-ac74-e913d8657313 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:17.860908 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1451/2904] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:24.394893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68859f-3f35-4f6a-b827-4608d534b724 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:24.404184 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68859f-3f35-4f6a-b827-4608d534b724 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:24.407902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ab54d-70dc-4af5-b779-553a24a70c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:24.408541 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ab54d-70dc-4af5-b779-553a24a70c7b service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:24.408854 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ab54d-70dc-4af5-b779-553a24a70c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:24.409136 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ab54d-70dc-4af5-b779-553a24a70c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:24.410905 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f65ab54d-70dc-4af5-b779-553a24a70c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:24.450455 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ab54d-70dc-4af5-b779-553a24a70c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:24.451889 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ab54d-70dc-4af5-b779-553a24a70c7b service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:24.472463 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1454/2905] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:25.644620 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4cb37-0080-4c13-ac74-e913d8657313 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:25.646136 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f0c4cb37-0080-4c13-ac74-e913d8657313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:25.657725 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4cb37-0080-4c13-ac74-e913d8657313 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:25.676264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa912d-370c-44b4-9a95-7de4b8ef7d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:25.676264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa912d-370c-44b4-9a95-7de4b8ef7d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:25.676264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa912d-370c-44b4-9a95-7de4b8ef7d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:25.676264 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa912d-370c-44b4-9a95-7de4b8ef7d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:25.676640 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a6aa912d-370c-44b4-9a95-7de4b8ef7d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:25.677490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa912d-370c-44b4-9a95-7de4b8ef7d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:25.678911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa912d-370c-44b4-9a95-7de4b8ef7d23 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:25.690401 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1452/2906] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:29.866546 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255ca9-fd5c-41f9-ac7c-5b8f634647fb None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:29.867046 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255ca9-fd5c-41f9-ac7c-5b8f634647fb None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:29.867146 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255ca9-fd5c-41f9-ac7c-5b8f634647fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:29.922846 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-4b255ca9-fd5c-41f9-ac7c-5b8f634647fb None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:29.924038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-4b255ca9-fd5c-41f9-ac7c-5b8f634647fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:29.954972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=100 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:29.985523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1455/2907] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:56:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:30.123394 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa912d-370c-44b4-9a95-7de4b8ef7d23 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:30.124826 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a6aa912d-370c-44b4-9a95-7de4b8ef7d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:30.211837 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa912d-370c-44b4-9a95-7de4b8ef7d23 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:30.216879 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ab716-25bf-4495-9021-213b14c3ea67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:30.217523 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ab716-25bf-4495-9021-213b14c3ea67 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:30.217809 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ab716-25bf-4495-9021-213b14c3ea67 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:30.218083 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ab716-25bf-4495-9021-213b14c3ea67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:30.226004 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ab716-25bf-4495-9021-213b14c3ea67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:30.227603 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ab716-25bf-4495-9021-213b14c3ea67 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:30.235497 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1453/2908] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:56:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:56:31.018967 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a9a8c-522a-42b3-88f3-6b2c89611b1d None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:31.019435 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a9a8c-522a-42b3-88f3-6b2c89611b1d None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:31.019526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a9a8c-522a-42b3-88f3-6b2c89611b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:31.037222 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-924a9a8c-522a-42b3-88f3-6b2c89611b1d None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:31.038670 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-924a9a8c-522a-42b3-88f3-6b2c89611b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:31.046476 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1456/2909] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jun 23 13:56:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:31.058521 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ab716-25bf-4495-9021-213b14c3ea67 service swift] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:31.069145 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ab716-25bf-4495-9021-213b14c3ea67 service swift] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:31.074324 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f2f24-dde5-4379-a140-5d1622294da2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:31.075280 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f2f24-dde5-4379-a140-5d1622294da2 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:31.075280 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f2f24-dde5-4379-a140-5d1622294da2 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:31.075731 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f2f24-dde5-4379-a140-5d1622294da2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:31.084138 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f2f24-dde5-4379-a140-5d1622294da2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:31.085746 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f2f24-dde5-4379-a140-5d1622294da2 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:31.094235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1454/2910] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:56:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:56:31.634388 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71355369-cc78-4fca-886d-37e2ba8eba22 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:31.634697 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71355369-cc78-4fca-886d-37e2ba8eba22 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:31.634972 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71355369-cc78-4fca-886d-37e2ba8eba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:31.652077 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-71355369-cc78-4fca-886d-37e2ba8eba22 None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:31.653289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-71355369-cc78-4fca-886d-37e2ba8eba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:31.660269 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1457/2911] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 23 13:56:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:31.672390 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f2f24-dde5-4379-a140-5d1622294da2 service swift] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:31.683465 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f2f24-dde5-4379-a140-5d1622294da2 service swift] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:31.691256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bdf2b-7b8d-4d6f-90ee-a734ed63947c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:31.691256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bdf2b-7b8d-4d6f-90ee-a734ed63947c service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:31.691256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bdf2b-7b8d-4d6f-90ee-a734ed63947c service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:31.691256 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bdf2b-7b8d-4d6f-90ee-a734ed63947c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:31.698359 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bdf2b-7b8d-4d6f-90ee-a734ed63947c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:31.699945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bdf2b-7b8d-4d6f-90ee-a734ed63947c service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:31.707986 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1455/2912] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:56:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:56:32.291013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5412a-56de-4844-9785-9e9ceaabab23 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:32.291496 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5412a-56de-4844-9785-9e9ceaabab23 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:32.291600 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5412a-56de-4844-9785-9e9ceaabab23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:32.309278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-53a5412a-56de-4844-9785-9e9ceaabab23 None None] MFA Rules not processed for user `09e74199a07b481e837185c93b7c6455`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:32.310461 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-53a5412a-56de-4844-9785-9e9ceaabab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:32.317495 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1458/2913] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jun 23 13:56:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:32.329358 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bdf2b-7b8d-4d6f-90ee-a734ed63947c service swift] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:32.340536 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bdf2b-7b8d-4d6f-90ee-a734ed63947c service swift] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:32.345565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6f403-20ed-4cbb-a562-2ad3694d7da2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d23f1644b94d51a4d0efe47f7aab3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:32.346180 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f403-20ed-4cbb-a562-2ad3694d7da2 service swift] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:32.346466 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f403-20ed-4cbb-a562-2ad3694d7da2 service swift] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:32.346744 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f403-20ed-4cbb-a562-2ad3694d7da2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:32.354655 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6f403-20ed-4cbb-a562-2ad3694d7da2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:32.356213 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6f403-20ed-4cbb-a562-2ad3694d7da2 service swift] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:32.364486 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1456/2914] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 23 13:56:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:56:35.026301 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5412a-56de-4844-9785-9e9ceaabab23 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:35.094178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5412a-56de-4844-9785-9e9ceaabab23 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:35.098640 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:35.107403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:35.107403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:35.107403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] PATH_INFO: `/v3/users/3eadc1946e3b48049e74afef65b60dc9` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:35.107403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eadc1946e3b48049e74afef65b60dc9)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:35.107403 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:35.303056 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eadc1946e3b48049e74afef65b60dc9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:35.303681 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eadc1946e3b48049e74afef65b60dc9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:35.390013 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eadc1946e3b48049e74afef65b60dc9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:35.401951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eadc1946e3b48049e74afef65b60dc9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:35.408652 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eadc1946e3b48049e74afef65b60dc9'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:35.414810 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1459/2915] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:56:35 2022] DELETE /identity/v3/users/3eadc1946e3b48049e74afef65b60dc9 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:56:35.419300 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b183a8-0374-4ef6-a975-51d8415f20bd None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:35.419766 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b183a8-0374-4ef6-a975-51d8415f20bd None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:35.423999 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b183a8-0374-4ef6-a975-51d8415f20bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:35.425631 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=100 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:35.438313 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-64b183a8-0374-4ef6-a975-51d8415f20bd None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:35.439565 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-64b183a8-0374-4ef6-a975-51d8415f20bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:35.496953 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1457/2916] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:35.507118 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:35.508522 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:35.543116 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:35.564297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddad1f-058c-4635-93ae-424aebbee52d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:35.567807 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fd407-32ed-41c9-843d-e023c12754c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:35.568444 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fd407-32ed-41c9-843d-e023c12754c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:35.568753 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fd407-32ed-41c9-843d-e023c12754c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:35.569029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fd407-32ed-41c9-843d-e023c12754c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:35.578362 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fd407-32ed-41c9-843d-e023c12754c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:35.579768 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fd407-32ed-41c9-843d-e023c12754c7 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:35.589290 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1460/2917] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:35.865078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b183a8-0374-4ef6-a975-51d8415f20bd None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:35.865078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-64b183a8-0374-4ef6-a975-51d8415f20bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:35.879212 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b183a8-0374-4ef6-a975-51d8415f20bd None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:35.884546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b8184-514a-42a6-b045-eeb2742ed355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:35.885627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b8184-514a-42a6-b045-eeb2742ed355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:35.885923 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b8184-514a-42a6-b045-eeb2742ed355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:35.886292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b8184-514a-42a6-b045-eeb2742ed355 admin admin] PATH_INFO: `/v3/projects/d1445018bb1645508e48ef89249128d2` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:35.887450 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b8184-514a-42a6-b045-eeb2742ed355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1445018bb1645508e48ef89249128d2)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:35.889464 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b8184-514a-42a6-b045-eeb2742ed355 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:36.007936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7a6b8184-514a-42a6-b045-eeb2742ed355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1445018bb1645508e48ef89249128d2', 'request_id': 'req-7a6b8184-514a-42a6-b045-eeb2742ed355'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:36.084506 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7a6b8184-514a-42a6-b045-eeb2742ed355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1445018bb1645508e48ef89249128d2', 'request_id': 'req-7a6b8184-514a-42a6-b045-eeb2742ed355'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:36.091808 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7a6b8184-514a-42a6-b045-eeb2742ed355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1445018bb1645508e48ef89249128d2', 'request_id': 'req-7a6b8184-514a-42a6-b045-eeb2742ed355'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:36.102093 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7a6b8184-514a-42a6-b045-eeb2742ed355 admin admin] The token cache is being invalidate because project d1445018bb1645508e48ef89249128d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:56:36.102983 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7a6b8184-514a-42a6-b045-eeb2742ed355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:36.103675 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-7a6b8184-514a-42a6-b045-eeb2742ed355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:36.105412 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1458/2918] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:56:35 2022] DELETE /identity/v3/projects/d1445018bb1645508e48ef89249128d2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:56:36.111811 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c2e19-5aaf-41e1-b3c2-549e2d9a78e9 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:36.112278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c2e19-5aaf-41e1-b3c2-549e2d9a78e9 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:36.112375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c2e19-5aaf-41e1-b3c2-549e2d9a78e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:36.130735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-1c7c2e19-5aaf-41e1-b3c2-549e2d9a78e9 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:36.132214 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1c7c2e19-5aaf-41e1-b3c2-549e2d9a78e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:36.191115 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1461/2919] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:36.199186 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa13f-1033-4b95-80d4-315f0a208f81 None None] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:36.199597 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa13f-1033-4b95-80d4-315f0a208f81 None None] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:36.199916 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa13f-1033-4b95-80d4-315f0a208f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:36.218283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.auth.core [None req-273aa13f-1033-4b95-80d4-315f0a208f81 None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:36.219479 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-273aa13f-1033-4b95-80d4-315f0a208f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:36.227296 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1459/2920] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:36.231794 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c2e19-5aaf-41e1-b3c2-549e2d9a78e9 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:36.241338 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c2e19-5aaf-41e1-b3c2-549e2d9a78e9 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:36.245903 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dc521-beba-4d5d-984b-f7c15729688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:36.246555 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dc521-beba-4d5d-984b-f7c15729688f admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:36.246840 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dc521-beba-4d5d-984b-f7c15729688f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:36.247121 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dc521-beba-4d5d-984b-f7c15729688f admin admin] PATH_INFO: `/v3/domains` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:36.247848 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dc521-beba-4d5d-984b-f7c15729688f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:56:36.248158 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dc521-beba-4d5d-984b-f7c15729688f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:36.249797 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dc521-beba-4d5d-984b-f7c15729688f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:36.261067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1462/2921] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 23 13:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:56:36.265067 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa13f-1033-4b95-80d4-315f0a208f81 None None] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:36.274649 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa13f-1033-4b95-80d4-315f0a208f81 None None] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:36.279203 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1144d2-c15a-4b56-90e7-07ba6ab8ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:36.279845 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1144d2-c15a-4b56-90e7-07ba6ab8ad44 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:36.280132 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1144d2-c15a-4b56-90e7-07ba6ab8ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:36.280410 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1144d2-c15a-4b56-90e7-07ba6ab8ad44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:36.281122 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1144d2-c15a-4b56-90e7-07ba6ab8ad44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:36.283008 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1144d2-c15a-4b56-90e7-07ba6ab8ad44 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:36.385608 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1460/2922] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:56:36 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:56:36.389535 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dc521-beba-4d5d-984b-f7c15729688f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:36.400153 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dc521-beba-4d5d-984b-f7c15729688f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:36.454296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cec409-c517-443e-a772-af9613934eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:36.454962 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cec409-c517-443e-a772-af9613934eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:36.455247 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cec409-c517-443e-a772-af9613934eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:36.455524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cec409-c517-443e-a772-af9613934eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:36.456207 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cec409-c517-443e-a772-af9613934eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:36.458140 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cec409-c517-443e-a772-af9613934eb4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:36.521751 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1463/2923] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:56:36 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:56:36.526318 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1144d2-c15a-4b56-90e7-07ba6ab8ad44 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:36.536708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1144d2-c15a-4b56-90e7-07ba6ab8ad44 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:36.541708 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc0a77-0e93-48f9-8263-77d67d846db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:36.542363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc0a77-0e93-48f9-8263-77d67d846db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:36.542651 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc0a77-0e93-48f9-8263-77d67d846db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:36.542987 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc0a77-0e93-48f9-8263-77d67d846db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:36.543756 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc0a77-0e93-48f9-8263-77d67d846db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:36.545398 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc0a77-0e93-48f9-8263-77d67d846db5 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:36.555627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1461/2924] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:56:36.559275 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cec409-c517-443e-a772-af9613934eb4 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:36.569196 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cec409-c517-443e-a772-af9613934eb4 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:36.574326 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8901aa-59b5-42ab-858e-3c4e350aced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:36.574979 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8901aa-59b5-42ab-858e-3c4e350aced4 admin admin] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:36.575262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8901aa-59b5-42ab-858e-3c4e350aced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:36.575539 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8901aa-59b5-42ab-858e-3c4e350aced4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:36.576261 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8901aa-59b5-42ab-858e-3c4e350aced4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:36.577923 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8901aa-59b5-42ab-858e-3c4e350aced4 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:36.588232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1464/2925] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:56:36.592131 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc0a77-0e93-48f9-8263-77d67d846db5 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:36.601911 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc0a77-0e93-48f9-8263-77d67d846db5 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:36.606431 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1348057-0543-4728-ab07-d628595f7ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:36.607301 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1348057-0543-4728-ab07-d628595f7ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:36.607583 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1348057-0543-4728-ab07-d628595f7ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:36.607859 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1348057-0543-4728-ab07-d628595f7ccf admin admin] PATH_INFO: `/v3/projects/2092626dc3a9409690e96187d3a4e8bc/users/16a9195034464dad8908034c1176c2f3/roles/3b950540b0074582839238d2d27d159e` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:36.621924 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1348057-0543-4728-ab07-d628595f7ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2092626dc3a9409690e96187d3a4e8bc, user_id=16a9195034464dad8908034c1176c2f3, role_id=3b950540b0074582839238d2d27d159e)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:36.624554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1348057-0543-4728-ab07-d628595f7ccf admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:36.693025 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1462/2926] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:56:36 2022] PUT /identity/v3/projects/2092626dc3a9409690e96187d3a4e8bc/users/16a9195034464dad8908034c1176c2f3/roles/3b950540b0074582839238d2d27d159e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:56:36.698680 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57361fd5-75a5-4364-9221-cc87b88c0cdd None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:36.698975 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57361fd5-75a5-4364-9221-cc87b88c0cdd None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:36.699258 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57361fd5-75a5-4364-9221-cc87b88c0cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:36.717101 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-57361fd5-75a5-4364-9221-cc87b88c0cdd None None] MFA Rules not processed for user `8182fe078f1d405e804c7fa5779da52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:36.718299 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-57361fd5-75a5-4364-9221-cc87b88c0cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:36.754298 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:36.775371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1465/2927] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:56:36.784823 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1348057-0543-4728-ab07-d628595f7ccf admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:36.788972 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-f1348057-0543-4728-ab07-d628595f7ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:36.812033 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:36.842841 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1348057-0543-4728-ab07-d628595f7ccf admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:36.846660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665412a4-8d65-4a24-8d88-7557398a87c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:36.849821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665412a4-8d65-4a24-8d88-7557398a87c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:36.849821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665412a4-8d65-4a24-8d88-7557398a87c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:36.849821 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665412a4-8d65-4a24-8d88-7557398a87c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:36.856967 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665412a4-8d65-4a24-8d88-7557398a87c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:36.858471 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665412a4-8d65-4a24-8d88-7557398a87c6 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:36.869193 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1463/2928] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:41.856342 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f6a89-0497-4f5d-b102-24c30e2437b8 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:41.856921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f6a89-0497-4f5d-b102-24c30e2437b8 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:41.856921 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f6a89-0497-4f5d-b102-24c30e2437b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:41.885631 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-f15f6a89-0497-4f5d-b102-24c30e2437b8 None None] MFA Rules not processed for user `16a9195034464dad8908034c1176c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:41.887012 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-f15f6a89-0497-4f5d-b102-24c30e2437b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:41.963141 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1466/2929] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:41.967399 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665412a4-8d65-4a24-8d88-7557398a87c6 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:41.977854 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665412a4-8d65-4a24-8d88-7557398a87c6 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:41.982777 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ea080-a756-47d6-a435-80017cb02084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:41.983490 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ea080-a756-47d6-a435-80017cb02084 admin admin] REQUEST_METHOD: `POST` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:41.983771 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ea080-a756-47d6-a435-80017cb02084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:41.984046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ea080-a756-47d6-a435-80017cb02084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:41.984785 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ea080-a756-47d6-a435-80017cb02084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:41.986745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ea080-a756-47d6-a435-80017cb02084 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:42.088082 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1464/2930] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 23 13:56:41 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:56:42.092169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f6a89-0497-4f5d-b102-24c30e2437b8 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:42.104256 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f6a89-0497-4f5d-b102-24c30e2437b8 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:42.164458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882d458-1567-4464-aae5-c89ccd5af51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:42.165724 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882d458-1567-4464-aae5-c89ccd5af51f admin admin] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:42.166170 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882d458-1567-4464-aae5-c89ccd5af51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:42.166350 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882d458-1567-4464-aae5-c89ccd5af51f admin admin] PATH_INFO: `/v3/users` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:42.167065 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882d458-1567-4464-aae5-c89ccd5af51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:42.169047 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882d458-1567-4464-aae5-c89ccd5af51f admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:42.260131 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1467/2931] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 23 13:56:42 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:56:42.264104 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ea080-a756-47d6-a435-80017cb02084 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:42.276230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ea080-a756-47d6-a435-80017cb02084 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:42.281339 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d6a07-8d83-46bf-9d75-5a66045343ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:42.282016 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d6a07-8d83-46bf-9d75-5a66045343ce admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:42.282300 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d6a07-8d83-46bf-9d75-5a66045343ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:42.282578 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d6a07-8d83-46bf-9d75-5a66045343ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:42.283309 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d6a07-8d83-46bf-9d75-5a66045343ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:42.285038 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d6a07-8d83-46bf-9d75-5a66045343ce admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:42.298564 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1465/2932] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:56:42.302784 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882d458-1567-4464-aae5-c89ccd5af51f admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:42.313704 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882d458-1567-4464-aae5-c89ccd5af51f admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:42.318893 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1fb1a-f77a-4046-a9a1-4ac42f1c01a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:42.320042 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1fb1a-f77a-4046-a9a1-4ac42f1c01a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:42.320042 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1fb1a-f77a-4046-a9a1-4ac42f1c01a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:42.320402 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1fb1a-f77a-4046-a9a1-4ac42f1c01a9 admin admin] PATH_INFO: `/v3/projects/dab6988fc148473fab88c02bfb1bf7e9/users/f036d77f51c04e49887dfe7c73c04c32/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:42.340529 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1fb1a-f77a-4046-a9a1-4ac42f1c01a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab6988fc148473fab88c02bfb1bf7e9, user_id=f036d77f51c04e49887dfe7c73c04c32, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:42.343202 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1fb1a-f77a-4046-a9a1-4ac42f1c01a9 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:42.405990 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1468/2933] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:56:42 2022] PUT /identity/v3/projects/dab6988fc148473fab88c02bfb1bf7e9/users/f036d77f51c04e49887dfe7c73c04c32/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:56:42.410037 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d6a07-8d83-46bf-9d75-5a66045343ce admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:42.421298 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d6a07-8d83-46bf-9d75-5a66045343ce admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:42.485707 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5599f4-12fa-4c6b-9b52-4264ec36ca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:42.486397 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5599f4-12fa-4c6b-9b52-4264ec36ca04 admin admin] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:42.486684 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5599f4-12fa-4c6b-9b52-4264ec36ca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:42.486963 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5599f4-12fa-4c6b-9b52-4264ec36ca04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:42.487695 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5599f4-12fa-4c6b-9b52-4264ec36ca04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:42.489384 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5599f4-12fa-4c6b-9b52-4264ec36ca04 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:42.505152 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1466/2934] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 23 13:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:56:42.513646 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1fb1a-f77a-4046-a9a1-4ac42f1c01a9 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:42.519891 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5599f4-12fa-4c6b-9b52-4264ec36ca04 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:42.530621 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1fb1a-f77a-4046-a9a1-4ac42f1c01a9 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:42.538384 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dffba-a0f7-47be-876d-f67606ef9347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:42.539552 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dffba-a0f7-47be-876d-f67606ef9347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:42.540081 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dffba-a0f7-47be-876d-f67606ef9347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:42.540229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dffba-a0f7-47be-876d-f67606ef9347 admin admin] PATH_INFO: `/v3/projects/dab6988fc148473fab88c02bfb1bf7e9/users/f036d77f51c04e49887dfe7c73c04c32/roles/da42ba69df1c4d8a90a6bb1904777e5e` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:42.542424 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dffba-a0f7-47be-876d-f67606ef9347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab6988fc148473fab88c02bfb1bf7e9, user_id=f036d77f51c04e49887dfe7c73c04c32, role_id=da42ba69df1c4d8a90a6bb1904777e5e)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:42.545473 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dffba-a0f7-47be-876d-f67606ef9347 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:42.561618 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1469/2935] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 23 13:56:42 2022] PUT /identity/v3/projects/dab6988fc148473fab88c02bfb1bf7e9/users/f036d77f51c04e49887dfe7c73c04c32/roles/da42ba69df1c4d8a90a6bb1904777e5e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:56:42.601396 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5599f4-12fa-4c6b-9b52-4264ec36ca04 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:42.652276 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:42.660935 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568386a9-0ca8-450a-8906-bcc45add9da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:42.661848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568386a9-0ca8-450a-8906-bcc45add9da2 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:42.662292 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568386a9-0ca8-450a-8906-bcc45add9da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:42.662812 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568386a9-0ca8-450a-8906-bcc45add9da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:42.666571 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-568386a9-0ca8-450a-8906-bcc45add9da2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:42.679370 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568386a9-0ca8-450a-8906-bcc45add9da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:42.681765 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568386a9-0ca8-450a-8906-bcc45add9da2 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:42.702612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1467/2936] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:48.075001 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639806e-5621-4831-9a32-b1113fee5cd4 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:48.075836 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639806e-5621-4831-9a32-b1113fee5cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:48.076122 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639806e-5621-4831-9a32-b1113fee5cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:48.109109 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-2639806e-5621-4831-9a32-b1113fee5cd4 None None] MFA Rules not processed for user `f036d77f51c04e49887dfe7c73c04c32`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:48.110352 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-2639806e-5621-4831-9a32-b1113fee5cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:48.123607 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:48.181858 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1470/2937] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:48.197267 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568386a9-0ca8-450a-8906-bcc45add9da2 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:48.198731 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-568386a9-0ca8-450a-8906-bcc45add9da2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:48.275228 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568386a9-0ca8-450a-8906-bcc45add9da2 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:48.280936 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66d784-f8a4-46e8-a033-5aacff7dca71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:48.281600 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66d784-f8a4-46e8-a033-5aacff7dca71 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:48.281884 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66d784-f8a4-46e8-a033-5aacff7dca71 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:48.282161 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66d784-f8a4-46e8-a033-5aacff7dca71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:48.343194 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66d784-f8a4-46e8-a033-5aacff7dca71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:48.344848 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66d784-f8a4-46e8-a033-5aacff7dca71 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:48.354937 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1468/2938] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:51.254701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8f2e4-1e06-408a-8946-4210e3614684 None None] REQUEST_METHOD: `POST` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:51.255179 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8f2e4-1e06-408a-8946-4210e3614684 None None] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:51.255297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8f2e4-1e06-408a-8946-4210e3614684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:51.273083 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.auth.core [None req-0de8f2e4-1e06-408a-8946-4210e3614684 None None] MFA Rules not processed for user `16a9195034464dad8908034c1176c2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:51.274313 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-0de8f2e4-1e06-408a-8946-4210e3614684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:51.281186 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1471/2939] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 23 13:56:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:58.350314 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=62 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:01.268029 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=26 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:20.366883 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66d784-f8a4-46e8-a033-5aacff7dca71 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:20.368499 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ca66d784-f8a4-46e8-a033-5aacff7dca71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:20.439381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66d784-f8a4-46e8-a033-5aacff7dca71 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:20.444375 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dce881-fbe5-4d8e-8002-8c300b15b5cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:20.445057 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dce881-fbe5-4d8e-8002-8c300b15b5cb service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:20.445343 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dce881-fbe5-4d8e-8002-8c300b15b5cb service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:20.445625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dce881-fbe5-4d8e-8002-8c300b15b5cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:20.447393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-63dce881-fbe5-4d8e-8002-8c300b15b5cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:20.458685 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dce881-fbe5-4d8e-8002-8c300b15b5cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:20.460289 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dce881-fbe5-4d8e-8002-8c300b15b5cb service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:20.470789 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1469/2940] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:24.361274 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8f2e4-1e06-408a-8946-4210e3614684 None None] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:24.376297 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8f2e4-1e06-408a-8946-4210e3614684 None None] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:24.383475 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4bdb-28af-4476-bf5b-5a8ae8554c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:24.384524 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4bdb-28af-4476-bf5b-5a8ae8554c34 service nova] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:24.385735 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4bdb-28af-4476-bf5b-5a8ae8554c34 service nova] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:24.386178 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4bdb-28af-4476-bf5b-5a8ae8554c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:24.388217 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-056a4bdb-28af-4476-bf5b-5a8ae8554c34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:24.403006 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4bdb-28af-4476-bf5b-5a8ae8554c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:24.404626 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4bdb-28af-4476-bf5b-5a8ae8554c34 service nova] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:24.416891 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1472/2941] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:30.466511 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=32 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:34.396489 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dce881-fbe5-4d8e-8002-8c300b15b5cb service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:34.411220 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:34.430553 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dce881-fbe5-4d8e-8002-8c300b15b5cb service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:34.436850 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470ba1a-5300-4414-89d2-51b4f6f83026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5874e98df57242028c0f9983dee3b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:34.437501 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470ba1a-5300-4414-89d2-51b4f6f83026 service nova] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:34.437791 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470ba1a-5300-4414-89d2-51b4f6f83026 service nova] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:34.438078 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470ba1a-5300-4414-89d2-51b4f6f83026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:34.439877 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-9470ba1a-5300-4414-89d2-51b4f6f83026 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:34.472190 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470ba1a-5300-4414-89d2-51b4f6f83026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:34.473865 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470ba1a-5300-4414-89d2-51b4f6f83026 service nova] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:34.485636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1470/2942] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:37.996067 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4bdb-28af-4476-bf5b-5a8ae8554c34 service nova] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:38.005328 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4bdb-28af-4476-bf5b-5a8ae8554c34 service nova] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:38.008906 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b53d47-47d0-4d08-af8e-a000488f0bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:38.009534 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b53d47-47d0-4d08-af8e-a000488f0bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:38.009818 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b53d47-47d0-4d08-af8e-a000488f0bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:38.010095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b53d47-47d0-4d08-af8e-a000488f0bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:38.018909 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b53d47-47d0-4d08-af8e-a000488f0bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:38.020336 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b53d47-47d0-4d08-af8e-a000488f0bb2 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:38.029902 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1473/2943] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:41.376285 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470ba1a-5300-4414-89d2-51b4f6f83026 service nova] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:41.397167 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470ba1a-5300-4414-89d2-51b4f6f83026 service nova] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:41.402392 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6883a-07a7-42db-bb1f-132d4cc21c77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:41.403076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6883a-07a7-42db-bb1f-132d4cc21c77 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:41.403366 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6883a-07a7-42db-bb1f-132d4cc21c77 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:41.403646 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6883a-07a7-42db-bb1f-132d4cc21c77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:41.405459 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-17e6883a-07a7-42db-bb1f-132d4cc21c77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:41.430329 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6883a-07a7-42db-bb1f-132d4cc21c77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:41.431904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6883a-07a7-42db-bb1f-132d4cc21c77 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:41.442363 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1471/2944] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:48.025710 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:51.438026 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=38 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:58:33.700259 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b53d47-47d0-4d08-af8e-a000488f0bb2 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:58:33.730012 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b53d47-47d0-4d08-af8e-a000488f0bb2 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:58:33.733684 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8a027-d7b1-42c1-9a1d-973db996ac8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:58:33.734321 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8a027-d7b1-42c1-9a1d-973db996ac8c service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:58:33.734606 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8a027-d7b1-42c1-9a1d-973db996ac8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:58:33.734885 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8a027-d7b1-42c1-9a1d-973db996ac8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:58:33.736650 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-74d8a027-d7b1-42c1-9a1d-973db996ac8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:58:33.820262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8a027-d7b1-42c1-9a1d-973db996ac8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:58:33.821729 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8a027-d7b1-42c1-9a1d-973db996ac8c service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:58:33.842547 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1474/2945] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 13:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:58:40.970239 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6883a-07a7-42db-bb1f-132d4cc21c77 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:58:40.971961 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-17e6883a-07a7-42db-bb1f-132d4cc21c77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:58:40.988780 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6883a-07a7-42db-bb1f-132d4cc21c77 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:58:40.994117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:58:40.994117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:58:40.994362 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:58:40.994625 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] PATH_INFO: `/v3/users/68cb1f2b1bc349b99aab575d48d9eada` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:58:40.995798 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=68cb1f2b1bc349b99aab575d48d9eada)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:58:40.997774 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:58:41.183592 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68cb1f2b1bc349b99aab575d48d9eada'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:41.184247 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68cb1f2b1bc349b99aab575d48d9eada'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:41.184892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68cb1f2b1bc349b99aab575d48d9eada'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:41.197491 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68cb1f2b1bc349b99aab575d48d9eada'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:41.205477 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68cb1f2b1bc349b99aab575d48d9eada'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:41.318563 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1472/2946] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:58:40 2022] DELETE /identity/v3/users/68cb1f2b1bc349b99aab575d48d9eada => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:58:41.571095 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8a027-d7b1-42c1-9a1d-973db996ac8c service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:58:41.581174 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8a027-d7b1-42c1-9a1d-973db996ac8c service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:58:41.638672 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:58:41.639458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:58:41.639758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:58:41.640038 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] PATH_INFO: `/v3/projects/f9bb0d479a7e4a9eb74cd6ea82462505` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:58:41.641245 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9bb0d479a7e4a9eb74cd6ea82462505)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:58:41.643165 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:58:41.759493 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:58:41.760722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9bb0d479a7e4a9eb74cd6ea82462505', 'request_id': 'req-beaa9d34-1cde-4718-ada2-0983be7ec41d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:41.766699 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9bb0d479a7e4a9eb74cd6ea82462505', 'request_id': 'req-beaa9d34-1cde-4718-ada2-0983be7ec41d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:41.771963 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9bb0d479a7e4a9eb74cd6ea82462505', 'request_id': 'req-beaa9d34-1cde-4718-ada2-0983be7ec41d'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:41.822762 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] The token cache is being invalidate because project f9bb0d479a7e4a9eb74cd6ea82462505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:58:41.823044 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:41.823806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:41.825364 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1475/2947] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:58:41 2022] DELETE /identity/v3/projects/f9bb0d479a7e4a9eb74cd6ea82462505 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:58:41.830393 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:58:41.831817 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:58:41.845842 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84941b-20e7-4335-b1fe-b85f7a001afd admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:58:41.902022 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:58:41.902864 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:58:41.903151 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:58:41.903428 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] PATH_INFO: `/v3/users/de11beebd2b3487baad6127662d9e52b` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:58:41.904587 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de11beebd2b3487baad6127662d9e52b)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:58:41.906554 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:58:42.048222 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de11beebd2b3487baad6127662d9e52b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:42.048945 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de11beebd2b3487baad6127662d9e52b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:42.049505 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de11beebd2b3487baad6127662d9e52b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:42.062115 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de11beebd2b3487baad6127662d9e52b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:42.066542 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:58:42.069441 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de11beebd2b3487baad6127662d9e52b'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:42.181599 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1473/2948] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 13:58:41 2022] DELETE /identity/v3/users/de11beebd2b3487baad6127662d9e52b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:58:42.486380 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:58:42.487822 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:58:42.501113 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa9d34-1cde-4718-ada2-0983be7ec41d admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:58:42.556819 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:58:42.557712 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:58:42.557999 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:58:42.558280 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] PATH_INFO: `/v3/projects/fb85b350124249c8aab127b0e25d73fa` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:58:42.559486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb85b350124249c8aab127b0e25d73fa)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:58:42.561419 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:58:42.692019 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb85b350124249c8aab127b0e25d73fa', 'request_id': 'req-abc8fc6b-125f-462b-8a00-4932261cdace'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:42.698232 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb85b350124249c8aab127b0e25d73fa', 'request_id': 'req-abc8fc6b-125f-462b-8a00-4932261cdace'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:42.704349 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb85b350124249c8aab127b0e25d73fa', 'request_id': 'req-abc8fc6b-125f-462b-8a00-4932261cdace'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:42.808892 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] The token cache is being invalidate because project fb85b350124249c8aab127b0e25d73fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:58:42.809097 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:42.809722 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:58:42.811250 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1476/2949] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 13:58:42 2022] DELETE /identity/v3/projects/fb85b350124249c8aab127b0e25d73fa => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:58:52.301476 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=4,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:58:52.805660 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 14:00:08.591807 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:00:08.593368 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:00:08.661697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1975fc-29db-4b44-896a-0466866b112b admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:00:08.708614 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0eb9f-3102-4362-8870-9529d409d589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:00:08.709606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0eb9f-3102-4362-8870-9529d409d589 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:00:08.709907 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0eb9f-3102-4362-8870-9529d409d589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:00:08.710183 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0eb9f-3102-4362-8870-9529d409d589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:00:08.712252 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1ff0eb9f-3102-4362-8870-9529d409d589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:00:08.722697 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0eb9f-3102-4362-8870-9529d409d589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:00:08.724126 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0eb9f-3102-4362-8870-9529d409d589 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:00:08.732048 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1474/2950] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 14:00:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 14:00:09.069458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:00:09.069458 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:00:09.077748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8fc6b-125f-462b-8a00-4932261cdace admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:00:09.081824 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081abdf6-98e5-430c-9441-857a795bb290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:00:09.082485 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081abdf6-98e5-430c-9441-857a795bb290 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:00:09.082772 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081abdf6-98e5-430c-9441-857a795bb290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:00:09.083056 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081abdf6-98e5-430c-9441-857a795bb290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:00:09.084934 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-081abdf6-98e5-430c-9441-857a795bb290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:00:09.095703 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081abdf6-98e5-430c-9441-857a795bb290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:00:09.097228 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081abdf6-98e5-430c-9441-857a795bb290 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:00:09.106062 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1477/2951] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 14:00:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 14:00:10.195678 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0eb9f-3102-4362-8870-9529d409d589 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:00:10.197235 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1ff0eb9f-3102-4362-8870-9529d409d589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:00:10.207531 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0eb9f-3102-4362-8870-9529d409d589 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:00:10.211346 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f464ef-5b60-4d06-8d27-af7fec6a273e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:00:10.211997 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f464ef-5b60-4d06-8d27-af7fec6a273e service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:00:10.212283 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f464ef-5b60-4d06-8d27-af7fec6a273e service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:00:10.212562 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f464ef-5b60-4d06-8d27-af7fec6a273e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:00:10.214372 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-60f464ef-5b60-4d06-8d27-af7fec6a273e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:00:10.287127 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f464ef-5b60-4d06-8d27-af7fec6a273e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:00:10.288567 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f464ef-5b60-4d06-8d27-af7fec6a273e service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:00:10.300601 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1475/2952] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 14:00:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 14:00:19.102639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 14:00:20.295806 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=85 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 14:01:46.754758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081abdf6-98e5-430c-9441-857a795bb290 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:01:46.764169 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081abdf6-98e5-430c-9441-857a795bb290 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:01:46.767748 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ef2fe-ea24-4bae-bdba-084b2bd67507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:01:46.768375 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ef2fe-ea24-4bae-bdba-084b2bd67507 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:01:46.768674 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ef2fe-ea24-4bae-bdba-084b2bd67507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:01:46.768958 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ef2fe-ea24-4bae-bdba-084b2bd67507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:01:46.770720 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5e1ef2fe-ea24-4bae-bdba-084b2bd67507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:01:46.780087 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ef2fe-ea24-4bae-bdba-084b2bd67507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:01:46.781526 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ef2fe-ea24-4bae-bdba-084b2bd67507 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:01:46.789263 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1478/2953] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 14:01:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 14:01:56.785758 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=6 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 14:01:58.453481 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f464ef-5b60-4d06-8d27-af7fec6a273e service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:01:58.462216 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f464ef-5b60-4d06-8d27-af7fec6a273e service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:01:58.465904 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6adc46-38aa-4e65-8966-b39144782192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:01:58.466548 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6adc46-38aa-4e65-8966-b39144782192 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:01:58.466833 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6adc46-38aa-4e65-8966-b39144782192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:01:58.467117 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6adc46-38aa-4e65-8966-b39144782192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:01:58.468880 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1f6adc46-38aa-4e65-8966-b39144782192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:01:58.526046 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6adc46-38aa-4e65-8966-b39144782192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:01:58.527546 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6adc46-38aa-4e65-8966-b39144782192 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:01:58.536713 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1476/2954] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 14:01:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 14:01:59.949132 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ef2fe-ea24-4bae-bdba-084b2bd67507 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:01:59.961161 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ef2fe-ea24-4bae-bdba-084b2bd67507 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:01:59.966588 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e153-98a1-427f-b458-e35c3202e88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:01:59.967516 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e153-98a1-427f-b458-e35c3202e88f service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:01:59.967904 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e153-98a1-427f-b458-e35c3202e88f service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:01:59.968512 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e153-98a1-427f-b458-e35c3202e88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:01:59.970426 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-16f9e153-98a1-427f-b458-e35c3202e88f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:01:59.984882 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e153-98a1-427f-b458-e35c3202e88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:01:59.986257 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e153-98a1-427f-b458-e35c3202e88f service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:01:59.998430 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1479/2955] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 14:01:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 14:02:01.175776 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6adc46-38aa-4e65-8966-b39144782192 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:02:01.184610 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6adc46-38aa-4e65-8966-b39144782192 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:02:01.188231 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0debd-8042-4b70-9087-9f3288a48859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:02:01.188898 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0debd-8042-4b70-9087-9f3288a48859 service neutron] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:02:01.189185 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0debd-8042-4b70-9087-9f3288a48859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:02:01.189461 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0debd-8042-4b70-9087-9f3288a48859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:02:01.191745 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e2f0debd-8042-4b70-9087-9f3288a48859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:02:01.205158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0debd-8042-4b70-9087-9f3288a48859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:02:01.207360 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0debd-8042-4b70-9087-9f3288a48859 service neutron] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:02:01.218453 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1477/2956] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 14:02:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 14:02:04.913316 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e153-98a1-427f-b458-e35c3202e88f service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:02:04.922454 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e153-98a1-427f-b458-e35c3202e88f service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:02:04.929803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e1313-4661-497c-a6d8-96eeed291ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1eb257517674c63840d6a2090eb2200', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:02:04.929803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e1313-4661-497c-a6d8-96eeed291ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:02:04.929803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e1313-4661-497c-a6d8-96eeed291ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:02:04.929803 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e1313-4661-497c-a6d8-96eeed291ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:02:04.930189 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-5b1e1313-4661-497c-a6d8-96eeed291ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:02:04.991806 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e1313-4661-497c-a6d8-96eeed291ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:02:04.993277 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e1313-4661-497c-a6d8-96eeed291ae4 service neutron] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:02:05.002706 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1480/2957] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 14:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 14:02:08.451574 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0debd-8042-4b70-9087-9f3288a48859 service neutron] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:02:08.453074 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-e2f0debd-8042-4b70-9087-9f3288a48859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:02:08.524740 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0debd-8042-4b70-9087-9f3288a48859 service neutron] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:02:08.529677 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b6527-c6ab-4c31-8d92-7b9ba7cae166 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:02:08.530325 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b6527-c6ab-4c31-8d92-7b9ba7cae166 service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:02:08.530612 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b6527-c6ab-4c31-8d92-7b9ba7cae166 service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:02:08.530892 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b6527-c6ab-4c31-8d92-7b9ba7cae166 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:02:08.532627 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ee8b6527-c6ab-4c31-8d92-7b9ba7cae166 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:02:08.544733 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b6527-c6ab-4c31-8d92-7b9ba7cae166 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:02:08.546348 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b6527-c6ab-4c31-8d92-7b9ba7cae166 service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:02:08.556956 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1478/2958] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 14:02:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 14:02:12.031472 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e1313-4661-497c-a6d8-96eeed291ae4 service neutron] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:02:12.043855 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e1313-4661-497c-a6d8-96eeed291ae4 service neutron] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:02:12.049242 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48200a16-540e-4ca5-a037-1da6ebfcc709 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:02:12.049881 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48200a16-540e-4ca5-a037-1da6ebfcc709 service placement] REQUEST_METHOD: `GET` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:02:12.050162 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48200a16-540e-4ca5-a037-1da6ebfcc709 service placement] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:02:12.050439 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48200a16-540e-4ca5-a037-1da6ebfcc709 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:02:12.054272 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-48200a16-540e-4ca5-a037-1da6ebfcc709 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:02:12.065376 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48200a16-540e-4ca5-a037-1da6ebfcc709 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:02:12.067486 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48200a16-540e-4ca5-a037-1da6ebfcc709 service placement] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:02:12.077610 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1481/2959] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 14:02:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 14:02:12.159233 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b6527-c6ab-4c31-8d92-7b9ba7cae166 service placement] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:02:12.160803 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-ee8b6527-c6ab-4c31-8d92-7b9ba7cae166 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:02:12.174934 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b6527-c6ab-4c31-8d92-7b9ba7cae166 service placement] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:02:12.179460 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:02:12.180350 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:02:12.180683 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:02:12.180988 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] PATH_INFO: `/v3/users/16a9195034464dad8908034c1176c2f3` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:02:12.182158 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a9195034464dad8908034c1176c2f3)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:02:12.184055 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:02:12.341970 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a9195034464dad8908034c1176c2f3'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:12.342636 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a9195034464dad8908034c1176c2f3'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:12.343239 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a9195034464dad8908034c1176c2f3'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:12.355068 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a9195034464dad8908034c1176c2f3'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:12.359660 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 14:02:12.362609 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a9195034464dad8908034c1176c2f3'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:12.425381 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1479/2960] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 14:02:12 2022] DELETE /identity/v3/users/16a9195034464dad8908034c1176c2f3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 14:02:12.645229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48200a16-540e-4ca5-a037-1da6ebfcc709 service placement] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:02:12.655761 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48200a16-540e-4ca5-a037-1da6ebfcc709 service placement] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:02:12.714537 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:02:12.715391 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:02:12.715672 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:02:12.715951 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] PATH_INFO: `/v3/projects/2092626dc3a9409690e96187d3a4e8bc` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:02:12.717150 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2092626dc3a9409690e96187d3a4e8bc)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:02:12.719033 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:02:12.810371 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2092626dc3a9409690e96187d3a4e8bc', 'request_id': 'req-1301033f-50f0-44fa-9525-a807cbb19940'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:12.816715 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2092626dc3a9409690e96187d3a4e8bc', 'request_id': 'req-1301033f-50f0-44fa-9525-a807cbb19940'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:12.822289 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2092626dc3a9409690e96187d3a4e8bc', 'request_id': 'req-1301033f-50f0-44fa-9525-a807cbb19940'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:12.867244 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 14:02:12.871931 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] The token cache is being invalidate because project 2092626dc3a9409690e96187d3a4e8bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 14:02:12.872215 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:12.872864 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:12.878296 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1482/2961] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 14:02:12 2022] DELETE /identity/v3/projects/2092626dc3a9409690e96187d3a4e8bc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 14:02:12.878606 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:02:12.880468 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:02:12.893807 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f60df3-3e41-4097-b554-9054061cb711 admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:02:12.950456 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:02:12.951326 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:02:12.951613 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:02:12.951894 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] PATH_INFO: `/v3/users/f036d77f51c04e49887dfe7c73c04c32` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:02:12.953112 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f036d77f51c04e49887dfe7c73c04c32)` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:02:12.955049 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:02:13.165021 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f036d77f51c04e49887dfe7c73c04c32'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:13.165626 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f036d77f51c04e49887dfe7c73c04c32'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:13.166194 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f036d77f51c04e49887dfe7c73c04c32'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:13.178886 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f036d77f51c04e49887dfe7c73c04c32'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:13.185686 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.notifications [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f036d77f51c04e49887dfe7c73c04c32'} {{(pid=80258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:13.288526 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1480/2962] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 23 14:02:12 2022] DELETE /identity/v3/users/f036d77f51c04e49887dfe7c73c04c32 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 14:02:13.543230 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] Authenticating user token {{(pid=80259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:02:13.545229 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.fernet_utils [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:02:13.558197 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301033f-50f0-44fa-9525-a807cbb19940 admin admin] Validating token access rules against request {{(pid=80259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:02:13.616639 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182fe078f1d405e804c7fa5779da52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '573a8643ae104193ab15bb005adb20d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:02:13.617523 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:02:13.617812 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b admin admin] SCRIPT_NAME: `/identity` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:02:13.618090 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b admin admin] PATH_INFO: `/v3/projects/dab6988fc148473fab88c02bfb1bf7e9` {{(pid=80259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:02:13.619278 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab6988fc148473fab88c02bfb1bf7e9)` {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:02:13.621246 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b admin admin] RBAC: Authorization granted {{(pid=80259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:02:13.735009 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab6988fc148473fab88c02bfb1bf7e9', 'request_id': 'req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:13.741110 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab6988fc148473fab88c02bfb1bf7e9', 'request_id': 'req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:13.746663 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab6988fc148473fab88c02bfb1bf7e9', 'request_id': 'req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b'} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:13.813483 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b admin admin] The token cache is being invalidate because project dab6988fc148473fab88c02bfb1bf7e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80259) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 14:02:13.813701 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:13.814325 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG keystone.notifications [None req-e2f63def-dae7-4ae1-b71a-b2e96e0b605b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 14:02:13.815877 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: [pid: 80259|app: 0|req: 1483/2963] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 23 14:02:13 2022] DELETE /identity/v3/projects/dab6988fc148473fab88c02bfb1bf7e9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 14:02:23.284762 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=57,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 14:02:23.810262 dv-cinder-847335-1-iscsi devstack@keystone.service[80259]: DEBUG dbcounter [-] [80259] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 14:02:44.316304 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] Authenticating user token {{(pid=80258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 14:02:44.317753 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:02:44.384540 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c268456-043b-4453-bfcf-570a9758859f admin admin] Validating token access rules against request {{(pid=80258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 14:02:44.441133 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e4ea7-26dc-4b39-a55c-887fd90ad8bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8644754798b5439c954c86dc9aa9e7af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '311787f32b54485682be669bca9998f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 14:02:44.441775 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e4ea7-26dc-4b39-a55c-887fd90ad8bc service placement] REQUEST_METHOD: `GET` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 14:02:44.442058 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e4ea7-26dc-4b39-a55c-887fd90ad8bc service placement] SCRIPT_NAME: `/identity` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 14:02:44.442333 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e4ea7-26dc-4b39-a55c-887fd90ad8bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 14:02:44.444076 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.fernet_utils [None req-815e4ea7-26dc-4b39-a55c-887fd90ad8bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 14:02:44.454917 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e4ea7-26dc-4b39-a55c-887fd90ad8bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 14:02:44.456520 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e4ea7-26dc-4b39-a55c-887fd90ad8bc service placement] RBAC: Authorization granted {{(pid=80258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 14:02:44.466411 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: [pid: 80258|app: 0|req: 1481/2964] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 23 14:02:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 14:02:54.462230 dv-cinder-847335-1-iscsi devstack@keystone.service[80258]: DEBUG dbcounter [-] [80258] Writing DB stats keystone:SELECT=58 {{(pid=80258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}